Sep 19 10:32:30.139277 ip-10-0-143-186 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 19 10:32:30.139288 ip-10-0-143-186 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 19 10:32:30.139295 ip-10-0-143-186 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 19 10:32:30.139542 ip-10-0-143-186 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 19 10:32:40.202149 ip-10-0-143-186 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 19 10:32:40.202167 ip-10-0-143-186 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6c9892163e5648459a80f91a74d50e13 --
Sep 19 10:34:35.708999 ip-10-0-143-186 systemd[1]: Starting Kubernetes Kubelet...
Sep 19 10:34:39.007971 ip-10-0-143-186 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 10:34:39.007971 ip-10-0-143-186 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 19 10:34:39.007971 ip-10-0-143-186 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 10:34:39.007971 ip-10-0-143-186 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 19 10:34:39.007971 ip-10-0-143-186 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 10:34:39.008716 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.008045    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 19 10:34:39.011407 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011388    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 10:34:39.011407 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011405    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 10:34:39.011407 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011409    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011413    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011417    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011420    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011423    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011426    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011430    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011432    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011435    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011438    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011444    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011447    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011450    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011454    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011457    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011460    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011463    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011466    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011468    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011471    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 10:34:39.011499 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011474    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011476    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011479    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011482    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011485    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011487    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011490    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011493    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011496    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011498    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011501    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011505    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011508    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011511    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011514    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011517    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011520    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011523    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011525    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011529    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 10:34:39.012004 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011531    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011534    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011536    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011539    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011542    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011544    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011547    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011549    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011552    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011554    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011557    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011560    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011562    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011565    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011569    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011572    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011575    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011578    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011581    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 10:34:39.012587 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011584    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011588    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011592    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011595    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011598    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011601    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011604    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011607    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011610    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011612    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011615    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011618    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011621    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011624    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011626    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011629    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011632    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011634    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011637    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 10:34:39.013079 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011640    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011644    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011647    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011650    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011653    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011656    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011659    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011662    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011666    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011669    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011672    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011675    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011677    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011680    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011682    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011685    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011688    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011691    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.011695    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 10:34:39.013582 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012444    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012453    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012457    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012460    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012463    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012466    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012469    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012472    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012476    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012479    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012482    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012484    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012487    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012490    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012492    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012495    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012498    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012500    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012503    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012506    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 10:34:39.014073 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012509    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012512    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012515    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012518    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012520    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012523    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012526    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012532    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012536    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012539    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012542    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012545    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012547    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012550    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012552    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012555    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012558    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012561    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012564    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 10:34:39.014620 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012566    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012569    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012572    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012575    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012578    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012581    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012584    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012586    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012591    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012595    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012598    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012601    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012603    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012606    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012610    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012613    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012617    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012620    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012624    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012627    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 10:34:39.015126 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012630    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012633    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012636    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012639    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012642    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012645    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012648    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012650    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012653    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012656    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012658    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012661    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012664    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012670    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012674    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012678    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012681    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012684    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012687    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 10:34:39.015615 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012690    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012692    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012695    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012697    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012700    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012702    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012705    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012708    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012711    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012714    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012716    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012719    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012738    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012741    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012744    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012746    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012749    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012752    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012754    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012757    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 10:34:39.016082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.012760    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013141    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013148    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013152    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013156    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013159    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013162    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013164    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013168    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013170    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013173    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013176    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013179    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013182    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013185    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013188    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013190    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013193    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013196    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 10:34:39.016560 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013198    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013201    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013204    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013206    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013209    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013214    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013216    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013219    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013222    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013225    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013228    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013230    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013233    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013236    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013238    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013241    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013244    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013246    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013249    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013251    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 10:34:39.017051 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013254    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013257    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013260    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013263    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013265    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013269    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013273    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013277    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013280    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013283    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013286    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013291    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013294    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013296    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013300    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013302    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013305    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013309    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013312    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 10:34:39.017530 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013315    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013317    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013320    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013322    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013325    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013328    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013330    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013333    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013336    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013338    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013341    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013344    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013347    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013349    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013352    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013354    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013357    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013360    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013381    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013385    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 10:34:39.018011 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013388    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013391    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013393    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013396    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013399    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013402    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013405    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013408    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013410    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013413    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013418    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013420    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013423    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013426    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013428    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013431    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013434    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013436    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013439    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013441    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 10:34:39.018513 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013444    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.013447    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013516    2579 flags.go:64] FLAG: --address="0.0.0.0"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013557    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013567    2579 flags.go:64] FLAG: --anonymous-auth="true"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013572    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013576    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013579    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013584    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013591    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013596    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013599    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013603    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013607    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013610    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013614    2579 flags.go:64] FLAG: --cgroup-root=""
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013617    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013620    2579 flags.go:64] FLAG: --client-ca-file=""
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013623    2579 flags.go:64] FLAG: --cloud-provider="external"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013626    2579 flags.go:64] FLAG: --cluster-dns="[]"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013631    2579 flags.go:64] FLAG: --cluster-domain=""
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013634    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013638    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013641    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 19 10:34:39.019015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013645    2579 flags.go:64] FLAG: --container-log-max-files="5"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013648    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013652    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013655    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013658    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013661    2579 flags.go:64] FLAG: --contention-profiling="false"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013664    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013668    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013671    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013674    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013678    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013681    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013684    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013687    2579 flags.go:64] FLAG: --enable-load-reader="false"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013690    2579 flags.go:64] FLAG: --enable-server="true"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013693    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013698    2579 flags.go:64] FLAG: --event-burst="100"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013702    2579 flags.go:64] FLAG: --event-qps="50"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013709    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013712    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013715    2579 flags.go:64] FLAG: --eviction-hard=""
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013719    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013735    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013739    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013742    2579 flags.go:64] FLAG: --eviction-soft=""
Sep 19 10:34:39.019640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013745    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013748    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013751    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013754    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013757    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013761    2579 flags.go:64] FLAG: --fail-swap-on="true"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013764    2579 flags.go:64] FLAG: --feature-gates=""
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013768    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013771    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013774    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013778    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013781    2579 flags.go:64] FLAG: --healthz-port="10248"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013784    2579 flags.go:64] FLAG: --help="false"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013787    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013790    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013793    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013796    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013800    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013803    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013806    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013809    2579 flags.go:64] FLAG: --image-service-endpoint=""
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013812    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013815    2579 flags.go:64] FLAG: --kube-api-burst="100"
Sep 19 10:34:39.020246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013818    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013821    2579 flags.go:64] FLAG: --kube-api-qps="50"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013826    2579 flags.go:64] FLAG: --kube-reserved=""
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013833    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013836    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013840    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013843    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013846    2579 flags.go:64] FLAG: --lock-file=""
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013848    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013851    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013854    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013860    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013863    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013866    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013869    2579 flags.go:64] FLAG: --logging-format="text"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013872    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013875    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013878    2579 flags.go:64] FLAG: --manifest-url=""
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013881    2579 flags.go:64] FLAG: --manifest-url-header=""
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013886    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013889    2579 flags.go:64] FLAG: --max-open-files="1000000"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013897    2579 flags.go:64] FLAG: --max-pods="110"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013901    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013904    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013907    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 19 10:34:39.020851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013910    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013913    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013916    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013919    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013927    2579 flags.go:64] FLAG: --node-status-max-images="50"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013930    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013933    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013936    2579 flags.go:64] FLAG: --pod-cidr=""
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013940    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013945    2579 flags.go:64] FLAG: --pod-manifest-path=""
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013950    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013954    2579 flags.go:64] FLAG: --pods-per-core="0"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013957    2579 flags.go:64] FLAG: --port="10250"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013960    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013963    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09163d9948cca6f76"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013967    2579 flags.go:64] FLAG: --qos-reserved=""
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013970    2579 flags.go:64] FLAG: --read-only-port="10255"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013973    2579 flags.go:64] FLAG: --register-node="true"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013976    2579 flags.go:64] FLAG: --register-with-taints=""
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013979    2579 flags.go:64] FLAG: --registry-burst="10"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013982    2579 flags.go:64] FLAG: --registry-qps="5"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013985    2579 flags.go:64] FLAG: --reserved-cpus=""
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013988    2579 flags.go:64] FLAG: --reserved-memory=""
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013992    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013995    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 19 10:34:39.021455 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.013998    2579 flags.go:64] FLAG: --rotate-certificates="false"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014001    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014004    2579 flags.go:64] FLAG: --runonce="false"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014007    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014011    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014014    2579 flags.go:64] FLAG: --seccomp-default="false"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014017    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014020    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014023    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014026    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014029    2579 flags.go:64] FLAG: --storage-driver-password="root"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014031    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014035    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014038    2579 flags.go:64] FLAG: --storage-driver-user="root"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014041    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014044    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014047    2579 flags.go:64] FLAG: --system-cgroups=""
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014051    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014057    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014060    2579 flags.go:64] FLAG: --tls-cert-file=""
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014063    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014068    2579 flags.go:64] FLAG: --tls-min-version=""
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014070    2579 flags.go:64] FLAG: --tls-private-key-file=""
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014073    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014076    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 19 10:34:39.022102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014080    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014083    2579 flags.go:64] FLAG: --v="2"
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014087    2579 flags.go:64] FLAG: --version="false"
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014093    2579 flags.go:64] FLAG: --vmodule=""
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014097    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014100    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014224    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014228    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014231    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014234    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014238    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014241    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014244    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014248    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014251    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014254    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014257    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014260    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014264    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014267    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014270    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014273    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 10:34:39.023099 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014276    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014278    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014283    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014286    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014289    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014292    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014295    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014297    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014300    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014303    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014305    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014308    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014311    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014317    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014320    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014323    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014325    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014328    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014331    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014334    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 10:34:39.023999 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014337    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014339    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014342    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014345    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014348    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014351    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014353    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014356    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014359    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014362    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014365    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014367    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014370    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014372    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014376    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014379    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014382    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014385    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014388    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014390    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 10:34:39.024502 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014393    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014396    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014399    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014401    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014404    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014408    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014411    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014416    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014419    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014422    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014425    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014428    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014439    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014443    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014447    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014451    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014454    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014457    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014460    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 10:34:39.025041 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014462    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014465    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014468    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014470    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014473    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014476    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014478    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014482    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014485    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014488    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014491    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014493    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014496    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014501    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014504    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014507    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014510    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014513    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014518    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 10:34:39.025522 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014521    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014524    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014527    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014530    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.014533    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.014973    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.024006    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.024021    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.024042    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.024047    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024103    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024107    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024111    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024115    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024118    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 10:34:39.026005 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024121    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024124    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024127    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024130    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024133    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024136    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024138    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024141    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024144    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024146    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024149    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024152    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024155    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024158    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024160    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024163    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024166    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024169    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024171    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024174    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 10:34:39.026386 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024177    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024185    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024188    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024191    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024194    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024197    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024199    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024202    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024205    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024208    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024210    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024213    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024215    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024218    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024221    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024223    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024226    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024229    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024232    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 10:34:39.026885 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024234    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024237    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024240    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024242    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024245    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024248    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024252    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024254    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024257    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024260    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024263    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024266    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024268    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024273    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024277    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024279    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024282    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024286    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024288    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 10:34:39.027444 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024293    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024296    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024300    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024303    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024305    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024308    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024311    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024314    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024316    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024319    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024321    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024326    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024330    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024333    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024336    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024338    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024343    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024346    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024349    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 10:34:39.028124 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024352    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024355    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024358    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024361    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024364    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024366    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024369    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024372    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024374    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024377    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024379    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024382    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024384    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024387    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024390    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024392    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 10:34:39.028898 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024395    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.024400    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024516    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024522    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024524    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024528    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024531    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024534    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024537    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024539    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024543    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024546    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024550    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024554    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024557    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 10:34:39.029349 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024560    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024564    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024566    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024569    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024572    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024575    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024578    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024581    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024584    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024587    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024590    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024593    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024596    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024599    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024601    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024604    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024607    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024609    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024612    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 10:34:39.029946 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024615    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024618    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024620    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024623    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024625    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024628    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024631    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024634    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024637    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024639    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024642    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024645    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024647    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024651    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024654    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024657    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024659    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024662    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024665    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024667    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 10:34:39.030421 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024670    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024673    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024675    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024678    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024681    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024683    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024686    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024689    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024691    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024694    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024697    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024699    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024702    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024704    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024707    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024710    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024713    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024716    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024719    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024740    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 10:34:39.031002 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024744    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024747    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024750    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024752    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024755    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024757    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024761    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024764    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024767    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024769    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024772    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024775    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024777    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024780    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024782    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024785    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024787    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024790    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024793    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024796    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 10:34:39.031681 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024800    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024803    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024806    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024809    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024811    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024814    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:39.024816    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.024821    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.024945    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.026853    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.027557    2579 server.go:1019] "Starting client certificate rotation"
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.027675    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.027742    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 10:34:39.032247 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.029621    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 10:34:39.032578 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.031415    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 10:34:39.040982 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.040954    2579 log.go:25] "Validated CRI v1 runtime API"
Sep 19 10:34:39.042636 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.042619    2579 log.go:25] "Validated CRI v1 image API"
Sep 19 10:34:39.045758 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.045740    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 19 10:34:39.048183 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.048165    2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 92b4dea1-461e-4d7e-9138-6785b43424e4:/dev/nvme0n1p4 eaa1fbed-7094-48c4-baa9-b76e85527ba7:/dev/nvme0n1p3]
Sep 19 10:34:39.048229 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.048183    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 19 10:34:39.053180 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.053063    2579 manager.go:216] Machine: {Timestamp:2026-09-19 10:34:39.052570091 +0000 UTC m=+1.951759974 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112038 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c2e7b4e75d04756ce548eb46e0080 SystemUUID:ec2c2e7b-4e75-d047-56ce-548eb46e0080 BootID:6c989216-3e56-4845-9a80-f91a74d50e13 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e1:52:ae:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e1:52:ae:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:84:9c:47:39:79 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 19 10:34:39.053180 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.053175    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 19 10:34:39.053290 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.053255    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 19 10:34:39.054948 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.054907    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 19 10:34:39.055105 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.054951    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 19 10:34:39.055293 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.055277    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 10:34:39.056097 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.056085    2579 topology_manager.go:138] "Creating topology manager with none policy"
Sep 19 10:34:39.056128 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.056100    2579 container_manager_linux.go:309] "Creating device plugin manager"
Sep 19 10:34:39.056128 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.056108    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 10:34:39.056185 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.056134    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 10:34:39.057097 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.057087    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 19 10:34:39.061094 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.061081    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 10:34:39.061205 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.061196    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 19 10:34:39.061235 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.061224    2579 kubelet.go:486] "Attempting to sync node with API server"
Sep 19 10:34:39.061235 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.061233    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 19 10:34:39.061288 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.061243    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 19 10:34:39.061288 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.061252    2579 kubelet.go:398] "Adding apiserver pod source"
Sep 19 10:34:39.061288 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.061264    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 19 10:34:39.062453 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.062192    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 10:34:39.062453 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.062294    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 10:34:39.064220 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.064202    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 19 10:34:39.066079 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066063    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 19 10:34:39.066144 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066103    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 19 10:34:39.066887 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066872    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 19 10:34:39.066887 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066889    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 19 10:34:39.067001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066895    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 19 10:34:39.067001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066900    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 19 10:34:39.067001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066909    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 19 10:34:39.067001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066917    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 19 10:34:39.067001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066935    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 19 10:34:39.067001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066940    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 19 10:34:39.067001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066947    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 19 10:34:39.067001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066952    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 19 10:34:39.067001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066960    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 19 10:34:39.067001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066965    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 19 10:34:39.067001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066991    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 19 10:34:39.067001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.066999    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 19 10:34:39.070793 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.070778    2579 server.go:1268] "Started kubelet"
Sep 19 10:34:39.070958 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.070849    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 19 10:34:39.071053 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.070888    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 19 10:34:39.071053 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.071068    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 19 10:34:39.071408 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.071365    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 19 10:34:39.071667 ip-10-0-143-186 systemd[1]: Started Kubernetes Kubelet.
Sep 19 10:34:39.072323 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.072208    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 19 10:34:39.072323 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.072209    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 19 10:34:39.072323 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.072304    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 19 10:34:39.072323 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.072320    2579 server.go:310] "Adding debug handlers to kubelet server"
Sep 19 10:34:39.075145 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.075113    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 19 10:34:39.077768 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.077751    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2qmg8"
Sep 19 10:34:39.081954 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.081933    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 19 10:34:39.082043 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.081967    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 19 10:34:39.082414 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.082343    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 19 10:34:39.082515 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.082448    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 19 10:34:39.082515 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.082480    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 19 10:34:39.082613 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.082556    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:39.082680 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.082663    2579 reconstruct.go:97] "Volume reconstruction finished"
Sep 19 10:34:39.082680 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.082676    2579 reconciler.go:29] "Reconciler: start to sync state"
Sep 19 10:34:39.083044 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.083022    2579 factory.go:55] Registering systemd factory
Sep 19 10:34:39.083139 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.083047    2579 factory.go:223] Registration of the systemd container factory successfully
Sep 19 10:34:39.083318 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.083304    2579 factory.go:153] Registering CRI-O factory
Sep 19 10:34:39.083402 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.083321    2579 factory.go:223] Registration of the crio container factory successfully
Sep 19 10:34:39.083402 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.083388    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 19 10:34:39.083486 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.083406    2579 factory.go:103] Registering Raw factory
Sep 19 10:34:39.083486 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.083424    2579 manager.go:1196] Started watching for new ooms in manager
Sep 19 10:34:39.084079 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.084017    2579 manager.go:349] Starting recovery of all containers
Sep 19 10:34:39.084079 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.084060    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 19 10:34:39.084250 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.084158    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 19 10:34:39.085440 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.085417    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2qmg8"
Sep 19 10:34:39.109647 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.109504    2579 manager.go:354] Recovery completed
Sep 19 10:34:39.114287 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.114267    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:34:39.116707 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.116691    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:34:39.116786 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.116715    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:34:39.116786 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.116740    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:34:39.117229 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.117216    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 19 10:34:39.117229 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.117228    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:34:39.117328 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.117230    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 19 10:34:39.117328 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.117296    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 10:34:39.117971 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.117953    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:34:39.118048 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.117986    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:34:39.118048 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.118000    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:34:39.119306 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.119294    2579 policy_none.go:49] "None policy: Start"
Sep 19 10:34:39.119363 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.119309    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 19 10:34:39.119363 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.119319    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 19 10:34:39.121231 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.121220    2579 policy_none.go:47] "Start"
Sep 19 10:34:39.173296 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.162237    2579 manager.go:337] "Starting Device Plugin manager"
Sep 19 10:34:39.173296 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.162267    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 19 10:34:39.173296 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.162276    2579 server.go:87] "Starting device plugin registration server"
Sep 19 10:34:39.173296 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.162505    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 19 10:34:39.173296 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.162545    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 19 10:34:39.173296 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.162645    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 19 10:34:39.173296 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.162774    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 19 10:34:39.173296 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.162789    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 19 10:34:39.173296 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.163538    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 19 10:34:39.173296 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.163589    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:39.194449 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.194419    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 19 10:34:39.195546 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.195531    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 19 10:34:39.195626 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.195577    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 19 10:34:39.195626 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.195596    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 19 10:34:39.195711 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.195635    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 19 10:34:39.197768 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.197750    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 10:34:39.262836 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.262780    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:34:39.263540 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.263525    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:34:39.263594 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.263551    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:34:39.263594 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.263562    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:34:39.263594 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.263582    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.272443 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.272422    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.272443 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.272440    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-186.ec2.internal\": node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:39.294458 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.294428    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:39.296516 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.296499    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"]
Sep 19 10:34:39.296566 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.296558    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:34:39.297255 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.297240    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:34:39.297324 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.297264    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:34:39.297324 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.297273    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:34:39.299461 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.299449    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:34:39.299586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.299571    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.299632 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.299605    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:34:39.300546 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.300533    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:34:39.300607 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.300555    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:34:39.300607 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.300564    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:34:39.300698 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.300551    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:34:39.300698 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.300648    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:34:39.300698 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.300662    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:34:39.302852 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.302836    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.302934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.302863    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 10:34:39.303612 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.303595    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 10:34:39.303678 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.303628    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 10:34:39.303678 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.303648    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 19 10:34:39.316246 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.316233    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-186.ec2.internal\" not found" node="ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.320404 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.320391    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-186.ec2.internal\" not found" node="ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.384093 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.384075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59b8682cbef62c1284699abf166acf58-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal\" (UID: \"59b8682cbef62c1284699abf166acf58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.384139 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.384098    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c0db033f393a4308e61b0b4763bc529a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-186.ec2.internal\" (UID: \"c0db033f393a4308e61b0b4763bc529a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.384139 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.384115    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59b8682cbef62c1284699abf166acf58-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal\" (UID: \"59b8682cbef62c1284699abf166acf58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.395158 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.395142    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:39.485073 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.485057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59b8682cbef62c1284699abf166acf58-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal\" (UID: \"59b8682cbef62c1284699abf166acf58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.485138 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.485083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59b8682cbef62c1284699abf166acf58-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal\" (UID: \"59b8682cbef62c1284699abf166acf58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.485138 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.485106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c0db033f393a4308e61b0b4763bc529a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-186.ec2.internal\" (UID: \"c0db033f393a4308e61b0b4763bc529a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.485199 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.485148    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59b8682cbef62c1284699abf166acf58-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal\" (UID: \"59b8682cbef62c1284699abf166acf58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.485199 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.485162    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c0db033f393a4308e61b0b4763bc529a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-186.ec2.internal\" (UID: \"c0db033f393a4308e61b0b4763bc529a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.485199 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.485188    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59b8682cbef62c1284699abf166acf58-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal\" (UID: \"59b8682cbef62c1284699abf166acf58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.496174 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.496160    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:39.597057 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.597036    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:39.619196 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.619179    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.624292 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:39.624147    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:39.697422 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.697401    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:39.797896 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.797871    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:39.898432 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.898369    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:39.998859 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:39.998835    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:40.028015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.027988    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 19 10:34:40.028486 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.028124    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 19 10:34:40.090527 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.090500    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 10:29:39 +0000 UTC" deadline="2028-02-24 08:57:25.039146366 +0000 UTC"
Sep 19 10:34:40.090527 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.090524    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12550h22m44.948625317s"
Sep 19 10:34:40.099412 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:40.099393    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:40.184455 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:40.184400    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b8682cbef62c1284699abf166acf58.slice/crio-2fa7cb5d007ffd463298363561a815ad2b211bb3e564d2772f2e351205cae502 WatchSource:0}: Error finding container 2fa7cb5d007ffd463298363561a815ad2b211bb3e564d2772f2e351205cae502: Status 404 returned error can't find the container with id 2fa7cb5d007ffd463298363561a815ad2b211bb3e564d2772f2e351205cae502
Sep 19 10:34:40.184890 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:40.184873    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0db033f393a4308e61b0b4763bc529a.slice/crio-44e7953a725d597a2c10537052b6b75e254db1beee95de4ffab894418a7d5575 WatchSource:0}: Error finding container 44e7953a725d597a2c10537052b6b75e254db1beee95de4ffab894418a7d5575: Status 404 returned error can't find the container with id 44e7953a725d597a2c10537052b6b75e254db1beee95de4ffab894418a7d5575
Sep 19 10:34:40.189473 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.189460    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 10:34:40.199277 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.199240    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal" event={"ID":"c0db033f393a4308e61b0b4763bc529a","Type":"ContainerStarted","Data":"44e7953a725d597a2c10537052b6b75e254db1beee95de4ffab894418a7d5575"}
Sep 19 10:34:40.199518 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:40.199501    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 19 10:34:40.200278 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.200261    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal" event={"ID":"59b8682cbef62c1284699abf166acf58","Type":"ContainerStarted","Data":"2fa7cb5d007ffd463298363561a815ad2b211bb3e564d2772f2e351205cae502"}
Sep 19 10:34:40.276140 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.276115    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 10:34:40.282969 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.282946    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:40.293293 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.293273    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 10:34:40.295095 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.295081    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"
Sep 19 10:34:40.303622 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.303605    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 10:34:40.322644 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.322625    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 10:34:40.507632 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:40.507588    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 10:34:41.062662 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.062636    2579 apiserver.go:52] "Watching apiserver"
Sep 19 10:34:41.070591 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.070570    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 19 10:34:41.071036 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.071011    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-hk5p9","kube-system/global-pull-secret-syncer-7stdm","kube-system/konnectivity-agent-p6szj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4","openshift-cluster-node-tuning-operator/tuned-rsrtv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal","openshift-multus/multus-additional-cni-plugins-fq5vn","openshift-multus/multus-l7vf7","openshift-multus/network-metrics-daemon-2dwvp","kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal","openshift-dns/node-resolver-l4x25","openshift-image-registry/node-ca-rhh5b","openshift-network-diagnostics/network-check-target-4k7qx","openshift-network-operator/iptables-alerter-2vh26"]
Sep 19 10:34:41.073566 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.073546    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.075750 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.075718    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:41.075836 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.075793    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:34:41.078472 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.078434    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p6szj"
Sep 19 10:34:41.080035 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.080012    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 19 10:34:41.081021 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.080363    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 19 10:34:41.081021 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.080437    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 19 10:34:41.081131 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.081083    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 19 10:34:41.081131 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.081118    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4srmw\""
Sep 19 10:34:41.081227 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.081193    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sh9pb\""
Sep 19 10:34:41.081303 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.081273    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.081405 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.081276    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 19 10:34:41.081691 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.081676    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 19 10:34:41.081789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.081743    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 19 10:34:41.082943 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.082925    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 19 10:34:41.083278 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.083258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.083836 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.083817    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 19 10:34:41.084486 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.084386    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 19 10:34:41.084486 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.084388    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-npkq5\""
Sep 19 10:34:41.084486 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.084460    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 19 10:34:41.085589 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.085571    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2vh26"
Sep 19 10:34:41.087841 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.087825    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:41.087925 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.087887    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:34:41.090298 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.090276    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.092800 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.092777    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:41.092892 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.092841    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:34:41.093503 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-sysconfig\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.093582 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-run\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.093582 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7991cbac-7da3-4611-b3a4-e6a8ed62901e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.093582 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7991cbac-7da3-4611-b3a4-e6a8ed62901e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.093696 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-474lz\" (UniqueName: \"kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz\") pod \"network-check-target-4k7qx\" (UID: \"a33aa089-b8e1-4aea-8457-254010f62a22\") " pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:41.093696 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093615    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5-konnectivity-ca\") pod \"konnectivity-agent-p6szj\" (UID: \"4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5\") " pod="kube-system/konnectivity-agent-p6szj"
Sep 19 10:34:41.093696 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-registration-dir\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.093819 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-kubernetes\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.093819 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-systemd\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.093819 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093754    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77bd7787-5d84-497b-a721-844fc9d22907-etc-tuned\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.093819 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7991cbac-7da3-4611-b3a4-e6a8ed62901e-cnibin\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.093819 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5-agent-certs\") pod \"konnectivity-agent-p6szj\" (UID: \"4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5\") " pod="kube-system/konnectivity-agent-p6szj"
Sep 19 10:34:41.093819 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-socket-dir\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.094034 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093858    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-var-lib-kubelet\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.094034 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-sys\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.094034 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.093957    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-device-dir\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.094034 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094001    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-host\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.094034 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094025    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77bd7787-5d84-497b-a721-844fc9d22907-tmp\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.094259 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7991cbac-7da3-4611-b3a4-e6a8ed62901e-cni-binary-copy\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.094259 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7991cbac-7da3-4611-b3a4-e6a8ed62901e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.094259 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkwjp\" (UniqueName: \"kubernetes.io/projected/7991cbac-7da3-4611-b3a4-e6a8ed62901e-kube-api-access-rkwjp\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.094259 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-lib-modules\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.094259 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-etc-selinux\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.094259 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094191    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-sys-fs\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.094259 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-modprobe-d\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.094555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-sysctl-d\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.094555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-sysctl-conf\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.094555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094319    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7phk\" (UniqueName: \"kubernetes.io/projected/77bd7787-5d84-497b-a721-844fc9d22907-kube-api-access-g7phk\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.094555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7991cbac-7da3-4611-b3a4-e6a8ed62901e-system-cni-dir\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.094555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094366    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 19 10:34:41.094555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.094555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g96m\" (UniqueName: \"kubernetes.io/projected/0b2e683d-65bd-4055-b844-9c8ce9886e17-kube-api-access-2g96m\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.094831 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094565    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 19 10:34:41.094831 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094626    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 19 10:34:41.094831 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.094828    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 19 10:34:41.095200 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.095167    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.096162 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.096140    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 19 10:34:41.096269 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.096162    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p6sdr\""
Sep 19 10:34:41.096269 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.096225    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 19 10:34:41.096374 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.096129    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 19 10:34:41.096428 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.096386    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 19 10:34:41.096477 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.096458    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 19 10:34:41.096550 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.096516    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-clnx7\""
Sep 19 10:34:41.096666 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.096651    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 19 10:34:41.096783 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.096692    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 19 10:34:41.096783 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.096713    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4j4jp\""
Sep 19 10:34:41.097252 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.097235    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n5hzt\""
Sep 19 10:34:41.097469 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.097448    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 19 10:34:41.097663 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.097647    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l4x25"
Sep 19 10:34:41.100522 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.100504    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rhh5b"
Sep 19 10:34:41.102158 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.102141    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 19 10:34:41.107284 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.107261    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 19 10:34:41.107408 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.107358    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v2rfc\""
Sep 19 10:34:41.108836 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.107530    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 19 10:34:41.108836 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.107701    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 19 10:34:41.108836 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.107719    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 19 10:34:41.108836 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.107832    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7sn6x\""
Sep 19 10:34:41.114803 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.114783    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 10:34:41.159119 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.159098    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kj85t"
Sep 19 10:34:41.169877 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.169862    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kj85t"
Sep 19 10:34:41.184078 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.184055    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 19 10:34:41.195516 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-run-netns\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.195607 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-var-lib-cni-bin\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.195607 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkwjp\" (UniqueName: \"kubernetes.io/projected/7991cbac-7da3-4611-b3a4-e6a8ed62901e-kube-api-access-rkwjp\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.195607 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-lib-modules\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.195777 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195614    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a924e506-1103-4d63-83b9-74d7974ae6d6-serviceca\") pod \"node-ca-rhh5b\" (UID: \"a924e506-1103-4d63-83b9-74d7974ae6d6\") " pod="openshift-image-registry/node-ca-rhh5b"
Sep 19 10:34:41.195777 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-slash\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.195777 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195692    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-log-socket\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.195777 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195739    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-lib-modules\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.195777 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-etc-selinux\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.196011 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-sys-fs\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.196011 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-sysctl-d\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.196011 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195839    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5562ade4-b9ad-402c-99ad-38724e6f5221-kubelet-config\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:41.196011 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195856    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.196011 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195898    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ebd3a5f-3104-4518-b44b-6e88911e8d93-env-overrides\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.196011 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195889    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-sys-fs\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.196011 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195925    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-run-k8s-cni-cncf-io\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.196011 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195955    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-sysctl-d\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.196011 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195952    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-etc-selinux\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.196011 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.195961    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-var-lib-kubelet\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.196011 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196012    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-run\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f2466a6-7440-4e73-af68-b490909a4606-iptables-alerter-script\") pod \"iptables-alerter-2vh26\" (UID: \"8f2466a6-7440-4e73-af68-b490909a4606\") " pod="openshift-network-operator/iptables-alerter-2vh26"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a924e506-1103-4d63-83b9-74d7974ae6d6-host\") pod \"node-ca-rhh5b\" (UID: \"a924e506-1103-4d63-83b9-74d7974ae6d6\") " pod="openshift-image-registry/node-ca-rhh5b"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196103    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-run\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196105    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tgd7\" (UniqueName: \"kubernetes.io/projected/a924e506-1103-4d63-83b9-74d7974ae6d6-kube-api-access-2tgd7\") pod \"node-ca-rhh5b\" (UID: \"a924e506-1103-4d63-83b9-74d7974ae6d6\") " pod="openshift-image-registry/node-ca-rhh5b"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-run-systemd\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196181    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-run-netns\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7991cbac-7da3-4611-b3a4-e6a8ed62901e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7991cbac-7da3-4611-b3a4-e6a8ed62901e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-474lz\" (UniqueName: \"kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz\") pod \"network-check-target-4k7qx\" (UID: \"a33aa089-b8e1-4aea-8457-254010f62a22\") " pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5-konnectivity-ca\") pod \"konnectivity-agent-p6szj\" (UID: \"4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5\") " pod="kube-system/konnectivity-agent-p6szj"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-registration-dir\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196356    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-systemd\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-cni-netd\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-system-cni-dir\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.196480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7991cbac-7da3-4611-b3a4-e6a8ed62901e-cnibin\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-var-lib-kubelet\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4-hosts-file\") pod \"node-resolver-l4x25\" (UID: \"fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4\") " pod="openshift-dns/node-resolver-l4x25"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-var-lib-openvswitch\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-hostroot\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-var-lib-cni-multus\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-kubelet\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjngt\" (UniqueName: \"kubernetes.io/projected/7ebd3a5f-3104-4518-b44b-6e88911e8d93-kube-api-access-vjngt\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196618    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7991cbac-7da3-4611-b3a4-e6a8ed62901e-cni-binary-copy\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7991cbac-7da3-4611-b3a4-e6a8ed62901e-cnibin\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7991cbac-7da3-4611-b3a4-e6a8ed62901e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196705    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-run-openvswitch\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-node-log\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7991cbac-7da3-4611-b3a4-e6a8ed62901e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-systemd\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-var-lib-kubelet\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-run-ovn-kubernetes\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.197355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196952    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ebd3a5f-3104-4518-b44b-6e88911e8d93-ovnkube-config\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ebd3a5f-3104-4518-b44b-6e88911e8d93-ovn-node-metrics-cert\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-modprobe-d\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.196999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7991cbac-7da3-4611-b3a4-e6a8ed62901e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197011    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-registration-dir\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197103    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-modprobe-d\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7991cbac-7da3-4611-b3a4-e6a8ed62901e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197134    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-sysctl-conf\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-sysctl-conf\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7phk\" (UniqueName: \"kubernetes.io/projected/77bd7787-5d84-497b-a721-844fc9d22907-kube-api-access-g7phk\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f2466a6-7440-4e73-af68-b490909a4606-host-slash\") pod \"iptables-alerter-2vh26\" (UID: \"8f2466a6-7440-4e73-af68-b490909a4606\") " pod="openshift-network-operator/iptables-alerter-2vh26"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7991cbac-7da3-4611-b3a4-e6a8ed62901e-cni-binary-copy\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wrcz\" (UniqueName: \"kubernetes.io/projected/2b41c220-4b51-4250-989b-fdc1c5a684c8-kube-api-access-7wrcz\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-etc-openvswitch\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197450    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ebd3a5f-3104-4518-b44b-6e88911e8d93-ovnkube-script-lib\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-multus-cni-dir\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.198086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7991cbac-7da3-4611-b3a4-e6a8ed62901e-system-cni-dir\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g96m\" (UniqueName: \"kubernetes.io/projected/0b2e683d-65bd-4055-b844-9c8ce9886e17-kube-api-access-2g96m\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-sysconfig\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-669pk\" (UniqueName: \"kubernetes.io/projected/8f2466a6-7440-4e73-af68-b490909a4606-kube-api-access-669pk\") pod \"iptables-alerter-2vh26\" (UID: \"8f2466a6-7440-4e73-af68-b490909a4606\") " pod="openshift-network-operator/iptables-alerter-2vh26"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197615    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4-tmp-dir\") pod \"node-resolver-l4x25\" (UID: \"fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4\") " pod="openshift-dns/node-resolver-l4x25"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197661    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-cni-bin\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-multus-conf-dir\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5-konnectivity-ca\") pod \"konnectivity-agent-p6szj\" (UID: \"4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5\") " pod="kube-system/konnectivity-agent-p6szj"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197741    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-kubernetes\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77bd7787-5d84-497b-a721-844fc9d22907-etc-tuned\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197808    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-kubernetes\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197819    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7991cbac-7da3-4611-b3a4-e6a8ed62901e-system-cni-dir\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197846    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-etc-sysconfig\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5562ade4-b9ad-402c-99ad-38724e6f5221-dbus\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.197916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34fe78b4-d425-4404-b550-61a7a8873f89-cni-binary-copy\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-multus-socket-dir-parent\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.198854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-etc-kubernetes\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5-agent-certs\") pod \"konnectivity-agent-p6szj\" (UID: \"4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5\") " pod="kube-system/konnectivity-agent-p6szj"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-socket-dir\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-run-multus-certs\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198134    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-sys\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlkvr\" (UniqueName: \"kubernetes.io/projected/fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4-kube-api-access-wlkvr\") pod \"node-resolver-l4x25\" (UID: \"fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4\") " pod="openshift-dns/node-resolver-l4x25"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-socket-dir\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-cnibin\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34fe78b4-d425-4404-b550-61a7a8873f89-multus-daemon-config\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198277    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-sys\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8szm\" (UniqueName: \"kubernetes.io/projected/34fe78b4-d425-4404-b550-61a7a8873f89-kube-api-access-w8szm\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-device-dir\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-host\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77bd7787-5d84-497b-a721-844fc9d22907-tmp\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-systemd-units\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198539    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77bd7787-5d84-497b-a721-844fc9d22907-host\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.199501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198537    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b2e683d-65bd-4055-b844-9c8ce9886e17-device-dir\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.200064 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.198557    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-run-ovn\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.201156 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.201137    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77bd7787-5d84-497b-a721-844fc9d22907-etc-tuned\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.201257 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.201205    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77bd7787-5d84-497b-a721-844fc9d22907-tmp\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.201451 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.201435    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5-agent-certs\") pod \"konnectivity-agent-p6szj\" (UID: \"4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5\") " pod="kube-system/konnectivity-agent-p6szj"
Sep 19 10:34:41.225323 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.225305    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkwjp\" (UniqueName: \"kubernetes.io/projected/7991cbac-7da3-4611-b3a4-e6a8ed62901e-kube-api-access-rkwjp\") pod \"multus-additional-cni-plugins-fq5vn\" (UID: \"7991cbac-7da3-4611-b3a4-e6a8ed62901e\") " pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.233299 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.233281    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:34:41.233401 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.233306    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:34:41.233401 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.233319    2579 projected.go:196] Error preparing data for projected volume kube-api-access-474lz for pod openshift-network-diagnostics/network-check-target-4k7qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:34:41.233401 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.233376    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz podName:a33aa089-b8e1-4aea-8457-254010f62a22 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:41.73336113 +0000 UTC m=+4.632551011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-474lz" (UniqueName: "kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz") pod "network-check-target-4k7qx" (UID: "a33aa089-b8e1-4aea-8457-254010f62a22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:34:41.235415 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.235393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7phk\" (UniqueName: \"kubernetes.io/projected/77bd7787-5d84-497b-a721-844fc9d22907-kube-api-access-g7phk\") pod \"tuned-rsrtv\" (UID: \"77bd7787-5d84-497b-a721-844fc9d22907\") " pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.238822 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.238797    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g96m\" (UniqueName: \"kubernetes.io/projected/0b2e683d-65bd-4055-b844-9c8ce9886e17-kube-api-access-2g96m\") pod \"aws-ebs-csi-driver-node-rjfd4\" (UID: \"0b2e683d-65bd-4055-b844-9c8ce9886e17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.299072 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjngt\" (UniqueName: \"kubernetes.io/projected/7ebd3a5f-3104-4518-b44b-6e88911e8d93-kube-api-access-vjngt\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.299072 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-run-openvswitch\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.299234 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-node-log\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.299234 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-run-ovn-kubernetes\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.299234 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-run-openvswitch\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.299234 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ebd3a5f-3104-4518-b44b-6e88911e8d93-ovnkube-config\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.299423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ebd3a5f-3104-4518-b44b-6e88911e8d93-ovn-node-metrics-cert\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.299423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-node-log\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.299423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299270    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f2466a6-7440-4e73-af68-b490909a4606-host-slash\") pod \"iptables-alerter-2vh26\" (UID: \"8f2466a6-7440-4e73-af68-b490909a4606\") " pod="openshift-network-operator/iptables-alerter-2vh26"
Sep 19 10:34:41.299423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f2466a6-7440-4e73-af68-b490909a4606-host-slash\") pod \"iptables-alerter-2vh26\" (UID: \"8f2466a6-7440-4e73-af68-b490909a4606\") " pod="openshift-network-operator/iptables-alerter-2vh26"
Sep 19 10:34:41.299423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wrcz\" (UniqueName: \"kubernetes.io/projected/2b41c220-4b51-4250-989b-fdc1c5a684c8-kube-api-access-7wrcz\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:41.299423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-run-ovn-kubernetes\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.299694 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-etc-openvswitch\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.299694 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ebd3a5f-3104-4518-b44b-6e88911e8d93-ovnkube-script-lib\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.299694 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-multus-cni-dir\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.299694 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-669pk\" (UniqueName: \"kubernetes.io/projected/8f2466a6-7440-4e73-af68-b490909a4606-kube-api-access-669pk\") pod \"iptables-alerter-2vh26\" (UID: \"8f2466a6-7440-4e73-af68-b490909a4606\") " pod="openshift-network-operator/iptables-alerter-2vh26"
Sep 19 10:34:41.299694 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299547    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-etc-openvswitch\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.299694 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:41.299694 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299602    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4-tmp-dir\") pod \"node-resolver-l4x25\" (UID: \"fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4\") " pod="openshift-dns/node-resolver-l4x25"
Sep 19 10:34:41.299694 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.299636    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:34:41.299694 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299672    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-cni-bin\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ebd3a5f-3104-4518-b44b-6e88911e8d93-ovnkube-config\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.299820    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs podName:2b41c220-4b51-4250-989b-fdc1c5a684c8 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:41.799789037 +0000 UTC m=+4.698978933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs") pod "network-metrics-daemon-2dwvp" (UID: "2b41c220-4b51-4250-989b-fdc1c5a684c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-multus-cni-dir\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-cni-bin\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-multus-conf-dir\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5562ade4-b9ad-402c-99ad-38724e6f5221-dbus\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-multus-conf-dir\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34fe78b4-d425-4404-b550-61a7a8873f89-cni-binary-copy\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-multus-socket-dir-parent\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-etc-kubernetes\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300110    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-run-multus-certs\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300118    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5562ade4-b9ad-402c-99ad-38724e6f5221-dbus\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.299997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4-tmp-dir\") pod \"node-resolver-l4x25\" (UID: \"fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4\") " pod="openshift-dns/node-resolver-l4x25"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-multus-socket-dir-parent\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlkvr\" (UniqueName: \"kubernetes.io/projected/fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4-kube-api-access-wlkvr\") pod \"node-resolver-l4x25\" (UID: \"fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4\") " pod="openshift-dns/node-resolver-l4x25"
Sep 19 10:34:41.300176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300182    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-etc-kubernetes\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-cnibin\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300180    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-run-multus-certs\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300144    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ebd3a5f-3104-4518-b44b-6e88911e8d93-ovnkube-script-lib\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300238    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-cnibin\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34fe78b4-d425-4404-b550-61a7a8873f89-multus-daemon-config\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8szm\" (UniqueName: \"kubernetes.io/projected/34fe78b4-d425-4404-b550-61a7a8873f89-kube-api-access-w8szm\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-systemd-units\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-run-ovn\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-run-netns\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-var-lib-cni-bin\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.300450    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34fe78b4-d425-4404-b550-61a7a8873f89-cni-binary-copy\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a924e506-1103-4d63-83b9-74d7974ae6d6-serviceca\") pod \"node-ca-rhh5b\" (UID: \"a924e506-1103-4d63-83b9-74d7974ae6d6\") " pod="openshift-image-registry/node-ca-rhh5b"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.300524    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret podName:5562ade4-b9ad-402c-99ad-38724e6f5221 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:41.800507305 +0000 UTC m=+4.699697190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret") pod "global-pull-secret-syncer-7stdm" (UID: "5562ade4-b9ad-402c-99ad-38724e6f5221") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300556    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-run-netns\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-systemd-units\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.300934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-slash\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300602    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-var-lib-cni-bin\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-log-socket\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5562ade4-b9ad-402c-99ad-38724e6f5221-kubelet-config\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300640    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-slash\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-log-socket\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300608    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-run-ovn\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300693    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5562ade4-b9ad-402c-99ad-38724e6f5221-kubelet-config\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300706    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ebd3a5f-3104-4518-b44b-6e88911e8d93-env-overrides\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-run-k8s-cni-cncf-io\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300755    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-var-lib-kubelet\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-run-k8s-cni-cncf-io\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f2466a6-7440-4e73-af68-b490909a4606-iptables-alerter-script\") pod \"iptables-alerter-2vh26\" (UID: \"8f2466a6-7440-4e73-af68-b490909a4606\") " pod="openshift-network-operator/iptables-alerter-2vh26"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300839    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-var-lib-kubelet\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300772    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34fe78b4-d425-4404-b550-61a7a8873f89-multus-daemon-config\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.301684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a924e506-1103-4d63-83b9-74d7974ae6d6-host\") pod \"node-ca-rhh5b\" (UID: \"a924e506-1103-4d63-83b9-74d7974ae6d6\") " pod="openshift-image-registry/node-ca-rhh5b"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tgd7\" (UniqueName: \"kubernetes.io/projected/a924e506-1103-4d63-83b9-74d7974ae6d6-kube-api-access-2tgd7\") pod \"node-ca-rhh5b\" (UID: \"a924e506-1103-4d63-83b9-74d7974ae6d6\") " pod="openshift-image-registry/node-ca-rhh5b"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-run-systemd\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a924e506-1103-4d63-83b9-74d7974ae6d6-host\") pod \"node-ca-rhh5b\" (UID: \"a924e506-1103-4d63-83b9-74d7974ae6d6\") " pod="openshift-image-registry/node-ca-rhh5b"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.300988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a924e506-1103-4d63-83b9-74d7974ae6d6-serviceca\") pod \"node-ca-rhh5b\" (UID: \"a924e506-1103-4d63-83b9-74d7974ae6d6\") " pod="openshift-image-registry/node-ca-rhh5b"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301012    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-run-netns\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301043    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-run-systemd\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301099    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-run-netns\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301113    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ebd3a5f-3104-4518-b44b-6e88911e8d93-env-overrides\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-cni-netd\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301206    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-system-cni-dir\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4-hosts-file\") pod \"node-resolver-l4x25\" (UID: \"fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4\") " pod="openshift-dns/node-resolver-l4x25"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-var-lib-openvswitch\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-system-cni-dir\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301267    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-cni-netd\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-hostroot\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-var-lib-cni-multus\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f2466a6-7440-4e73-af68-b490909a4606-iptables-alerter-script\") pod \"iptables-alerter-2vh26\" (UID: \"8f2466a6-7440-4e73-af68-b490909a4606\") " pod="openshift-network-operator/iptables-alerter-2vh26"
Sep 19 10:34:41.302280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-kubelet\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.302865 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301367    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-hostroot\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.302865 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-var-lib-openvswitch\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.302865 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301411    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ebd3a5f-3104-4518-b44b-6e88911e8d93-host-kubelet\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.302865 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34fe78b4-d425-4404-b550-61a7a8873f89-host-var-lib-cni-multus\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.302865 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.301312    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4-hosts-file\") pod \"node-resolver-l4x25\" (UID: \"fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4\") " pod="openshift-dns/node-resolver-l4x25"
Sep 19 10:34:41.302865 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.302473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ebd3a5f-3104-4518-b44b-6e88911e8d93-ovn-node-metrics-cert\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.320637 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.320551    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tgd7\" (UniqueName: \"kubernetes.io/projected/a924e506-1103-4d63-83b9-74d7974ae6d6-kube-api-access-2tgd7\") pod \"node-ca-rhh5b\" (UID: \"a924e506-1103-4d63-83b9-74d7974ae6d6\") " pod="openshift-image-registry/node-ca-rhh5b"
Sep 19 10:34:41.321274 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.321255    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8szm\" (UniqueName: \"kubernetes.io/projected/34fe78b4-d425-4404-b550-61a7a8873f89-kube-api-access-w8szm\") pod \"multus-l7vf7\" (UID: \"34fe78b4-d425-4404-b550-61a7a8873f89\") " pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.322271 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.322250    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wrcz\" (UniqueName: \"kubernetes.io/projected/2b41c220-4b51-4250-989b-fdc1c5a684c8-kube-api-access-7wrcz\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:41.322490 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.322443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjngt\" (UniqueName: \"kubernetes.io/projected/7ebd3a5f-3104-4518-b44b-6e88911e8d93-kube-api-access-vjngt\") pod \"ovnkube-node-hk5p9\" (UID: \"7ebd3a5f-3104-4518-b44b-6e88911e8d93\") " pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.324041 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.324021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-669pk\" (UniqueName: \"kubernetes.io/projected/8f2466a6-7440-4e73-af68-b490909a4606-kube-api-access-669pk\") pod \"iptables-alerter-2vh26\" (UID: \"8f2466a6-7440-4e73-af68-b490909a4606\") " pod="openshift-network-operator/iptables-alerter-2vh26"
Sep 19 10:34:41.327907 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.327886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlkvr\" (UniqueName: \"kubernetes.io/projected/fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4-kube-api-access-wlkvr\") pod \"node-resolver-l4x25\" (UID: \"fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4\") " pod="openshift-dns/node-resolver-l4x25"
Sep 19 10:34:41.350205 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.350184    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 10:34:41.384607 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.384583    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fq5vn"
Sep 19 10:34:41.391292 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.391271    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p6szj"
Sep 19 10:34:41.400999 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.400980    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4"
Sep 19 10:34:41.407873 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.407856    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rsrtv"
Sep 19 10:34:41.416352 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.416335    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2vh26"
Sep 19 10:34:41.423560 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.423540    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:34:41.430346 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.430329    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l7vf7"
Sep 19 10:34:41.436227 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.436213    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l4x25"
Sep 19 10:34:41.441980 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.441964    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rhh5b"
Sep 19 10:34:41.804355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.804322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:41.804501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.804371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-474lz\" (UniqueName: \"kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz\") pod \"network-check-target-4k7qx\" (UID: \"a33aa089-b8e1-4aea-8457-254010f62a22\") " pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:41.804501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:41.804410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:41.804501 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.804463    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:34:41.804600 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.804510    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:34:41.804600 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.804540    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret podName:5562ade4-b9ad-402c-99ad-38724e6f5221 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:42.804521243 +0000 UTC m=+5.703711129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret") pod "global-pull-secret-syncer-7stdm" (UID: "5562ade4-b9ad-402c-99ad-38724e6f5221") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:34:41.804600 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.804543    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:34:41.804600 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.804560    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs podName:2b41c220-4b51-4250-989b-fdc1c5a684c8 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:42.804550841 +0000 UTC m=+5.703740722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs") pod "network-metrics-daemon-2dwvp" (UID: "2b41c220-4b51-4250-989b-fdc1c5a684c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:34:41.804600 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.804565    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:34:41.804600 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.804577    2579 projected.go:196] Error preparing data for projected volume kube-api-access-474lz for pod openshift-network-diagnostics/network-check-target-4k7qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:34:41.804853 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:41.804612    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz podName:a33aa089-b8e1-4aea-8457-254010f62a22 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:42.804602533 +0000 UTC m=+5.703792416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-474lz" (UniqueName: "kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz") pod "network-check-target-4k7qx" (UID: "a33aa089-b8e1-4aea-8457-254010f62a22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:34:42.059342 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:42.059310    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34fe78b4_d425_4404_b550_61a7a8873f89.slice/crio-57344a224574f7845ce910c9a646f93a9d75675852b91276666701238b7c6775 WatchSource:0}: Error finding container 57344a224574f7845ce910c9a646f93a9d75675852b91276666701238b7c6775: Status 404 returned error can't find the container with id 57344a224574f7845ce910c9a646f93a9d75675852b91276666701238b7c6775
Sep 19 10:34:42.060430 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:42.060404    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdcdcc3_35cb_457f_b2a6_de1abecb2cb4.slice/crio-406ce40c1bf242516111aa8de73ffa86d1f4dab59f6c6dc4986f809db004e5c7 WatchSource:0}: Error finding container 406ce40c1bf242516111aa8de73ffa86d1f4dab59f6c6dc4986f809db004e5c7: Status 404 returned error can't find the container with id 406ce40c1bf242516111aa8de73ffa86d1f4dab59f6c6dc4986f809db004e5c7
Sep 19 10:34:42.061751 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:42.061652    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce4789f_0ebf_458b_bcd6_bdcc5adf27d5.slice/crio-39642e62de8cedd21f2aeac0e8e49b817c79b769d6b0ea33888009f30a6c76b4 WatchSource:0}: Error finding container 39642e62de8cedd21f2aeac0e8e49b817c79b769d6b0ea33888009f30a6c76b4: Status 404 returned error can't find the container with id 39642e62de8cedd21f2aeac0e8e49b817c79b769d6b0ea33888009f30a6c76b4
Sep 19 10:34:42.062878 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:42.062592    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2466a6_7440_4e73_af68_b490909a4606.slice/crio-b0c2c68d63eee140d42230f88950f7ac118029a40998476a6a92541b5bb4e340 WatchSource:0}: Error finding container b0c2c68d63eee140d42230f88950f7ac118029a40998476a6a92541b5bb4e340: Status 404 returned error can't find the container with id b0c2c68d63eee140d42230f88950f7ac118029a40998476a6a92541b5bb4e340
Sep 19 10:34:42.065649 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:42.065629    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda924e506_1103_4d63_83b9_74d7974ae6d6.slice/crio-871979628f4aab1c0165c9c9c50874c95d97c7f3aa08f5c5fb7f968e81774fe6 WatchSource:0}: Error finding container 871979628f4aab1c0165c9c9c50874c95d97c7f3aa08f5c5fb7f968e81774fe6: Status 404 returned error can't find the container with id 871979628f4aab1c0165c9c9c50874c95d97c7f3aa08f5c5fb7f968e81774fe6
Sep 19 10:34:42.066884 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:42.066851    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2e683d_65bd_4055_b844_9c8ce9886e17.slice/crio-bb407741eed3c47e224f101b23765206df6309edb88f01fa89172a799ac020f3 WatchSource:0}: Error finding container bb407741eed3c47e224f101b23765206df6309edb88f01fa89172a799ac020f3: Status 404 returned error can't find the container with id bb407741eed3c47e224f101b23765206df6309edb88f01fa89172a799ac020f3
Sep 19 10:34:42.067532 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:42.067509    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ebd3a5f_3104_4518_b44b_6e88911e8d93.slice/crio-f706b523a67e9c5f796502d88b0d208f7bb99196e9a887d07c7438b56c477b3f WatchSource:0}: Error finding container f706b523a67e9c5f796502d88b0d208f7bb99196e9a887d07c7438b56c477b3f: Status 404 returned error can't find the container with id f706b523a67e9c5f796502d88b0d208f7bb99196e9a887d07c7438b56c477b3f
Sep 19 10:34:42.068437 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:42.068418    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7991cbac_7da3_4611_b3a4_e6a8ed62901e.slice/crio-3b022bdbd2262d84046a7acf57e4dc230f974f68097dad18dbae1294a3bb4622 WatchSource:0}: Error finding container 3b022bdbd2262d84046a7acf57e4dc230f974f68097dad18dbae1294a3bb4622: Status 404 returned error can't find the container with id 3b022bdbd2262d84046a7acf57e4dc230f974f68097dad18dbae1294a3bb4622
Sep 19 10:34:42.070280 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:34:42.070260    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bd7787_5d84_497b_a721_844fc9d22907.slice/crio-e0f733bc74a4fde979e5876c1c580c3c24c2a49ce3fe7311b92cec1b89404893 WatchSource:0}: Error finding container e0f733bc74a4fde979e5876c1c580c3c24c2a49ce3fe7311b92cec1b89404893: Status 404 returned error can't find the container with id e0f733bc74a4fde979e5876c1c580c3c24c2a49ce3fe7311b92cec1b89404893
Sep 19 10:34:42.172691 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.172664    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 10:29:41 +0000 UTC" deadline="2028-03-03 12:40:49.386832138 +0000 UTC"
Sep 19 10:34:42.172691 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.172690    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12746h6m7.214145152s"
Sep 19 10:34:42.205251 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.205222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal" event={"ID":"c0db033f393a4308e61b0b4763bc529a","Type":"ContainerStarted","Data":"8531f88d076800280d6693e510e4b5bf92baf2f5d9868024ed5d4f77e84391b4"}
Sep 19 10:34:42.206416 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.206381    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rsrtv" event={"ID":"77bd7787-5d84-497b-a721-844fc9d22907","Type":"ContainerStarted","Data":"e0f733bc74a4fde979e5876c1c580c3c24c2a49ce3fe7311b92cec1b89404893"}
Sep 19 10:34:42.207553 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.207527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9" event={"ID":"7ebd3a5f-3104-4518-b44b-6e88911e8d93","Type":"ContainerStarted","Data":"f706b523a67e9c5f796502d88b0d208f7bb99196e9a887d07c7438b56c477b3f"}
Sep 19 10:34:42.208702 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.208678    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rhh5b" event={"ID":"a924e506-1103-4d63-83b9-74d7974ae6d6","Type":"ContainerStarted","Data":"871979628f4aab1c0165c9c9c50874c95d97c7f3aa08f5c5fb7f968e81774fe6"}
Sep 19 10:34:42.209981 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.209957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p6szj" event={"ID":"4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5","Type":"ContainerStarted","Data":"39642e62de8cedd21f2aeac0e8e49b817c79b769d6b0ea33888009f30a6c76b4"}
Sep 19 10:34:42.211143 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.211121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l4x25" event={"ID":"fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4","Type":"ContainerStarted","Data":"406ce40c1bf242516111aa8de73ffa86d1f4dab59f6c6dc4986f809db004e5c7"}
Sep 19 10:34:42.212321 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.212298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l7vf7" event={"ID":"34fe78b4-d425-4404-b550-61a7a8873f89","Type":"ContainerStarted","Data":"57344a224574f7845ce910c9a646f93a9d75675852b91276666701238b7c6775"}
Sep 19 10:34:42.213575 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.213524    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fq5vn" event={"ID":"7991cbac-7da3-4611-b3a4-e6a8ed62901e","Type":"ContainerStarted","Data":"3b022bdbd2262d84046a7acf57e4dc230f974f68097dad18dbae1294a3bb4622"}
Sep 19 10:34:42.214674 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.214656    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4" event={"ID":"0b2e683d-65bd-4055-b844-9c8ce9886e17","Type":"ContainerStarted","Data":"bb407741eed3c47e224f101b23765206df6309edb88f01fa89172a799ac020f3"}
Sep 19 10:34:42.215836 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.215815    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2vh26" event={"ID":"8f2466a6-7440-4e73-af68-b490909a4606","Type":"ContainerStarted","Data":"b0c2c68d63eee140d42230f88950f7ac118029a40998476a6a92541b5bb4e340"}
Sep 19 10:34:42.813204 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.813170    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:42.813374 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.813233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-474lz\" (UniqueName: \"kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz\") pod \"network-check-target-4k7qx\" (UID: \"a33aa089-b8e1-4aea-8457-254010f62a22\") " pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:42.813374 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:42.813281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:42.813488 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:42.813398    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:34:42.813488 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:42.813466    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs podName:2b41c220-4b51-4250-989b-fdc1c5a684c8 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:44.813439806 +0000 UTC m=+7.712629683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs") pod "network-metrics-daemon-2dwvp" (UID: "2b41c220-4b51-4250-989b-fdc1c5a684c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:34:42.813889 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:42.813868    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:34:42.813973 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:42.813924    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret podName:5562ade4-b9ad-402c-99ad-38724e6f5221 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:44.81390937 +0000 UTC m=+7.713099245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret") pod "global-pull-secret-syncer-7stdm" (UID: "5562ade4-b9ad-402c-99ad-38724e6f5221") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:34:42.814031 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:42.814010    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:34:42.814031 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:42.814024    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:34:42.814132 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:42.814038    2579 projected.go:196] Error preparing data for projected volume kube-api-access-474lz for pod openshift-network-diagnostics/network-check-target-4k7qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:34:42.814132 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:42.814072    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz podName:a33aa089-b8e1-4aea-8457-254010f62a22 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:44.81406172 +0000 UTC m=+7.713251595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-474lz" (UniqueName: "kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz") pod "network-check-target-4k7qx" (UID: "a33aa089-b8e1-4aea-8457-254010f62a22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:34:43.173273 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:43.173148    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 10:29:41 +0000 UTC" deadline="2028-03-02 17:54:06.909509103 +0000 UTC"
Sep 19 10:34:43.173273 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:43.173202    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12727h19m23.73631114s"
Sep 19 10:34:43.199218 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:43.198288    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:43.199218 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:43.198399    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:34:43.199218 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:43.198831    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:43.199218 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:43.198931    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:34:43.199218 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:43.198987    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:43.199218 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:43.199053    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:34:43.234404 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:43.234376    2579 generic.go:356] "Generic (PLEG): container finished" podID="59b8682cbef62c1284699abf166acf58" containerID="055e930c00a41566574d20c15f49d7c3909775e4e24e7bc3bd0b21e2c9e1563d" exitCode=0
Sep 19 10:34:43.235264 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:43.235240    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal" event={"ID":"59b8682cbef62c1284699abf166acf58","Type":"ContainerDied","Data":"055e930c00a41566574d20c15f49d7c3909775e4e24e7bc3bd0b21e2c9e1563d"}
Sep 19 10:34:43.253842 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:43.253793    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal" podStartSLOduration=3.25377532 podStartE2EDuration="3.25377532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:34:42.246975509 +0000 UTC m=+5.146165401" watchObservedRunningTime="2026-09-19 10:34:43.25377532 +0000 UTC m=+6.152965212"
Sep 19 10:34:44.254639 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:44.254602    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal" event={"ID":"59b8682cbef62c1284699abf166acf58","Type":"ContainerStarted","Data":"b285a139b4dc42f886cb4e079eaa25688b973837c64dd026fc040af6a277bf1b"}
Sep 19 10:34:44.272447 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:44.272383    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal" podStartSLOduration=4.272363824 podStartE2EDuration="4.272363824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:34:44.270804011 +0000 UTC m=+7.169993898" watchObservedRunningTime="2026-09-19 10:34:44.272363824 +0000 UTC m=+7.171553742"
Sep 19 10:34:44.830634 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:44.830596    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:44.830844 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:44.830664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-474lz\" (UniqueName: \"kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz\") pod \"network-check-target-4k7qx\" (UID: \"a33aa089-b8e1-4aea-8457-254010f62a22\") " pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:44.830844 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:44.830716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:44.830961 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:44.830864    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:34:44.830961 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:44.830930    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs podName:2b41c220-4b51-4250-989b-fdc1c5a684c8 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:48.830911047 +0000 UTC m=+11.730100922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs") pod "network-metrics-daemon-2dwvp" (UID: "2b41c220-4b51-4250-989b-fdc1c5a684c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:34:44.831369 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:44.831350    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:34:44.831454 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:44.831410    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret podName:5562ade4-b9ad-402c-99ad-38724e6f5221 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:48.831394557 +0000 UTC m=+11.730584442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret") pod "global-pull-secret-syncer-7stdm" (UID: "5562ade4-b9ad-402c-99ad-38724e6f5221") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:34:44.831517 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:44.831492    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:34:44.831517 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:44.831508    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:34:44.831609 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:44.831520    2579 projected.go:196] Error preparing data for projected volume kube-api-access-474lz for pod openshift-network-diagnostics/network-check-target-4k7qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:34:44.831609 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:44.831558    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz podName:a33aa089-b8e1-4aea-8457-254010f62a22 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:48.831546635 +0000 UTC m=+11.730736514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-474lz" (UniqueName: "kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz") pod "network-check-target-4k7qx" (UID: "a33aa089-b8e1-4aea-8457-254010f62a22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:34:45.196868 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:45.196487    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:45.196868 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:45.196502    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:45.196868 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:45.196626    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:34:45.196868 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:45.196648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:45.196868 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:45.196785    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:34:45.197224 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:45.196881    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:34:47.198056 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:47.197469    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:47.198056 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:47.197497    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:47.198056 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:47.197633    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:47.198056 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:47.197750    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:34:47.198056 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:47.197623    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:34:47.198056 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:47.198010    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:34:48.865554 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:48.865205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:48.865554 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:48.865269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-474lz\" (UniqueName: \"kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz\") pod \"network-check-target-4k7qx\" (UID: \"a33aa089-b8e1-4aea-8457-254010f62a22\") " pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:48.865554 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:48.865317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:48.865554 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:48.865353    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:34:48.865554 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:48.865385    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:34:48.865554 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:48.865413    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret podName:5562ade4-b9ad-402c-99ad-38724e6f5221 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:56.865394417 +0000 UTC m=+19.764584306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret") pod "global-pull-secret-syncer-7stdm" (UID: "5562ade4-b9ad-402c-99ad-38724e6f5221") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:34:48.865554 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:48.865431    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs podName:2b41c220-4b51-4250-989b-fdc1c5a684c8 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:56.865421998 +0000 UTC m=+19.764611869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs") pod "network-metrics-daemon-2dwvp" (UID: "2b41c220-4b51-4250-989b-fdc1c5a684c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:34:48.865554 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:48.865471    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:34:48.865554 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:48.865483    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:34:48.865554 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:48.865494    2579 projected.go:196] Error preparing data for projected volume kube-api-access-474lz for pod openshift-network-diagnostics/network-check-target-4k7qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:34:48.865554 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:48.865527    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz podName:a33aa089-b8e1-4aea-8457-254010f62a22 nodeName:}" failed. No retries permitted until 2026-09-19 10:34:56.865515304 +0000 UTC m=+19.764705180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-474lz" (UniqueName: "kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz") pod "network-check-target-4k7qx" (UID: "a33aa089-b8e1-4aea-8457-254010f62a22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:34:49.198080 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:49.197301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:49.198080 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:49.197408    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:34:49.198080 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:49.197771    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:49.198080 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:49.197861    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:34:49.198080 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:49.197924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:49.198080 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:49.198004    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:34:51.196601 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:51.196569    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:51.197031 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:51.196606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:51.197031 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:51.196690    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:34:51.197031 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:51.196752    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:51.197031 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:51.196843    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:34:51.197031 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:51.196933    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:34:53.196854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:53.196816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:53.197357 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:53.196834    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:53.197357 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:53.196948    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:34:53.197357 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:53.197010    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:34:53.197357 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:53.197014    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:53.197357 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:53.197148    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:34:55.196214 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:55.196179    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:55.196625 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:55.196183    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:55.196625 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:55.196191    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:55.196625 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:55.196366    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:34:55.196625 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:55.196485    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:34:55.196625 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:55.196572    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:34:56.928842 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:56.928800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:56.929402 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:56.928861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-474lz\" (UniqueName: \"kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz\") pod \"network-check-target-4k7qx\" (UID: \"a33aa089-b8e1-4aea-8457-254010f62a22\") " pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:56.929402 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:56.928906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:56.929402 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:56.928961    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:34:56.929402 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:56.929003    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:34:56.929402 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:56.929026    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:34:56.929402 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:56.929040    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret podName:5562ade4-b9ad-402c-99ad-38724e6f5221 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:12.929019915 +0000 UTC m=+35.828209798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret") pod "global-pull-secret-syncer-7stdm" (UID: "5562ade4-b9ad-402c-99ad-38724e6f5221") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:34:56.929402 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:56.929045    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:34:56.929402 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:56.929057    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs podName:2b41c220-4b51-4250-989b-fdc1c5a684c8 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:12.929049738 +0000 UTC m=+35.828239607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs") pod "network-metrics-daemon-2dwvp" (UID: "2b41c220-4b51-4250-989b-fdc1c5a684c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:34:56.929402 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:56.929058    2579 projected.go:196] Error preparing data for projected volume kube-api-access-474lz for pod openshift-network-diagnostics/network-check-target-4k7qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:34:56.929402 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:56.929106    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz podName:a33aa089-b8e1-4aea-8457-254010f62a22 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:12.929091424 +0000 UTC m=+35.828281295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-474lz" (UniqueName: "kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz") pod "network-check-target-4k7qx" (UID: "a33aa089-b8e1-4aea-8457-254010f62a22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:34:57.196240 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:57.196158    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:57.196240 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:57.196180    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:57.196240 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:57.196181    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:57.196494 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:57.196273    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:34:57.196494 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:57.196403    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:34:57.196603 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:57.196511    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:34:59.204543 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:59.204518    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:34:59.204939 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:59.204616    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:34:59.204939 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:59.204664    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:34:59.204939 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:59.204769    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:34:59.205129 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:34:59.205042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:34:59.205129 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:34:59.205102    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:35:00.295914 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.295668    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4" event={"ID":"0b2e683d-65bd-4055-b844-9c8ce9886e17","Type":"ContainerStarted","Data":"11208d30e345bf2dc58f901a7b0fe0b7b6912653c367bb73385baf4c5d2c89ab"}
Sep 19 10:35:00.297097 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.297071    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rsrtv" event={"ID":"77bd7787-5d84-497b-a721-844fc9d22907","Type":"ContainerStarted","Data":"6582d9486184b2bbfad29ab22f46d9b9d9059037c03caf3ac9771a6668b7048d"}
Sep 19 10:35:00.299861 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.299844    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:35:00.300168 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.300146    2579 generic.go:356] "Generic (PLEG): container finished" podID="7ebd3a5f-3104-4518-b44b-6e88911e8d93" containerID="3f21a8ade6d6f78a18a694cfc8583046f01d0ae50d8fe5251d319792f5173f98" exitCode=1
Sep 19 10:35:00.300234 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.300203    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9" event={"ID":"7ebd3a5f-3104-4518-b44b-6e88911e8d93","Type":"ContainerStarted","Data":"ab3fdb704c10ea850880a37567eb68de243eace61d2c74fb872c08f95a43e49a"}
Sep 19 10:35:00.300290 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.300273    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9" event={"ID":"7ebd3a5f-3104-4518-b44b-6e88911e8d93","Type":"ContainerStarted","Data":"8549c0a061c577e07fd8838e40598e7c261e456bcccb9e2182147faa7ed96f2b"}
Sep 19 10:35:00.300397 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.300383    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9" event={"ID":"7ebd3a5f-3104-4518-b44b-6e88911e8d93","Type":"ContainerStarted","Data":"573f07d3169ecf61dca66499a38d526901a93b56eb34a452a9a460d558edc970"}
Sep 19 10:35:00.300451 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.300437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9" event={"ID":"7ebd3a5f-3104-4518-b44b-6e88911e8d93","Type":"ContainerStarted","Data":"6720cc6e62cbe6a71a05b5ec70c2c8a262f4bd82e3c266a66b93464982a53258"}
Sep 19 10:35:00.300492 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.300479    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9" event={"ID":"7ebd3a5f-3104-4518-b44b-6e88911e8d93","Type":"ContainerDied","Data":"3f21a8ade6d6f78a18a694cfc8583046f01d0ae50d8fe5251d319792f5173f98"}
Sep 19 10:35:00.300543 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.300533    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9" event={"ID":"7ebd3a5f-3104-4518-b44b-6e88911e8d93","Type":"ContainerStarted","Data":"cac3bd4b13b24f8346fbdb5980f17ad666a6e2c972ba776fb6b2252637888790"}
Sep 19 10:35:00.301630 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.301611    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rhh5b" event={"ID":"a924e506-1103-4d63-83b9-74d7974ae6d6","Type":"ContainerStarted","Data":"4b045c6b5d46a8e5fc81ef1d2c4a3d380ff0bf09ed12bf13912a693835c8394e"}
Sep 19 10:35:00.302965 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.302947    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p6szj" event={"ID":"4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5","Type":"ContainerStarted","Data":"9c32b124ae910d297664a672162d20aa691058f6b57fee8bfec16ef27c0f2e5d"}
Sep 19 10:35:00.304244 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.304222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l4x25" event={"ID":"fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4","Type":"ContainerStarted","Data":"4c1e674c9a1c1db3d5b3cc3094e95ca36e5a0499f95415b6c398d6e4bf4d4803"}
Sep 19 10:35:00.305596 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.305573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l7vf7" event={"ID":"34fe78b4-d425-4404-b550-61a7a8873f89","Type":"ContainerStarted","Data":"54a577775d9a07c8c30f38742cfeec84ba2dd86919163bc2a5acd46c0febf11c"}
Sep 19 10:35:00.307035 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.307015    2579 generic.go:356] "Generic (PLEG): container finished" podID="7991cbac-7da3-4611-b3a4-e6a8ed62901e" containerID="10b73ef25604eb369b4a9b401283aa615c09480f215dec66ef01b666d3068d3f" exitCode=0
Sep 19 10:35:00.307131 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.307041    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fq5vn" event={"ID":"7991cbac-7da3-4611-b3a4-e6a8ed62901e","Type":"ContainerDied","Data":"10b73ef25604eb369b4a9b401283aa615c09480f215dec66ef01b666d3068d3f"}
Sep 19 10:35:00.314119 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.314085    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rsrtv" podStartSLOduration=4.21451864 podStartE2EDuration="21.314074737s" totalImagesPullingTime="17.099556097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:00.313829491 +0000 UTC m=+23.213019377" watchObservedRunningTime="2026-09-19 10:35:00.314074737 +0000 UTC m=+23.213264628"
Sep 19 10:35:00.330365 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.330314    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-l7vf7" podStartSLOduration=4.158279232 podStartE2EDuration="21.330303353s" totalImagesPullingTime="17.172024121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:00.330055324 +0000 UTC m=+23.229245216" watchObservedRunningTime="2026-09-19 10:35:00.330303353 +0000 UTC m=+23.229493244"
Sep 19 10:35:00.362879 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.362845    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rhh5b" podStartSLOduration=4.2611782 podStartE2EDuration="21.362833435s" totalImagesPullingTime="17.101655235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:00.342972366 +0000 UTC m=+23.242162257" watchObservedRunningTime="2026-09-19 10:35:00.362833435 +0000 UTC m=+23.262023326"
Sep 19 10:35:00.375040 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.374982    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l4x25" podStartSLOduration=4.267697971 podStartE2EDuration="21.374971192s" totalImagesPullingTime="17.107273221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:00.374762451 +0000 UTC m=+23.273952344" watchObservedRunningTime="2026-09-19 10:35:00.374971192 +0000 UTC m=+23.274161083"
Sep 19 10:35:00.392148 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.392118    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p6szj" podStartSLOduration=8.387182525 podStartE2EDuration="21.392108329s" totalImagesPullingTime="13.004925804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:00.391635402 +0000 UTC m=+23.290825294" watchObservedRunningTime="2026-09-19 10:35:00.392108329 +0000 UTC m=+23.291298220"
Sep 19 10:35:00.720125 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:00.720085    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 19 10:35:01.175214 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:01.175117    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T10:35:00.720128378Z","UUID":"38ca608b-140c-4428-8d1b-600d3b34eb40","Handler":null,"Name":"","Endpoint":""}
Sep 19 10:35:01.176465 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:01.176445    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 19 10:35:01.176582 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:01.176477    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 19 10:35:01.196813 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:01.196786    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:35:01.196928 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:01.196786    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:01.196928 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:01.196921    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:35:01.197026 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:01.196914    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:35:01.197068 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:01.197044    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:35:01.197124 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:01.197108    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:35:01.311024 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:01.310992    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4" event={"ID":"0b2e683d-65bd-4055-b844-9c8ce9886e17","Type":"ContainerStarted","Data":"b6b06ea639394f0e4f95b3fdd6c53953eb942f85fbb3d61e6add4a48446beec4"}
Sep 19 10:35:01.312803 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:01.312677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2vh26" event={"ID":"8f2466a6-7440-4e73-af68-b490909a4606","Type":"ContainerStarted","Data":"acbb0af487a5c14f30f86e66be48695143d3840bf4117cdc94050a3d09fd9879"}
Sep 19 10:35:01.327072 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:01.327038    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2vh26" podStartSLOduration=5.23960479 podStartE2EDuration="22.327026607s" totalImagesPullingTime="17.087421817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:01.326596777 +0000 UTC m=+24.225786670" watchObservedRunningTime="2026-09-19 10:35:01.327026607 +0000 UTC m=+24.226216498"
Sep 19 10:35:02.317425 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:02.317385    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4" event={"ID":"0b2e683d-65bd-4055-b844-9c8ce9886e17","Type":"ContainerStarted","Data":"16272db2b22379419ce634eec83e3e8bd45b2d41ee0be98e481d06861bee87a5"}
Sep 19 10:35:02.320685 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:02.320663    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:35:02.321079 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:02.321053    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9" event={"ID":"7ebd3a5f-3104-4518-b44b-6e88911e8d93","Type":"ContainerStarted","Data":"159af036be882325fff5821c27382ca0c5ac5532909251f4c776ecd1bf1bf3c3"}
Sep 19 10:35:02.375463 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:02.375419    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjfd4" podStartSLOduration=4.092236482 podStartE2EDuration="23.375406701s" totalImagesPullingTime="19.283170219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:34:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:02.375319514 +0000 UTC m=+25.274509405" watchObservedRunningTime="2026-09-19 10:35:02.375406701 +0000 UTC m=+25.274596604"
Sep 19 10:35:02.821578 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:02.821552    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p6szj"
Sep 19 10:35:02.822258 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:02.822113    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p6szj"
Sep 19 10:35:03.196068 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:03.195989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:03.196068 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:03.196026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:35:03.196274 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:03.195993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:35:03.196274 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:03.196109    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:35:03.196274 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:03.196223    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:35:03.196426 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:03.196292    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:35:03.323876 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:03.323854    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p6szj"
Sep 19 10:35:03.324295 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:03.324146    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p6szj"
Sep 19 10:35:05.199110 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:05.199079    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:35:05.199572 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:05.199169    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:05.199572 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:05.199176    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:35:05.199572 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:05.199265    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:35:05.199572 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:05.199321    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:35:05.199572 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:05.199414    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:35:06.331696 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:06.331655    2579 generic.go:356] "Generic (PLEG): container finished" podID="7991cbac-7da3-4611-b3a4-e6a8ed62901e" containerID="6e0070cdc7b2d29d11c58cd7995f0ec68ba91f2034ae2595000decb3e38c2aa2" exitCode=0
Sep 19 10:35:06.332588 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:06.331761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fq5vn" event={"ID":"7991cbac-7da3-4611-b3a4-e6a8ed62901e","Type":"ContainerDied","Data":"6e0070cdc7b2d29d11c58cd7995f0ec68ba91f2034ae2595000decb3e38c2aa2"}
Sep 19 10:35:06.336292 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:06.336270    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:35:06.336838 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:06.336802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9" event={"ID":"7ebd3a5f-3104-4518-b44b-6e88911e8d93","Type":"ContainerStarted","Data":"607ebb10292ccf7d7cc156f889a2e3cf4f176e95b4e40f508a5ddd035008cbd9"}
Sep 19 10:35:06.337102 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:06.337071    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:35:06.337183 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:06.337169    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:35:06.337235 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:06.337218    2579 scope.go:117] "RemoveContainer" containerID="3f21a8ade6d6f78a18a694cfc8583046f01d0ae50d8fe5251d319792f5173f98"
Sep 19 10:35:06.353375 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:06.353309    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:35:07.196638 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.196495    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:35:07.196738 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.196495    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:35:07.196781 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:07.196744    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:35:07.196856 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:07.196832    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:35:07.196907 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.196504    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:07.196954 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:07.196937    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:35:07.343116 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.343095    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:35:07.343574 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.343542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9" event={"ID":"7ebd3a5f-3104-4518-b44b-6e88911e8d93","Type":"ContainerStarted","Data":"348b4ba328aa71901efa30b0f52e1de08528476ebe42ff2e93dd89a7e096f515"}
Sep 19 10:35:07.343933 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.343839    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:35:07.346209 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.346185    2579 generic.go:356] "Generic (PLEG): container finished" podID="7991cbac-7da3-4611-b3a4-e6a8ed62901e" containerID="96bf015a9cc88c7bab42be9a5a28163a272f26cd65fa454ff8b7efcf4e893e4a" exitCode=0
Sep 19 10:35:07.346306 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.346228    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fq5vn" event={"ID":"7991cbac-7da3-4611-b3a4-e6a8ed62901e","Type":"ContainerDied","Data":"96bf015a9cc88c7bab42be9a5a28163a272f26cd65fa454ff8b7efcf4e893e4a"}
Sep 19 10:35:07.349997 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.349974    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4k7qx"]
Sep 19 10:35:07.350081 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.350056    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:07.350162 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:07.350142    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:35:07.351241 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.351038    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7stdm"]
Sep 19 10:35:07.351241 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.351121    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:35:07.351241 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:07.351207    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:35:07.351994 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.351968    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2dwvp"]
Sep 19 10:35:07.352084 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.352057    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:35:07.352202 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:07.352183    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:35:07.362817 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.362758    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:35:07.374571 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:07.374536    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9" podStartSLOduration=11.235889327 podStartE2EDuration="28.374522648s" totalImagesPullingTime="17.138633321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:07.373426526 +0000 UTC m=+30.272616417" watchObservedRunningTime="2026-09-19 10:35:07.374522648 +0000 UTC m=+30.273712538"
Sep 19 10:35:09.198806 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:09.198776    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:35:09.198806 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:09.198804    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:09.199293 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:09.198776    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:35:09.199293 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:09.198896    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:35:09.199293 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:09.198960    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:35:09.199293 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:09.199038    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:35:09.353791 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:09.353763    2579 generic.go:356] "Generic (PLEG): container finished" podID="7991cbac-7da3-4611-b3a4-e6a8ed62901e" containerID="f4eeaa3fa196f44ca00806d2489afed9d028f2de3185f3b6b11dd3e997b5ee08" exitCode=0
Sep 19 10:35:09.353937 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:09.353851    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fq5vn" event={"ID":"7991cbac-7da3-4611-b3a4-e6a8ed62901e","Type":"ContainerDied","Data":"f4eeaa3fa196f44ca00806d2489afed9d028f2de3185f3b6b11dd3e997b5ee08"}
Sep 19 10:35:11.196822 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:11.196628    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:11.197272 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:11.196644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:35:11.197272 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:11.196908    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4k7qx" podUID="a33aa089-b8e1-4aea-8457-254010f62a22"
Sep 19 10:35:11.197272 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:11.196675    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:35:11.197272 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:11.196976    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dwvp" podUID="2b41c220-4b51-4250-989b-fdc1c5a684c8"
Sep 19 10:35:11.197272 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:11.197056    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7stdm" podUID="5562ade4-b9ad-402c-99ad-38724e6f5221"
Sep 19 10:35:12.094880 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.094854    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeReady"
Sep 19 10:35:12.095068 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.094983    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 19 10:35:12.130693 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.130661    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86b5b64789-5c99s"]
Sep 19 10:35:12.151197 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.151175    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tztnz"]
Sep 19 10:35:12.151313 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.151289    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.155065 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.154865    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 19 10:35:12.155065 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.154887    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 19 10:35:12.155065 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.154914    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-59nw8\""
Sep 19 10:35:12.155303 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.155273    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 19 10:35:12.160147 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.159974    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 19 10:35:12.165265 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.165242    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dhz2s"]
Sep 19 10:35:12.165381 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.165365    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.167942 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.167924    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 19 10:35:12.168038 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.167946    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-snddw\""
Sep 19 10:35:12.168371 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.168297    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 19 10:35:12.181933 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.181912    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b5b64789-5c99s"]
Sep 19 10:35:12.182021 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.181941    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tztnz"]
Sep 19 10:35:12.182021 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.181962    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dhz2s"]
Sep 19 10:35:12.182095 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.182024    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dhz2s"
Sep 19 10:35:12.184583 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.184564    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 19 10:35:12.184583 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.184578    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 19 10:35:12.184817 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.184565    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 19 10:35:12.185004 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.184941    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cttpt\""
Sep 19 10:35:12.237272 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.237245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-ca-trust-extracted\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.237586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.237278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-certificates\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.237586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.237304    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-installation-pull-secrets\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.237586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.237330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-bound-sa-token\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.237586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.237353    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8cc4\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-kube-api-access-w8cc4\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.237586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.237375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-trusted-ca\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.237586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.237401    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02262f5a-d60e-41b9-a942-8ae81cf009b1-tmp-dir\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.237586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.237424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-image-registry-private-configuration\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.237586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.237444    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77lg8\" (UniqueName: \"kubernetes.io/projected/02262f5a-d60e-41b9-a942-8ae81cf009b1-kube-api-access-77lg8\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.237586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.237492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.237586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.237539    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02262f5a-d60e-41b9-a942-8ae81cf009b1-config-volume\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.237586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.237558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.338088 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-ca-trust-extracted\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.338088 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-certificates\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.338299 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-installation-pull-secrets\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.338299 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-bound-sa-token\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.338299 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8cc4\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-kube-api-access-w8cc4\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.338299 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-trusted-ca\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.338299 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338230    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02262f5a-d60e-41b9-a942-8ae81cf009b1-tmp-dir\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.338299 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-image-registry-private-configuration\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.338299 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77lg8\" (UniqueName: \"kubernetes.io/projected/02262f5a-d60e-41b9-a942-8ae81cf009b1-kube-api-access-77lg8\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.338634 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgwfp\" (UniqueName: \"kubernetes.io/projected/2fcd2c88-949d-4f19-922d-285340024356-kube-api-access-sgwfp\") pod \"ingress-canary-dhz2s\" (UID: \"2fcd2c88-949d-4f19-922d-285340024356\") " pod="openshift-ingress-canary/ingress-canary-dhz2s"
Sep 19 10:35:12.338634 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338350    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fcd2c88-949d-4f19-922d-285340024356-cert\") pod \"ingress-canary-dhz2s\" (UID: \"2fcd2c88-949d-4f19-922d-285340024356\") " pod="openshift-ingress-canary/ingress-canary-dhz2s"
Sep 19 10:35:12.338634 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.338634 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02262f5a-d60e-41b9-a942-8ae81cf009b1-config-volume\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.338634 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.338885 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.338644    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 10:35:12.338885 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.338695    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 10:35:12.338885 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.338714    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b5b64789-5c99s: secret "image-registry-tls" not found
Sep 19 10:35:12.338885 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.338764    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-ca-trust-extracted\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.338885 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.338701    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls podName:02262f5a-d60e-41b9-a942-8ae81cf009b1 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:12.838682963 +0000 UTC m=+35.737872847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls") pod "dns-default-tztnz" (UID: "02262f5a-d60e-41b9-a942-8ae81cf009b1") : secret "dns-default-metrics-tls" not found
Sep 19 10:35:12.338885 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.338856    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls podName:ce1ff929-7052-4241-9489-3ac3a8ff1cf1 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:12.838837417 +0000 UTC m=+35.738027287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls") pod "image-registry-86b5b64789-5c99s" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1") : secret "image-registry-tls" not found
Sep 19 10:35:12.339175 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.339154    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-certificates\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.339429 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.339402    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02262f5a-d60e-41b9-a942-8ae81cf009b1-config-volume\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.339564 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.339547    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02262f5a-d60e-41b9-a942-8ae81cf009b1-tmp-dir\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.339679 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.339657    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-trusted-ca\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.342596 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.342576    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-installation-pull-secrets\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.342686 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.342582    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-image-registry-private-configuration\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.346795 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.346664    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8cc4\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-kube-api-access-w8cc4\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.347016 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.346975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-bound-sa-token\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.347124 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.347089    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77lg8\" (UniqueName: \"kubernetes.io/projected/02262f5a-d60e-41b9-a942-8ae81cf009b1-kube-api-access-77lg8\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.439094 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.439062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgwfp\" (UniqueName: \"kubernetes.io/projected/2fcd2c88-949d-4f19-922d-285340024356-kube-api-access-sgwfp\") pod \"ingress-canary-dhz2s\" (UID: \"2fcd2c88-949d-4f19-922d-285340024356\") " pod="openshift-ingress-canary/ingress-canary-dhz2s"
Sep 19 10:35:12.439234 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.439106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fcd2c88-949d-4f19-922d-285340024356-cert\") pod \"ingress-canary-dhz2s\" (UID: \"2fcd2c88-949d-4f19-922d-285340024356\") " pod="openshift-ingress-canary/ingress-canary-dhz2s"
Sep 19 10:35:12.441588 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.441563    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fcd2c88-949d-4f19-922d-285340024356-cert\") pod \"ingress-canary-dhz2s\" (UID: \"2fcd2c88-949d-4f19-922d-285340024356\") " pod="openshift-ingress-canary/ingress-canary-dhz2s"
Sep 19 10:35:12.447332 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.447307    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgwfp\" (UniqueName: \"kubernetes.io/projected/2fcd2c88-949d-4f19-922d-285340024356-kube-api-access-sgwfp\") pod \"ingress-canary-dhz2s\" (UID: \"2fcd2c88-949d-4f19-922d-285340024356\") " pod="openshift-ingress-canary/ingress-canary-dhz2s"
Sep 19 10:35:12.491348 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.491324    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dhz2s"
Sep 19 10:35:12.843934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.843898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:12.844127 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.843975    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:12.844127 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.844097    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 10:35:12.844251 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.844127    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 10:35:12.844251 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.844145    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b5b64789-5c99s: secret "image-registry-tls" not found
Sep 19 10:35:12.844251 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.844169    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls podName:02262f5a-d60e-41b9-a942-8ae81cf009b1 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:13.844150582 +0000 UTC m=+36.743340452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls") pod "dns-default-tztnz" (UID: "02262f5a-d60e-41b9-a942-8ae81cf009b1") : secret "dns-default-metrics-tls" not found
Sep 19 10:35:12.844251 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.844189    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls podName:ce1ff929-7052-4241-9489-3ac3a8ff1cf1 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:13.844175812 +0000 UTC m=+36.743365682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls") pod "image-registry-86b5b64789-5c99s" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1") : secret "image-registry-tls" not found
Sep 19 10:35:12.945146 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.945091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:35:12.945327 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.945161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:35:12.945327 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:12.945219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-474lz\" (UniqueName: \"kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz\") pod \"network-check-target-4k7qx\" (UID: \"a33aa089-b8e1-4aea-8457-254010f62a22\") " pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:12.945327 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.945246    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:35:12.945327 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.945265    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 10:35:12.945327 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.945305    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs podName:2b41c220-4b51-4250-989b-fdc1c5a684c8 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:44.945286596 +0000 UTC m=+67.844476480 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs") pod "network-metrics-daemon-2dwvp" (UID: "2b41c220-4b51-4250-989b-fdc1c5a684c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 10:35:12.945327 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.945325    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret podName:5562ade4-b9ad-402c-99ad-38724e6f5221 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:44.945316132 +0000 UTC m=+67.844506006 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret") pod "global-pull-secret-syncer-7stdm" (UID: "5562ade4-b9ad-402c-99ad-38724e6f5221") : object "kube-system"/"original-pull-secret" not registered
Sep 19 10:35:12.945648 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.945356    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 10:35:12.945648 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.945377    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 10:35:12.945648 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.945392    2579 projected.go:196] Error preparing data for projected volume kube-api-access-474lz for pod openshift-network-diagnostics/network-check-target-4k7qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:35:12.945648 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:12.945441    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz podName:a33aa089-b8e1-4aea-8457-254010f62a22 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:44.945425327 +0000 UTC m=+67.844615203 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-474lz" (UniqueName: "kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz") pod "network-check-target-4k7qx" (UID: "a33aa089-b8e1-4aea-8457-254010f62a22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 10:35:13.196683 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:13.196623    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:13.196924 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:13.196624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:35:13.196924 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:13.196632    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:35:13.199457 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:13.199439    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 10:35:13.200420 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:13.200392    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 10:35:13.200517 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:13.200430    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 10:35:13.200517 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:13.200443    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8jxmp\""
Sep 19 10:35:13.200632 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:13.200596    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 10:35:13.200687 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:13.200641    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d9kv4\""
Sep 19 10:35:13.697697 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:13.697671    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dhz2s"]
Sep 19 10:35:13.701184 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:35:13.701158    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fcd2c88_949d_4f19_922d_285340024356.slice/crio-2db8e279ef7101159bcc715008b342f9db8085771dee944af5c94cce6ff748da WatchSource:0}: Error finding container 2db8e279ef7101159bcc715008b342f9db8085771dee944af5c94cce6ff748da: Status 404 returned error can't find the container with id 2db8e279ef7101159bcc715008b342f9db8085771dee944af5c94cce6ff748da
Sep 19 10:35:13.852552 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:13.852410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:13.852661 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:13.852582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:13.852661 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:13.852513    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 10:35:13.852661 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:13.852641    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b5b64789-5c99s: secret "image-registry-tls" not found
Sep 19 10:35:13.852789 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:13.852685    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls podName:ce1ff929-7052-4241-9489-3ac3a8ff1cf1 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:15.852669429 +0000 UTC m=+38.751859304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls") pod "image-registry-86b5b64789-5c99s" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1") : secret "image-registry-tls" not found
Sep 19 10:35:13.852789 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:13.852698    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 10:35:13.852789 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:13.852750    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls podName:02262f5a-d60e-41b9-a942-8ae81cf009b1 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:15.852739412 +0000 UTC m=+38.751929295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls") pod "dns-default-tztnz" (UID: "02262f5a-d60e-41b9-a942-8ae81cf009b1") : secret "dns-default-metrics-tls" not found
Sep 19 10:35:14.369955 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:14.369919    2579 generic.go:356] "Generic (PLEG): container finished" podID="7991cbac-7da3-4611-b3a4-e6a8ed62901e" containerID="ecf00e693ab489ea67344f10f7e93bc245111f21319129424d38a0de56f1ed3d" exitCode=0
Sep 19 10:35:14.370212 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:14.370001    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fq5vn" event={"ID":"7991cbac-7da3-4611-b3a4-e6a8ed62901e","Type":"ContainerDied","Data":"ecf00e693ab489ea67344f10f7e93bc245111f21319129424d38a0de56f1ed3d"}
Sep 19 10:35:14.371268 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:14.371249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dhz2s" event={"ID":"2fcd2c88-949d-4f19-922d-285340024356","Type":"ContainerStarted","Data":"2db8e279ef7101159bcc715008b342f9db8085771dee944af5c94cce6ff748da"}
Sep 19 10:35:15.378111 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.378072    2579 generic.go:356] "Generic (PLEG): container finished" podID="7991cbac-7da3-4611-b3a4-e6a8ed62901e" containerID="bb00f1405f4c0cec846239ba0e5e080527801ef86e7b6a62067dd0e0eadf5177" exitCode=0
Sep 19 10:35:15.378538 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.378150    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fq5vn" event={"ID":"7991cbac-7da3-4611-b3a4-e6a8ed62901e","Type":"ContainerDied","Data":"bb00f1405f4c0cec846239ba0e5e080527801ef86e7b6a62067dd0e0eadf5177"}
Sep 19 10:35:15.529296 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.529269    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6hzw4"]
Sep 19 10:35:15.531588 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.531562    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.533661 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.533638    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 19 10:35:15.534378 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.534352    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 19 10:35:15.534464 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.534414    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 19 10:35:15.534607 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.534582    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 19 10:35:15.534720 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.534594    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rcqd6\""
Sep 19 10:35:15.551265 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.551246    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6hzw4"]
Sep 19 10:35:15.667990 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.667915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21744756-dc19-4619-a75c-c114d0364cf8-data-volume\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.667990 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.667971    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.668174 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.668074    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.668174 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.668111    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dl69\" (UniqueName: \"kubernetes.io/projected/21744756-dc19-4619-a75c-c114d0364cf8-kube-api-access-7dl69\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.668253 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.668175    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21744756-dc19-4619-a75c-c114d0364cf8-crio-socket\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.769434 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.769400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21744756-dc19-4619-a75c-c114d0364cf8-data-volume\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.769434 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.769445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.769657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.769492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.769657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.769508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dl69\" (UniqueName: \"kubernetes.io/projected/21744756-dc19-4619-a75c-c114d0364cf8-kube-api-access-7dl69\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.769657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.769537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21744756-dc19-4619-a75c-c114d0364cf8-crio-socket\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.769838 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:15.769682    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 10:35:15.769838 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:15.769776    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls podName:21744756-dc19-4619-a75c-c114d0364cf8 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:16.269751926 +0000 UTC m=+39.168941812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hzw4" (UID: "21744756-dc19-4619-a75c-c114d0364cf8") : secret "insights-runtime-extractor-tls" not found
Sep 19 10:35:15.769838 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:15.769783    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 10:35:15.769838 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.769795    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21744756-dc19-4619-a75c-c114d0364cf8-data-volume\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.770020 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:15.769851    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm podName:21744756-dc19-4619-a75c-c114d0364cf8 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:16.269833443 +0000 UTC m=+39.169023330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hzw4" (UID: "21744756-dc19-4619-a75c-c114d0364cf8") : configmap "kube-rbac-proxy" not found
Sep 19 10:35:15.770020 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.769933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21744756-dc19-4619-a75c-c114d0364cf8-crio-socket\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.782494 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.782469    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dl69\" (UniqueName: \"kubernetes.io/projected/21744756-dc19-4619-a75c-c114d0364cf8-kube-api-access-7dl69\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:15.870085 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.870061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:15.870195 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:15.870115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:15.870195 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:15.870185    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 10:35:15.870294 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:15.870204    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b5b64789-5c99s: secret "image-registry-tls" not found
Sep 19 10:35:15.870294 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:15.870257    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 10:35:15.870473 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:15.870260    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls podName:ce1ff929-7052-4241-9489-3ac3a8ff1cf1 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:19.87024001 +0000 UTC m=+42.769429900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls") pod "image-registry-86b5b64789-5c99s" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1") : secret "image-registry-tls" not found
Sep 19 10:35:15.870473 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:15.870324    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls podName:02262f5a-d60e-41b9-a942-8ae81cf009b1 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:19.870306186 +0000 UTC m=+42.769496059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls") pod "dns-default-tztnz" (UID: "02262f5a-d60e-41b9-a942-8ae81cf009b1") : secret "dns-default-metrics-tls" not found
Sep 19 10:35:16.273487 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:16.273403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:16.273622 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:16.273496    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:16.273622 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:16.273531    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 10:35:16.273689 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:16.273620    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 10:35:16.273689 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:16.273655    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm podName:21744756-dc19-4619-a75c-c114d0364cf8 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:17.273638286 +0000 UTC m=+40.172828155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hzw4" (UID: "21744756-dc19-4619-a75c-c114d0364cf8") : configmap "kube-rbac-proxy" not found
Sep 19 10:35:16.273689 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:16.273670    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls podName:21744756-dc19-4619-a75c-c114d0364cf8 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:17.273664171 +0000 UTC m=+40.172854041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hzw4" (UID: "21744756-dc19-4619-a75c-c114d0364cf8") : secret "insights-runtime-extractor-tls" not found
Sep 19 10:35:16.381570 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:16.381538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dhz2s" event={"ID":"2fcd2c88-949d-4f19-922d-285340024356","Type":"ContainerStarted","Data":"15e286ad64530f39eb0a40e1e3507b21b20a1fbb33bb1ee3ec79aca46146169b"}
Sep 19 10:35:16.385023 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:16.385000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fq5vn" event={"ID":"7991cbac-7da3-4611-b3a4-e6a8ed62901e","Type":"ContainerStarted","Data":"81b53cbb25ffbc082d859c4cb38ffc5fd1eb3e3ba6ef4cb336c182be74d61ee5"}
Sep 19 10:35:16.401047 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:16.401001    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dhz2s" podStartSLOduration=2.208020805 podStartE2EDuration="4.400984284s" totalImagesPullingTime="2.192963479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:16.400705121 +0000 UTC m=+39.299895013" watchObservedRunningTime="2026-09-19 10:35:16.400984284 +0000 UTC m=+39.300174198"
Sep 19 10:35:16.421375 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:16.421339    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fq5vn" podStartSLOduration=8.801702654 podStartE2EDuration="37.421328414s" totalImagesPullingTime="28.61962576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:34:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:16.42000295 +0000 UTC m=+39.319192843" watchObservedRunningTime="2026-09-19 10:35:16.421328414 +0000 UTC m=+39.320518306"
Sep 19 10:35:17.194023 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.193954    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-dkb4t"]
Sep 19 10:35:17.197606 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.197579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t"
Sep 19 10:35:17.199937 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.199911    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-d5xvh\""
Sep 19 10:35:17.199937 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.199927    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 19 10:35:17.200147 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.199927    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 19 10:35:17.200747 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.200709    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 19 10:35:17.200866 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.200772    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 19 10:35:17.205414 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.205391    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-dkb4t"]
Sep 19 10:35:17.281183 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.281156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:17.281294 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.281219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:17.281363 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:17.281300    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 10:35:17.281363 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:17.281318    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 10:35:17.281363 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:17.281357    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls podName:21744756-dc19-4619-a75c-c114d0364cf8 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:19.281341021 +0000 UTC m=+42.180530891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hzw4" (UID: "21744756-dc19-4619-a75c-c114d0364cf8") : secret "insights-runtime-extractor-tls" not found
Sep 19 10:35:17.281488 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:17.281373    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm podName:21744756-dc19-4619-a75c-c114d0364cf8 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:19.281366104 +0000 UTC m=+42.180555974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hzw4" (UID: "21744756-dc19-4619-a75c-c114d0364cf8") : configmap "kube-rbac-proxy" not found
Sep 19 10:35:17.382140 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.382113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/09d962b5-6103-4bf4-9331-8c25ef73ed20-signing-key\") pod \"service-ca-55f6fc7b86-dkb4t\" (UID: \"09d962b5-6103-4bf4-9331-8c25ef73ed20\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t"
Sep 19 10:35:17.382140 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.382140    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh9n7\" (UniqueName: \"kubernetes.io/projected/09d962b5-6103-4bf4-9331-8c25ef73ed20-kube-api-access-fh9n7\") pod \"service-ca-55f6fc7b86-dkb4t\" (UID: \"09d962b5-6103-4bf4-9331-8c25ef73ed20\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t"
Sep 19 10:35:17.382449 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.382205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/09d962b5-6103-4bf4-9331-8c25ef73ed20-signing-cabundle\") pod \"service-ca-55f6fc7b86-dkb4t\" (UID: \"09d962b5-6103-4bf4-9331-8c25ef73ed20\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t"
Sep 19 10:35:17.482866 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.482801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh9n7\" (UniqueName: \"kubernetes.io/projected/09d962b5-6103-4bf4-9331-8c25ef73ed20-kube-api-access-fh9n7\") pod \"service-ca-55f6fc7b86-dkb4t\" (UID: \"09d962b5-6103-4bf4-9331-8c25ef73ed20\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t"
Sep 19 10:35:17.482980 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.482914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/09d962b5-6103-4bf4-9331-8c25ef73ed20-signing-cabundle\") pod \"service-ca-55f6fc7b86-dkb4t\" (UID: \"09d962b5-6103-4bf4-9331-8c25ef73ed20\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t"
Sep 19 10:35:17.483317 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.483289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/09d962b5-6103-4bf4-9331-8c25ef73ed20-signing-key\") pod \"service-ca-55f6fc7b86-dkb4t\" (UID: \"09d962b5-6103-4bf4-9331-8c25ef73ed20\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t"
Sep 19 10:35:17.483586 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.483562    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/09d962b5-6103-4bf4-9331-8c25ef73ed20-signing-cabundle\") pod \"service-ca-55f6fc7b86-dkb4t\" (UID: \"09d962b5-6103-4bf4-9331-8c25ef73ed20\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t"
Sep 19 10:35:17.486288 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.486266    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/09d962b5-6103-4bf4-9331-8c25ef73ed20-signing-key\") pod \"service-ca-55f6fc7b86-dkb4t\" (UID: \"09d962b5-6103-4bf4-9331-8c25ef73ed20\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t"
Sep 19 10:35:17.491320 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.491294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh9n7\" (UniqueName: \"kubernetes.io/projected/09d962b5-6103-4bf4-9331-8c25ef73ed20-kube-api-access-fh9n7\") pod \"service-ca-55f6fc7b86-dkb4t\" (UID: \"09d962b5-6103-4bf4-9331-8c25ef73ed20\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t"
Sep 19 10:35:17.492908 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.492886    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l4x25_fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4/dns-node-resolver/0.log"
Sep 19 10:35:17.507131 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.507111    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t"
Sep 19 10:35:17.782823 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:17.782781    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-dkb4t"]
Sep 19 10:35:17.784822 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:35:17.784796    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d962b5_6103_4bf4_9331_8c25ef73ed20.slice/crio-1acf777bdbb09c03d6582010b4c7a49c5a52e3b30b3aae0004e92da820313616 WatchSource:0}: Error finding container 1acf777bdbb09c03d6582010b4c7a49c5a52e3b30b3aae0004e92da820313616: Status 404 returned error can't find the container with id 1acf777bdbb09c03d6582010b4c7a49c5a52e3b30b3aae0004e92da820313616
Sep 19 10:35:18.391235 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:18.391192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t" event={"ID":"09d962b5-6103-4bf4-9331-8c25ef73ed20","Type":"ContainerStarted","Data":"1acf777bdbb09c03d6582010b4c7a49c5a52e3b30b3aae0004e92da820313616"}
Sep 19 10:35:18.693780 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:18.693696    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rhh5b_a924e506-1103-4d63-83b9-74d7974ae6d6/node-ca/0.log"
Sep 19 10:35:19.295616 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:19.295584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:19.295824 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:19.295685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:19.295824 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:19.295739    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 10:35:19.295824 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:19.295812    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm podName:21744756-dc19-4619-a75c-c114d0364cf8 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:23.295793578 +0000 UTC m=+46.194983455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hzw4" (UID: "21744756-dc19-4619-a75c-c114d0364cf8") : configmap "kube-rbac-proxy" not found
Sep 19 10:35:19.295824 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:19.295821    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 10:35:19.296053 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:19.295869    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls podName:21744756-dc19-4619-a75c-c114d0364cf8 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:23.295855731 +0000 UTC m=+46.195045601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hzw4" (UID: "21744756-dc19-4619-a75c-c114d0364cf8") : secret "insights-runtime-extractor-tls" not found
Sep 19 10:35:19.298077 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:19.298054    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dhz2s_2fcd2c88-949d-4f19-922d-285340024356/serve-healthcheck-canary/0.log"
Sep 19 10:35:19.899965 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:19.899927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:19.900283 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:19.899976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:19.900283 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:19.900082    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 10:35:19.900283 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:19.900100    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b5b64789-5c99s: secret "image-registry-tls" not found
Sep 19 10:35:19.900283 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:19.900151    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls podName:ce1ff929-7052-4241-9489-3ac3a8ff1cf1 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:27.900133639 +0000 UTC m=+50.799323521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls") pod "image-registry-86b5b64789-5c99s" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1") : secret "image-registry-tls" not found
Sep 19 10:35:19.900283 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:19.900154    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 10:35:19.900283 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:19.900213    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls podName:02262f5a-d60e-41b9-a942-8ae81cf009b1 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:27.900195531 +0000 UTC m=+50.799385405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls") pod "dns-default-tztnz" (UID: "02262f5a-d60e-41b9-a942-8ae81cf009b1") : secret "dns-default-metrics-tls" not found
Sep 19 10:35:20.398335 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:20.398295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t" event={"ID":"09d962b5-6103-4bf4-9331-8c25ef73ed20","Type":"ContainerStarted","Data":"d5948e49a1e6d2217431d48d0f3d7ee5ae9d2c3f4fbb99e213cd93ab85da1dc4"}
Sep 19 10:35:20.415302 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:20.415262    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-dkb4t" podStartSLOduration=1.463318249 podStartE2EDuration="3.415249423s" totalImagesPullingTime="1.951931174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:20.414115557 +0000 UTC m=+43.313305451" watchObservedRunningTime="2026-09-19 10:35:20.415249423 +0000 UTC m=+43.314439315"
Sep 19 10:35:23.324736 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:23.324690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:23.325238 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:23.324769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:23.325238 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:23.324832    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 10:35:23.325238 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:23.324887    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls podName:21744756-dc19-4619-a75c-c114d0364cf8 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:31.324872981 +0000 UTC m=+54.224062856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hzw4" (UID: "21744756-dc19-4619-a75c-c114d0364cf8") : secret "insights-runtime-extractor-tls" not found
Sep 19 10:35:23.325418 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:23.325353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21744756-dc19-4619-a75c-c114d0364cf8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:27.956340 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:27.956309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:27.956753 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:27.956353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:27.958671 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:27.958649    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls\") pod \"image-registry-86b5b64789-5c99s\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") " pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:27.958743 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:27.958655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02262f5a-d60e-41b9-a942-8ae81cf009b1-metrics-tls\") pod \"dns-default-tztnz\" (UID: \"02262f5a-d60e-41b9-a942-8ae81cf009b1\") " pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:28.062915 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:28.062888    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:28.076058 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:28.076031    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:28.366257 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:28.366231    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b5b64789-5c99s"]
Sep 19 10:35:28.370474 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:35:28.370451    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1ff929_7052_4241_9489_3ac3a8ff1cf1.slice/crio-d77be1969853a99e074cca84bb1eecc097397a0f7a557c23015dc2d7942d3ff6 WatchSource:0}: Error finding container d77be1969853a99e074cca84bb1eecc097397a0f7a557c23015dc2d7942d3ff6: Status 404 returned error can't find the container with id d77be1969853a99e074cca84bb1eecc097397a0f7a557c23015dc2d7942d3ff6
Sep 19 10:35:28.385112 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:28.385090    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tztnz"]
Sep 19 10:35:28.387762 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:35:28.387740    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02262f5a_d60e_41b9_a942_8ae81cf009b1.slice/crio-d03a23f1032f6ba6c327f3809e5cdfd1225f5c4704d1c22a40cf8d250ac6b383 WatchSource:0}: Error finding container d03a23f1032f6ba6c327f3809e5cdfd1225f5c4704d1c22a40cf8d250ac6b383: Status 404 returned error can't find the container with id d03a23f1032f6ba6c327f3809e5cdfd1225f5c4704d1c22a40cf8d250ac6b383
Sep 19 10:35:28.421372 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:28.421346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b5b64789-5c99s" event={"ID":"ce1ff929-7052-4241-9489-3ac3a8ff1cf1","Type":"ContainerStarted","Data":"d77be1969853a99e074cca84bb1eecc097397a0f7a557c23015dc2d7942d3ff6"}
Sep 19 10:35:28.422376 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:28.422354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tztnz" event={"ID":"02262f5a-d60e-41b9-a942-8ae81cf009b1","Type":"ContainerStarted","Data":"d03a23f1032f6ba6c327f3809e5cdfd1225f5c4704d1c22a40cf8d250ac6b383"}
Sep 19 10:35:29.426979 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:29.426699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b5b64789-5c99s" event={"ID":"ce1ff929-7052-4241-9489-3ac3a8ff1cf1","Type":"ContainerStarted","Data":"4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659"}
Sep 19 10:35:29.426979 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:29.426912    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:29.448638 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:29.448584    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86b5b64789-5c99s" podStartSLOduration=21.448566385 podStartE2EDuration="21.448566385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:35:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:29.446343323 +0000 UTC m=+52.345533207" watchObservedRunningTime="2026-09-19 10:35:29.448566385 +0000 UTC m=+52.347756274"
Sep 19 10:35:31.384040 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:31.384003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:31.386473 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:31.386436    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21744756-dc19-4619-a75c-c114d0364cf8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hzw4\" (UID: \"21744756-dc19-4619-a75c-c114d0364cf8\") " pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:31.436134 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:31.436105    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tztnz" event={"ID":"02262f5a-d60e-41b9-a942-8ae81cf009b1","Type":"ContainerStarted","Data":"ce0f83568a32a3f19b970e3a17d6f59fbd834392fe5ac15bd6132e3dc33c67f7"}
Sep 19 10:35:31.436285 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:31.436169    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tztnz" event={"ID":"02262f5a-d60e-41b9-a942-8ae81cf009b1","Type":"ContainerStarted","Data":"9a5a51c0c36bbe8706b850c4c485e915db0603e7a1d5fd842d17ed587d9c6df2"}
Sep 19 10:35:31.436285 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:31.436254    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:31.444494 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:31.444469    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6hzw4"
Sep 19 10:35:31.454958 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:31.454901    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tztnz" podStartSLOduration=17.377395439 podStartE2EDuration="19.45488723s" totalImagesPullingTime="2.077491791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:31.454478625 +0000 UTC m=+54.353668538" watchObservedRunningTime="2026-09-19 10:35:31.45488723 +0000 UTC m=+54.354077121"
Sep 19 10:35:31.737926 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:31.737859    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6hzw4"]
Sep 19 10:35:31.742030 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:35:31.742006    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21744756_dc19_4619_a75c_c114d0364cf8.slice/crio-be12cd373cee66918cc4622b13ed78a768b26a7d1aeabf2f1826df239508e1b0 WatchSource:0}: Error finding container be12cd373cee66918cc4622b13ed78a768b26a7d1aeabf2f1826df239508e1b0: Status 404 returned error can't find the container with id be12cd373cee66918cc4622b13ed78a768b26a7d1aeabf2f1826df239508e1b0
Sep 19 10:35:32.441100 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:32.441065    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hzw4" event={"ID":"21744756-dc19-4619-a75c-c114d0364cf8","Type":"ContainerStarted","Data":"388839f65688cdba2f7e43816223c60af3f029f1943243b7118f41fc38a0b30d"}
Sep 19 10:35:32.441449 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:32.441160    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hzw4" event={"ID":"21744756-dc19-4619-a75c-c114d0364cf8","Type":"ContainerStarted","Data":"be12cd373cee66918cc4622b13ed78a768b26a7d1aeabf2f1826df239508e1b0"}
Sep 19 10:35:33.445832 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:33.445803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hzw4" event={"ID":"21744756-dc19-4619-a75c-c114d0364cf8","Type":"ContainerStarted","Data":"8f0adff8e0b7ec853f8a9c0cb4e5056ff41b7c806a9b72c6bbb349a0dbb9bdb7"}
Sep 19 10:35:35.454705 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:35.454671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hzw4" event={"ID":"21744756-dc19-4619-a75c-c114d0364cf8","Type":"ContainerStarted","Data":"b2f78fabe4376551ef8e881b7677ae1e7de8c0689dc32937ce480f78dfcad64d"}
Sep 19 10:35:35.473075 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:35.473030    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6hzw4" podStartSLOduration=17.646896175 podStartE2EDuration="20.473016026s" totalImagesPullingTime="2.826119851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:35:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:35.472720442 +0000 UTC m=+58.371910333" watchObservedRunningTime="2026-09-19 10:35:35.473016026 +0000 UTC m=+58.372205920"
Sep 19 10:35:37.334808 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.334773    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86b5b64789-5c99s"]
Sep 19 10:35:37.351227 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.351187    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"]
Sep 19 10:35:37.368973 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.368946    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"]
Sep 19 10:35:37.369114 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.369069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.372986 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.372960    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 19 10:35:37.372986 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.372982    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 19 10:35:37.373297 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.373275    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 19 10:35:37.373492 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.373475    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 19 10:35:37.373715 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.373677    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 19 10:35:37.373833 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.373761    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 19 10:35:37.373833 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.373801    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 19 10:35:37.426524 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.426501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b56cde7f-8b1c-4cc7-904e-21155e69c006-ca\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.426610 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.426551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b56cde7f-8b1c-4cc7-904e-21155e69c006-hub\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.426610 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.426570    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b56cde7f-8b1c-4cc7-904e-21155e69c006-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.426610 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.426600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrpbr\" (UniqueName: \"kubernetes.io/projected/b56cde7f-8b1c-4cc7-904e-21155e69c006-kube-api-access-hrpbr\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.426762 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.426624    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b56cde7f-8b1c-4cc7-904e-21155e69c006-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.426762 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.426674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b56cde7f-8b1c-4cc7-904e-21155e69c006-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.527489 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.527463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b56cde7f-8b1c-4cc7-904e-21155e69c006-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.527575 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.527492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b56cde7f-8b1c-4cc7-904e-21155e69c006-ca\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.527575 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.527523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b56cde7f-8b1c-4cc7-904e-21155e69c006-hub\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.527701 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.527642    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b56cde7f-8b1c-4cc7-904e-21155e69c006-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.527701 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.527670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrpbr\" (UniqueName: \"kubernetes.io/projected/b56cde7f-8b1c-4cc7-904e-21155e69c006-kube-api-access-hrpbr\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.527701 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.527689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b56cde7f-8b1c-4cc7-904e-21155e69c006-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.528237 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.528219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b56cde7f-8b1c-4cc7-904e-21155e69c006-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.530003 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.529985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b56cde7f-8b1c-4cc7-904e-21155e69c006-hub\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.530003 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.530001    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b56cde7f-8b1c-4cc7-904e-21155e69c006-ca\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.530402 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.530386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b56cde7f-8b1c-4cc7-904e-21155e69c006-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.530464 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.530418    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b56cde7f-8b1c-4cc7-904e-21155e69c006-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.535751 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.535698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrpbr\" (UniqueName: \"kubernetes.io/projected/b56cde7f-8b1c-4cc7-904e-21155e69c006-kube-api-access-hrpbr\") pod \"cluster-proxy-proxy-agent-5f587fd848-mgjh8\" (UID: \"b56cde7f-8b1c-4cc7-904e-21155e69c006\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.684773 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.684708    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"
Sep 19 10:35:37.978201 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:37.978138    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8"]
Sep 19 10:35:37.980991 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:35:37.980964    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb56cde7f_8b1c_4cc7_904e_21155e69c006.slice/crio-7aeb9c4c110a43904fa284f38e5f72675dcd39336c143d0bc6459b1fac25f605 WatchSource:0}: Error finding container 7aeb9c4c110a43904fa284f38e5f72675dcd39336c143d0bc6459b1fac25f605: Status 404 returned error can't find the container with id 7aeb9c4c110a43904fa284f38e5f72675dcd39336c143d0bc6459b1fac25f605
Sep 19 10:35:38.465274 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:38.465245    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8" event={"ID":"b56cde7f-8b1c-4cc7-904e-21155e69c006","Type":"ContainerStarted","Data":"7aeb9c4c110a43904fa284f38e5f72675dcd39336c143d0bc6459b1fac25f605"}
Sep 19 10:35:39.367349 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:39.367321    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hk5p9"
Sep 19 10:35:41.443354 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:41.443331    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tztnz"
Sep 19 10:35:41.478210 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:41.478127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8" event={"ID":"b56cde7f-8b1c-4cc7-904e-21155e69c006","Type":"ContainerStarted","Data":"0b6d26a63c8185dc3e58ddc528934376d053ac940db5faa10c6903cddefddbe8"}
Sep 19 10:35:42.483202 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:42.483164    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8" event={"ID":"b56cde7f-8b1c-4cc7-904e-21155e69c006","Type":"ContainerStarted","Data":"cb1c8ebbf86a3e4d04f3fe64d99abee5c10002a060b31185523eccd2fac49152"}
Sep 19 10:35:42.483618 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:42.483217    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8" event={"ID":"b56cde7f-8b1c-4cc7-904e-21155e69c006","Type":"ContainerStarted","Data":"3613a6fc171a384cdee5cce5d131df93fa2fea18bd353b55f494e3446db33ed0"}
Sep 19 10:35:42.503493 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:42.503445    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f587fd848-mgjh8" podStartSLOduration=2.103541461 podStartE2EDuration="5.503427706s" totalImagesPullingTime="3.399886245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:42.502157641 +0000 UTC m=+65.401347534" watchObservedRunningTime="2026-09-19 10:35:42.503427706 +0000 UTC m=+65.402617652"
Sep 19 10:35:44.975137 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:44.975094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:35:44.975137 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:44.975149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-474lz\" (UniqueName: \"kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz\") pod \"network-check-target-4k7qx\" (UID: \"a33aa089-b8e1-4aea-8457-254010f62a22\") " pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:44.975546 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:44.975185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:35:44.977840 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:44.977822    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 10:35:44.977882 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:44.977823    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 10:35:44.978604 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:44.978591    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 10:35:44.988272 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:44.988241    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 10:35:44.988533 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:44.988516    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b41c220-4b51-4250-989b-fdc1c5a684c8-metrics-certs\") pod \"network-metrics-daemon-2dwvp\" (UID: \"2b41c220-4b51-4250-989b-fdc1c5a684c8\") " pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:35:44.988654 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:44.988636    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5562ade4-b9ad-402c-99ad-38724e6f5221-original-pull-secret\") pod \"global-pull-secret-syncer-7stdm\" (UID: \"5562ade4-b9ad-402c-99ad-38724e6f5221\") " pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:35:44.999627 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:44.999603    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-474lz\" (UniqueName: \"kubernetes.io/projected/a33aa089-b8e1-4aea-8457-254010f62a22-kube-api-access-474lz\") pod \"network-check-target-4k7qx\" (UID: \"a33aa089-b8e1-4aea-8457-254010f62a22\") " pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:45.010303 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:45.010286    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d9kv4\""
Sep 19 10:35:45.016045 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:45.016032    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8jxmp\""
Sep 19 10:35:45.018838 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:45.018824    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:45.020033 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:45.020008    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7stdm"
Sep 19 10:35:45.024924 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:45.024898    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dwvp"
Sep 19 10:35:45.293144 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:45.293076    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4k7qx"]
Sep 19 10:35:45.297361 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:45.296387    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7stdm"]
Sep 19 10:35:45.299527 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:45.299501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2dwvp"]
Sep 19 10:35:45.300863 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:35:45.300834    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5562ade4_b9ad_402c_99ad_38724e6f5221.slice/crio-0686575892b415addedefb16353f1effc0877a2193a91e95b46b001841a73e16 WatchSource:0}: Error finding container 0686575892b415addedefb16353f1effc0877a2193a91e95b46b001841a73e16: Status 404 returned error can't find the container with id 0686575892b415addedefb16353f1effc0877a2193a91e95b46b001841a73e16
Sep 19 10:35:45.302092 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:35:45.302071    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b41c220_4b51_4250_989b_fdc1c5a684c8.slice/crio-41faf14107ccd25baab60b5f01281e30f76d1fbb62a2e4ad44c171d1802f7045 WatchSource:0}: Error finding container 41faf14107ccd25baab60b5f01281e30f76d1fbb62a2e4ad44c171d1802f7045: Status 404 returned error can't find the container with id 41faf14107ccd25baab60b5f01281e30f76d1fbb62a2e4ad44c171d1802f7045
Sep 19 10:35:45.494199 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:45.494172    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2dwvp" event={"ID":"2b41c220-4b51-4250-989b-fdc1c5a684c8","Type":"ContainerStarted","Data":"41faf14107ccd25baab60b5f01281e30f76d1fbb62a2e4ad44c171d1802f7045"}
Sep 19 10:35:45.495377 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:45.495357    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7stdm" event={"ID":"5562ade4-b9ad-402c-99ad-38724e6f5221","Type":"ContainerStarted","Data":"0686575892b415addedefb16353f1effc0877a2193a91e95b46b001841a73e16"}
Sep 19 10:35:45.496472 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:45.496451    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4k7qx" event={"ID":"a33aa089-b8e1-4aea-8457-254010f62a22","Type":"ContainerStarted","Data":"afefaf219d92066f282b15c406acc4d113518aa210786eb51d61b9d05dc6f775"}
Sep 19 10:35:46.504476 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:46.504425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2dwvp" event={"ID":"2b41c220-4b51-4250-989b-fdc1c5a684c8","Type":"ContainerStarted","Data":"64fff3984805d5cc0c6296a3bfc4b5bfd71a08de532bbb84234248065c330c4d"}
Sep 19 10:35:47.342803 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:47.342766    2579 patch_prober.go:28] interesting pod/image-registry-86b5b64789-5c99s container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 19 10:35:47.342967 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:47.342828    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b5b64789-5c99s" podUID="ce1ff929-7052-4241-9489-3ac3a8ff1cf1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 10:35:47.510874 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:47.510780    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2dwvp" event={"ID":"2b41c220-4b51-4250-989b-fdc1c5a684c8","Type":"ContainerStarted","Data":"cabfe80d92ce696fc8c90ad7e21d7ae1036baa330fef7c734905d2e0a2af574d"}
Sep 19 10:35:50.523800 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.523761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7stdm" event={"ID":"5562ade4-b9ad-402c-99ad-38724e6f5221","Type":"ContainerStarted","Data":"bfd8c2a76483a79548263eb3807e3dd32fe510e8d8ffe23ba0a697faa763f843"}
Sep 19 10:35:50.525582 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.525555    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4k7qx" event={"ID":"a33aa089-b8e1-4aea-8457-254010f62a22","Type":"ContainerStarted","Data":"ec47ea2a9b03442ecefd7ca72d842265af901532d4aac451bd9991ec71c18992"}
Sep 19 10:35:50.525738 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.525699    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:35:50.570108 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.570064    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2dwvp" podStartSLOduration=70.580529223 podStartE2EDuration="1m11.570046899s" totalImagesPullingTime="989.517676ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:47.526351532 +0000 UTC m=+70.425541417" watchObservedRunningTime="2026-09-19 10:35:50.570046899 +0000 UTC m=+73.469236792"
Sep 19 10:35:50.570449 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.570420    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7stdm" podStartSLOduration=67.019139876 podStartE2EDuration="1m11.570412729s" totalImagesPullingTime="4.551272853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:50.569252111 +0000 UTC m=+73.468442015" watchObservedRunningTime="2026-09-19 10:35:50.570412729 +0000 UTC m=+73.469602619"
Sep 19 10:35:50.590785 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.590738    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4k7qx" podStartSLOduration=67.040585757 podStartE2EDuration="1m11.59071193s" totalImagesPullingTime="4.550126173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:50.590011143 +0000 UTC m=+73.489201034" watchObservedRunningTime="2026-09-19 10:35:50.59071193 +0000 UTC m=+73.489901821"
Sep 19 10:35:50.662823 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.662801    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vpk7s"]
Sep 19 10:35:50.664686 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.664665    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.666848 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.666828    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 19 10:35:50.667001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.666982    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 19 10:35:50.667181 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.667166    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zsbvs\""
Sep 19 10:35:50.667264 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.667193    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 19 10:35:50.667264 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.667247    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 19 10:35:50.667398 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.667384    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 19 10:35:50.667486 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.667468    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 19 10:35:50.716294 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.716272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98120cac-9503-4ae2-b8ee-57298e73c167-metrics-client-ca\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.716400 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.716300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98120cac-9503-4ae2-b8ee-57298e73c167-sys\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.716400 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.716317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lvkr\" (UniqueName: \"kubernetes.io/projected/98120cac-9503-4ae2-b8ee-57298e73c167-kube-api-access-9lvkr\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.716400 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.716335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.716400 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.716352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-tls\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.716605 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.716464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-accelerators-collector-config\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.716605 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.716501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98120cac-9503-4ae2-b8ee-57298e73c167-root\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.716605 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.716519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-textfile\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.716605 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.716544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-wtmp\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.817562 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.817539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-accelerators-collector-config\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.817690 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.817569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98120cac-9503-4ae2-b8ee-57298e73c167-root\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.817690 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.817586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-textfile\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.817690 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.817610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-wtmp\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.817690 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.817665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98120cac-9503-4ae2-b8ee-57298e73c167-metrics-client-ca\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.817690 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.817674    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98120cac-9503-4ae2-b8ee-57298e73c167-root\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.817954 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.817696    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98120cac-9503-4ae2-b8ee-57298e73c167-sys\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.817954 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.817735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lvkr\" (UniqueName: \"kubernetes.io/projected/98120cac-9503-4ae2-b8ee-57298e73c167-kube-api-access-9lvkr\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.817954 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.817762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.817954 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.817790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-tls\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.817954 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:50.817898    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 19 10:35:50.817954 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:50.817954    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-tls podName:98120cac-9503-4ae2-b8ee-57298e73c167 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:51.317935205 +0000 UTC m=+74.217125078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-tls") pod "node-exporter-vpk7s" (UID: "98120cac-9503-4ae2-b8ee-57298e73c167") : secret "node-exporter-tls" not found
Sep 19 10:35:50.818265 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.817967    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-textfile\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.818265 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.818088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-wtmp\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.818265 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.818156    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-accelerators-collector-config\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.818265 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.818219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98120cac-9503-4ae2-b8ee-57298e73c167-sys\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.818527 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.818508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98120cac-9503-4ae2-b8ee-57298e73c167-metrics-client-ca\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.820522 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.820495    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:50.828191 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:50.828167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lvkr\" (UniqueName: \"kubernetes.io/projected/98120cac-9503-4ae2-b8ee-57298e73c167-kube-api-access-9lvkr\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:51.321214 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.321178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-tls\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:51.323400 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.323371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98120cac-9503-4ae2-b8ee-57298e73c167-node-exporter-tls\") pod \"node-exporter-vpk7s\" (UID: \"98120cac-9503-4ae2-b8ee-57298e73c167\") " pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:51.575987 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.575921    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vpk7s"
Sep 19 10:35:51.585938 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:35:51.585909    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98120cac_9503_4ae2_b8ee_57298e73c167.slice/crio-14279619e2d7d38e152473f40211c20b9f5160d617eadcee90320b6dea2bcfee WatchSource:0}: Error finding container 14279619e2d7d38e152473f40211c20b9f5160d617eadcee90320b6dea2bcfee: Status 404 returned error can't find the container with id 14279619e2d7d38e152473f40211c20b9f5160d617eadcee90320b6dea2bcfee
Sep 19 10:35:51.655076 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.655052    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 10:35:51.657299 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.657284    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.659637 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.659618    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 19 10:35:51.659765 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.659661    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 19 10:35:51.659765 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.659618    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kqbtj\""
Sep 19 10:35:51.659952 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.659938    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 19 10:35:51.660014 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.660001    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 19 10:35:51.660260 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.660240    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 19 10:35:51.660349 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.660280    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 19 10:35:51.660421 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.660403    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 19 10:35:51.660627 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.660611    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 19 10:35:51.661843 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.661828    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 19 10:35:51.673442 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.673415    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 10:35:51.723422 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddaa8857-d392-44a2-8ae2-c304bf320023-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.723523 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723432    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.723523 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723451    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ddaa8857-d392-44a2-8ae2-c304bf320023-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.723523 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddaa8857-d392-44a2-8ae2-c304bf320023-config-out\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.723684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.723684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddaa8857-d392-44a2-8ae2-c304bf320023-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.723684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-web-config\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.723684 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723633    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvp2m\" (UniqueName: \"kubernetes.io/projected/ddaa8857-d392-44a2-8ae2-c304bf320023-kube-api-access-kvp2m\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.723916 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.723916 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.723916 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723773    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.723916 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-config-volume\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.723916 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.723844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddaa8857-d392-44a2-8ae2-c304bf320023-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824066 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-config-volume\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824166 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddaa8857-d392-44a2-8ae2-c304bf320023-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824166 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddaa8857-d392-44a2-8ae2-c304bf320023-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824166 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824166 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ddaa8857-d392-44a2-8ae2-c304bf320023-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824166 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddaa8857-d392-44a2-8ae2-c304bf320023-config-out\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824401 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824401 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824195    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddaa8857-d392-44a2-8ae2-c304bf320023-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824401 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-web-config\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824401 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvp2m\" (UniqueName: \"kubernetes.io/projected/ddaa8857-d392-44a2-8ae2-c304bf320023-kube-api-access-kvp2m\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824401 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824401 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824401 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824765 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:51.824533    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 19 10:35:51.824765 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.824546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ddaa8857-d392-44a2-8ae2-c304bf320023-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.824765 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:35:51.824602    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-main-tls podName:ddaa8857-d392-44a2-8ae2-c304bf320023 nodeName:}" failed. No retries permitted until 2026-09-19 10:35:52.324582192 +0000 UTC m=+75.223772066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023") : secret "alertmanager-main-tls" not found
Sep 19 10:35:51.826063 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.826006    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddaa8857-d392-44a2-8ae2-c304bf320023-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.826494 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.826473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddaa8857-d392-44a2-8ae2-c304bf320023-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.827146 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.827123    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddaa8857-d392-44a2-8ae2-c304bf320023-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.827773 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.827509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-config-volume\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.827773 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.827713    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.827773 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.827717    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.827916 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.827788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-web-config\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.827916 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.827887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.829061 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.829044    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddaa8857-d392-44a2-8ae2-c304bf320023-config-out\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.829621 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.829601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:51.834021 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:51.833999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvp2m\" (UniqueName: \"kubernetes.io/projected/ddaa8857-d392-44a2-8ae2-c304bf320023-kube-api-access-kvp2m\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:52.327290 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:52.327258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:52.329705 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:52.329681    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:52.535580 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:52.535554    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpk7s" event={"ID":"98120cac-9503-4ae2-b8ee-57298e73c167","Type":"ContainerStarted","Data":"964306ad6b1fa4852abfc1fcd964bb5c36b332cbc93aaf42ef7f8f089c84c82d"}
Sep 19 10:35:52.535692 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:52.535611    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpk7s" event={"ID":"98120cac-9503-4ae2-b8ee-57298e73c167","Type":"ContainerStarted","Data":"14279619e2d7d38e152473f40211c20b9f5160d617eadcee90320b6dea2bcfee"}
Sep 19 10:35:52.566315 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:52.566293    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:35:52.843817 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:52.843793    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 10:35:52.845810 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:35:52.845783    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddaa8857_d392_44a2_8ae2_c304bf320023.slice/crio-1903ae6e59be6f1d76a85606acf1c0f7fcf9d9ee0a9d9b4b879fe3785a378f1f WatchSource:0}: Error finding container 1903ae6e59be6f1d76a85606acf1c0f7fcf9d9ee0a9d9b4b879fe3785a378f1f: Status 404 returned error can't find the container with id 1903ae6e59be6f1d76a85606acf1c0f7fcf9d9ee0a9d9b4b879fe3785a378f1f
Sep 19 10:35:53.542003 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.541965    2579 generic.go:356] "Generic (PLEG): container finished" podID="98120cac-9503-4ae2-b8ee-57298e73c167" containerID="964306ad6b1fa4852abfc1fcd964bb5c36b332cbc93aaf42ef7f8f089c84c82d" exitCode=0
Sep 19 10:35:53.542198 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.542042    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpk7s" event={"ID":"98120cac-9503-4ae2-b8ee-57298e73c167","Type":"ContainerDied","Data":"964306ad6b1fa4852abfc1fcd964bb5c36b332cbc93aaf42ef7f8f089c84c82d"}
Sep 19 10:35:53.543752 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.543707    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerStarted","Data":"1903ae6e59be6f1d76a85606acf1c0f7fcf9d9ee0a9d9b4b879fe3785a378f1f"}
Sep 19 10:35:53.603204 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.603174    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"]
Sep 19 10:35:53.605974 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.605955    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.610234 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.610146    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-64q24\""
Sep 19 10:35:53.610516 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.610486    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 19 10:35:53.612815 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.612786    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b1oskq2g2jb7h\""
Sep 19 10:35:53.613234 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.613191    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 19 10:35:53.613468 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.613436    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 19 10:35:53.613643 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.613626    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 19 10:35:53.613904 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.613887    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 19 10:35:53.629328 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.629268    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"]
Sep 19 10:35:53.637755 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.637435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.637755 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.637471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/496d4ba2-7414-4cdb-932b-7a7f0e597203-metrics-client-ca\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.637755 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.637708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrjfs\" (UniqueName: \"kubernetes.io/projected/496d4ba2-7414-4cdb-932b-7a7f0e597203-kube-api-access-vrjfs\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.637941 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.637757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-tls\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.637941 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.637801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.637941 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.637884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.638090 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.637948    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-grpc-tls\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.638090 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.637981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.739197 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.739165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.739318 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.739204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-grpc-tls\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.739318 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.739223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.739318 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.739272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.739318 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.739297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/496d4ba2-7414-4cdb-932b-7a7f0e597203-metrics-client-ca\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.739520 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.739345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrjfs\" (UniqueName: \"kubernetes.io/projected/496d4ba2-7414-4cdb-932b-7a7f0e597203-kube-api-access-vrjfs\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.739520 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.739370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-tls\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.739520 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.739402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.740478 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.740122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/496d4ba2-7414-4cdb-932b-7a7f0e597203-metrics-client-ca\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.742383 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.742305    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-grpc-tls\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.742383 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.742336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.742712 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.742690    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.743281 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.743251    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-tls\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.744187 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.744161    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.744672 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.744649    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/496d4ba2-7414-4cdb-932b-7a7f0e597203-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.757388 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.757368    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrjfs\" (UniqueName: \"kubernetes.io/projected/496d4ba2-7414-4cdb-932b-7a7f0e597203-kube-api-access-vrjfs\") pod \"thanos-querier-7f8c99f754-dxvz5\" (UID: \"496d4ba2-7414-4cdb-932b-7a7f0e597203\") " pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:53.918702 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:53.918682    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:54.198588 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:54.198521    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"]
Sep 19 10:35:54.202012 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:35:54.201986    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496d4ba2_7414_4cdb_932b_7a7f0e597203.slice/crio-009b69bb30da5d3c03b56560b3ab259e6ebc96faeefa2f242b78031a6feb43b8 WatchSource:0}: Error finding container 009b69bb30da5d3c03b56560b3ab259e6ebc96faeefa2f242b78031a6feb43b8: Status 404 returned error can't find the container with id 009b69bb30da5d3c03b56560b3ab259e6ebc96faeefa2f242b78031a6feb43b8
Sep 19 10:35:54.550039 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:54.550005    2579 generic.go:356] "Generic (PLEG): container finished" podID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerID="c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85" exitCode=0
Sep 19 10:35:54.550162 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:54.550093    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerDied","Data":"c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85"}
Sep 19 10:35:54.551571 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:54.551539    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5" event={"ID":"496d4ba2-7414-4cdb-932b-7a7f0e597203","Type":"ContainerStarted","Data":"009b69bb30da5d3c03b56560b3ab259e6ebc96faeefa2f242b78031a6feb43b8"}
Sep 19 10:35:54.554212 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:54.554187    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpk7s" event={"ID":"98120cac-9503-4ae2-b8ee-57298e73c167","Type":"ContainerStarted","Data":"d68660911a3c57438e05602d9581cd9d66ecd3597566a2f13632084303f48510"}
Sep 19 10:35:54.554338 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:54.554237    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpk7s" event={"ID":"98120cac-9503-4ae2-b8ee-57298e73c167","Type":"ContainerStarted","Data":"2bd6b544d4d6f88af0e74e87fa539c6984df812270f18c8ff8eea20b38f13ea8"}
Sep 19 10:35:54.594622 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:54.594570    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vpk7s" podStartSLOduration=3.705983539 podStartE2EDuration="4.594551529s" totalImagesPullingTime="826.204247ms" totalInitContainerRuntime="62.363743ms" isStatefulPod=true podCreationTimestamp="2026-09-19 10:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:54.593482622 +0000 UTC m=+77.492672514" watchObservedRunningTime="2026-09-19 10:35:54.594551529 +0000 UTC m=+77.493741423"
Sep 19 10:35:56.564229 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:56.564192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerStarted","Data":"3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac"}
Sep 19 10:35:56.564544 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:56.564266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerStarted","Data":"272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e"}
Sep 19 10:35:56.564544 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:56.564295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerStarted","Data":"8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef"}
Sep 19 10:35:56.564544 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:56.564333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerStarted","Data":"c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43"}
Sep 19 10:35:56.564544 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:56.564358    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerStarted","Data":"9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748"}
Sep 19 10:35:56.566394 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:56.566361    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5" event={"ID":"496d4ba2-7414-4cdb-932b-7a7f0e597203","Type":"ContainerStarted","Data":"94746a7a945031f814d8f39d5dbb752d597c21acaae76328d7c9e685ddd7b943"}
Sep 19 10:35:56.566497 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:56.566440    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5" event={"ID":"496d4ba2-7414-4cdb-932b-7a7f0e597203","Type":"ContainerStarted","Data":"1d872fbc4a87749e20534c637037f27e4fcb0438b38a3dd18bd3aace3bf5ad3e"}
Sep 19 10:35:56.566497 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:56.566484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5" event={"ID":"496d4ba2-7414-4cdb-932b-7a7f0e597203","Type":"ContainerStarted","Data":"8dca1e92e12a793453738ec1f1495dc83a600fba6ed18dfa3fedbdcf27475ba6"}
Sep 19 10:35:57.339857 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:57.339832    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:35:57.574044 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:57.573994    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5" event={"ID":"496d4ba2-7414-4cdb-932b-7a7f0e597203","Type":"ContainerStarted","Data":"6aadf654f4edd07cfb80755050113068792918a294293225912fb4c9584ea824"}
Sep 19 10:35:57.574482 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:57.574084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5" event={"ID":"496d4ba2-7414-4cdb-932b-7a7f0e597203","Type":"ContainerStarted","Data":"5b1c356727bc45d6dd152a3341b79e33620d00b2eafd355bb3ae4dac2f07afed"}
Sep 19 10:35:57.574482 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:57.574131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:35:57.574482 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:57.574170    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5" event={"ID":"496d4ba2-7414-4cdb-932b-7a7f0e597203","Type":"ContainerStarted","Data":"68728101f209feb4c628efbfbfb7e62ede0cb68363392a1900129d779e9e617b"}
Sep 19 10:35:57.577571 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:57.577548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerStarted","Data":"05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011"}
Sep 19 10:35:57.599210 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:57.599099    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5" podStartSLOduration=1.937893128 podStartE2EDuration="4.599084027s" totalImagesPullingTime="2.661190899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:35:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:57.59829258 +0000 UTC m=+80.497482475" watchObservedRunningTime="2026-09-19 10:35:57.599084027 +0000 UTC m=+80.498273919"
Sep 19 10:35:57.625625 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:35:57.625582    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.384026362 podStartE2EDuration="6.625567204s" totalImagesPullingTime="3.224649177s" totalInitContainerRuntime="16.891665ms" isStatefulPod=false podCreationTimestamp="2026-09-19 10:35:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:35:57.623962697 +0000 UTC m=+80.523152588" watchObservedRunningTime="2026-09-19 10:35:57.625567204 +0000 UTC m=+80.524757132"
Sep 19 10:36:02.354152 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.354094    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86b5b64789-5c99s" podUID="ce1ff929-7052-4241-9489-3ac3a8ff1cf1" containerName="registry" containerID="cri-o://4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659" gracePeriod=30
Sep 19 10:36:02.588828 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.588806    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:36:02.599094 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.599069    2579 generic.go:356] "Generic (PLEG): container finished" podID="ce1ff929-7052-4241-9489-3ac3a8ff1cf1" containerID="4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659" exitCode=0
Sep 19 10:36:02.599194 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.599107    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b5b64789-5c99s"
Sep 19 10:36:02.599194 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.599145    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b5b64789-5c99s" event={"ID":"ce1ff929-7052-4241-9489-3ac3a8ff1cf1","Type":"ContainerDied","Data":"4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659"}
Sep 19 10:36:02.599194 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.599191    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b5b64789-5c99s" event={"ID":"ce1ff929-7052-4241-9489-3ac3a8ff1cf1","Type":"ContainerDied","Data":"d77be1969853a99e074cca84bb1eecc097397a0f7a557c23015dc2d7942d3ff6"}
Sep 19 10:36:02.599302 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.599225    2579 scope.go:117] "RemoveContainer" containerID="4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659"
Sep 19 10:36:02.606584 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.606558    2579 scope.go:117] "RemoveContainer" containerID="4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659"
Sep 19 10:36:02.606909 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:36:02.606890    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659\": container with ID starting with 4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659 not found: ID does not exist" containerID="4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659"
Sep 19 10:36:02.607004 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.606917    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659"} err="failed to get container status \"4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659\": rpc error: code = NotFound desc = could not find container \"4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659\": container with ID starting with 4fdf84b48e2d29f3f7ffbdd3996201b7958c0b30fe38ba4a0e5044106b834659 not found: ID does not exist"
Sep 19 10:36:02.707307 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.707287    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8cc4\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-kube-api-access-w8cc4\") pod \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") "
Sep 19 10:36:02.707407 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.707319    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-image-registry-private-configuration\") pod \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") "
Sep 19 10:36:02.707407 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.707341    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-certificates\") pod \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") "
Sep 19 10:36:02.707407 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.707377    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-installation-pull-secrets\") pod \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") "
Sep 19 10:36:02.707407 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.707405    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls\") pod \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") "
Sep 19 10:36:02.707578 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.707437    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-trusted-ca\") pod \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") "
Sep 19 10:36:02.707578 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.707465    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-bound-sa-token\") pod \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") "
Sep 19 10:36:02.707578 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.707494    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-ca-trust-extracted\") pod \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\" (UID: \"ce1ff929-7052-4241-9489-3ac3a8ff1cf1\") "
Sep 19 10:36:02.707975 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.707916    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ce1ff929-7052-4241-9489-3ac3a8ff1cf1" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:36:02.708130 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.708078    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ce1ff929-7052-4241-9489-3ac3a8ff1cf1" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:36:02.709691 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.709667    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ce1ff929-7052-4241-9489-3ac3a8ff1cf1" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:36:02.710072 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.710046    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ce1ff929-7052-4241-9489-3ac3a8ff1cf1" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:36:02.710154 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.710073    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ce1ff929-7052-4241-9489-3ac3a8ff1cf1" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:36:02.710154 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.710117    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-kube-api-access-w8cc4" (OuterVolumeSpecName: "kube-api-access-w8cc4") pod "ce1ff929-7052-4241-9489-3ac3a8ff1cf1" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1"). InnerVolumeSpecName "kube-api-access-w8cc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:36:02.710228 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.710168    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ce1ff929-7052-4241-9489-3ac3a8ff1cf1" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:36:02.718538 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.718513    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ce1ff929-7052-4241-9489-3ac3a8ff1cf1" (UID: "ce1ff929-7052-4241-9489-3ac3a8ff1cf1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:36:02.808080 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.808053    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8cc4\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-kube-api-access-w8cc4\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:36:02.808080 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.808077    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-image-registry-private-configuration\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:36:02.808209 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.808093    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-certificates\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:36:02.808209 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.808105    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-installation-pull-secrets\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:36:02.808209 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.808119    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:36:02.808209 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.808132    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-trusted-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:36:02.808209 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.808144    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-bound-sa-token\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:36:02.808209 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.808156    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1ff929-7052-4241-9489-3ac3a8ff1cf1-ca-trust-extracted\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:36:02.919870 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.919843    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86b5b64789-5c99s"]
Sep 19 10:36:02.923573 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:02.923552    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86b5b64789-5c99s"]
Sep 19 10:36:03.203955 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:03.201901    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce1ff929-7052-4241-9489-3ac3a8ff1cf1" path="/var/lib/kubelet/pods/ce1ff929-7052-4241-9489-3ac3a8ff1cf1/volumes"
Sep 19 10:36:03.590256 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:03.590235    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f8c99f754-dxvz5"
Sep 19 10:36:16.773959 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.773923    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55f86c8d8f-tzkgf"]
Sep 19 10:36:16.774331 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.774190    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1ff929-7052-4241-9489-3ac3a8ff1cf1" containerName="registry"
Sep 19 10:36:16.774331 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.774202    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1ff929-7052-4241-9489-3ac3a8ff1cf1" containerName="registry"
Sep 19 10:36:16.774331 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.774251    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1ff929-7052-4241-9489-3ac3a8ff1cf1" containerName="registry"
Sep 19 10:36:16.807740 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.807692    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f86c8d8f-tzkgf"]
Sep 19 10:36:16.807900 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.807830    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:16.810405 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.810379    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 19 10:36:16.811460 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.811428    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 19 10:36:16.811573 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.811466    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 19 10:36:16.811573 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.811440    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z4n2v\""
Sep 19 10:36:16.811573 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.811465    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 19 10:36:16.811573 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.811473    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 19 10:36:16.811573 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.811501    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 19 10:36:16.811960 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.811942    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 19 10:36:16.903813 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.903791    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-serving-cert\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:16.903903 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.903819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwbmc\" (UniqueName: \"kubernetes.io/projected/ef7943ea-7c5f-49e1-9935-6d26d149bd40-kube-api-access-mwbmc\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:16.903903 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.903841    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-oauth-serving-cert\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:16.903903 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.903887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-service-ca\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:16.904014 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.903935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-config\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:16.904014 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:16.903963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-oauth-config\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.005041 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.005018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-serving-cert\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.005126 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.005049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwbmc\" (UniqueName: \"kubernetes.io/projected/ef7943ea-7c5f-49e1-9935-6d26d149bd40-kube-api-access-mwbmc\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.005126 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.005069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-oauth-serving-cert\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.005278 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.005256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-service-ca\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.005338 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.005324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-config\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.005375 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.005360    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-oauth-config\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.005821 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.005796    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-oauth-serving-cert\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.006003 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.005981    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-service-ca\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.006003 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.005993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-config\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.007788 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.007768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-oauth-config\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.007877 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.007859    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-serving-cert\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.013296 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.013272    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwbmc\" (UniqueName: \"kubernetes.io/projected/ef7943ea-7c5f-49e1-9935-6d26d149bd40-kube-api-access-mwbmc\") pod \"console-55f86c8d8f-tzkgf\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") " pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.116636 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.116613    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:17.393908 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.393882    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f86c8d8f-tzkgf"]
Sep 19 10:36:17.395915 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:36:17.395890    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7943ea_7c5f_49e1_9935_6d26d149bd40.slice/crio-95aa39f740a05f20a6b79d693bf1535522b7e2e1d9e4073bf8a55af5a07cc3df WatchSource:0}: Error finding container 95aa39f740a05f20a6b79d693bf1535522b7e2e1d9e4073bf8a55af5a07cc3df: Status 404 returned error can't find the container with id 95aa39f740a05f20a6b79d693bf1535522b7e2e1d9e4073bf8a55af5a07cc3df
Sep 19 10:36:17.655797 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:17.655736    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f86c8d8f-tzkgf" event={"ID":"ef7943ea-7c5f-49e1-9935-6d26d149bd40","Type":"ContainerStarted","Data":"95aa39f740a05f20a6b79d693bf1535522b7e2e1d9e4073bf8a55af5a07cc3df"}
Sep 19 10:36:21.532249 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:21.532219    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4k7qx"
Sep 19 10:36:21.673984 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:21.673955    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f86c8d8f-tzkgf" event={"ID":"ef7943ea-7c5f-49e1-9935-6d26d149bd40","Type":"ContainerStarted","Data":"9bbd0e51f84232cc995287537339f5b83e4b138e80ac31c02e320b9a66f46eaf"}
Sep 19 10:36:21.693243 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:21.693194    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55f86c8d8f-tzkgf" podStartSLOduration=1.794776908 podStartE2EDuration="5.693180158s" totalImagesPullingTime="3.89840325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:36:21.69260479 +0000 UTC m=+104.591794683" watchObservedRunningTime="2026-09-19 10:36:21.693180158 +0000 UTC m=+104.592370050"
Sep 19 10:36:27.117298 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:27.117250    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:27.117835 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:27.117324    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:27.122385 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:27.122361    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:27.699974 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:27.699943    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:36:35.682709 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:36:35.682662    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f86c8d8f-tzkgf"]
Sep 19 10:37:00.702329 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:00.702281    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55f86c8d8f-tzkgf" podUID="ef7943ea-7c5f-49e1-9935-6d26d149bd40" containerName="console" containerID="cri-o://9bbd0e51f84232cc995287537339f5b83e4b138e80ac31c02e320b9a66f46eaf" gracePeriod=15
Sep 19 10:37:00.821146 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:00.821116    2579 generic.go:356] "Generic (PLEG): container finished" podID="ef7943ea-7c5f-49e1-9935-6d26d149bd40" containerID="9bbd0e51f84232cc995287537339f5b83e4b138e80ac31c02e320b9a66f46eaf" exitCode=0
Sep 19 10:37:00.821249 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:00.821186    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f86c8d8f-tzkgf" event={"ID":"ef7943ea-7c5f-49e1-9935-6d26d149bd40","Type":"ContainerDied","Data":"9bbd0e51f84232cc995287537339f5b83e4b138e80ac31c02e320b9a66f46eaf"}
Sep 19 10:37:00.938908 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:00.938886    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:37:01.015244 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.015188    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwbmc\" (UniqueName: \"kubernetes.io/projected/ef7943ea-7c5f-49e1-9935-6d26d149bd40-kube-api-access-mwbmc\") pod \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") "
Sep 19 10:37:01.015334 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.015243    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-config\") pod \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") "
Sep 19 10:37:01.015334 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.015262    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-oauth-config\") pod \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") "
Sep 19 10:37:01.015401 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.015362    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-oauth-serving-cert\") pod \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") "
Sep 19 10:37:01.015435 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.015398    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-serving-cert\") pod \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") "
Sep 19 10:37:01.015435 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.015424    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-service-ca\") pod \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\" (UID: \"ef7943ea-7c5f-49e1-9935-6d26d149bd40\") "
Sep 19 10:37:01.015690 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.015651    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-config" (OuterVolumeSpecName: "console-config") pod "ef7943ea-7c5f-49e1-9935-6d26d149bd40" (UID: "ef7943ea-7c5f-49e1-9935-6d26d149bd40"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:37:01.015833 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.015698    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ef7943ea-7c5f-49e1-9935-6d26d149bd40" (UID: "ef7943ea-7c5f-49e1-9935-6d26d149bd40"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:37:01.015923 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.015895    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-service-ca" (OuterVolumeSpecName: "service-ca") pod "ef7943ea-7c5f-49e1-9935-6d26d149bd40" (UID: "ef7943ea-7c5f-49e1-9935-6d26d149bd40"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:37:01.017466 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.017443    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7943ea-7c5f-49e1-9935-6d26d149bd40-kube-api-access-mwbmc" (OuterVolumeSpecName: "kube-api-access-mwbmc") pod "ef7943ea-7c5f-49e1-9935-6d26d149bd40" (UID: "ef7943ea-7c5f-49e1-9935-6d26d149bd40"). InnerVolumeSpecName "kube-api-access-mwbmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:37:01.017551 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.017462    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ef7943ea-7c5f-49e1-9935-6d26d149bd40" (UID: "ef7943ea-7c5f-49e1-9935-6d26d149bd40"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:37:01.017551 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.017503    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ef7943ea-7c5f-49e1-9935-6d26d149bd40" (UID: "ef7943ea-7c5f-49e1-9935-6d26d149bd40"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:37:01.115877 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.115855    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-config\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:01.115877 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.115874    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-oauth-config\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:01.115989 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.115884    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-oauth-serving-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:01.115989 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.115893    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7943ea-7c5f-49e1-9935-6d26d149bd40-console-serving-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:01.115989 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.115901    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7943ea-7c5f-49e1-9935-6d26d149bd40-service-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:01.115989 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.115909    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwbmc\" (UniqueName: \"kubernetes.io/projected/ef7943ea-7c5f-49e1-9935-6d26d149bd40-kube-api-access-mwbmc\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:01.826851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.826815    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f86c8d8f-tzkgf"
Sep 19 10:37:01.827274 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.826817    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f86c8d8f-tzkgf" event={"ID":"ef7943ea-7c5f-49e1-9935-6d26d149bd40","Type":"ContainerDied","Data":"95aa39f740a05f20a6b79d693bf1535522b7e2e1d9e4073bf8a55af5a07cc3df"}
Sep 19 10:37:01.827274 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.826952    2579 scope.go:117] "RemoveContainer" containerID="9bbd0e51f84232cc995287537339f5b83e4b138e80ac31c02e320b9a66f46eaf"
Sep 19 10:37:01.846269 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.846239    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f86c8d8f-tzkgf"]
Sep 19 10:37:01.849996 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:01.849970    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55f86c8d8f-tzkgf"]
Sep 19 10:37:03.200294 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:03.200242    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef7943ea-7c5f-49e1-9935-6d26d149bd40" path="/var/lib/kubelet/pods/ef7943ea-7c5f-49e1-9935-6d26d149bd40/volumes"
Sep 19 10:37:10.924755 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:10.924689    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 10:37:10.925190 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:10.925073    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="alertmanager" containerID="cri-o://9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748" gracePeriod=120
Sep 19 10:37:10.925190 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:10.925130    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="kube-rbac-proxy-metric" containerID="cri-o://3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac" gracePeriod=120
Sep 19 10:37:10.925315 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:10.925208    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="prom-label-proxy" containerID="cri-o://05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011" gracePeriod=120
Sep 19 10:37:10.925315 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:10.925235    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="kube-rbac-proxy-web" containerID="cri-o://8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef" gracePeriod=120
Sep 19 10:37:10.925315 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:10.925271    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="config-reloader" containerID="cri-o://c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43" gracePeriod=120
Sep 19 10:37:10.925519 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:10.925237    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="kube-rbac-proxy" containerID="cri-o://272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e" gracePeriod=120
Sep 19 10:37:11.868392 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:11.868357    2579 generic.go:356] "Generic (PLEG): container finished" podID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerID="05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011" exitCode=0
Sep 19 10:37:11.868392 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:11.868384    2579 generic.go:356] "Generic (PLEG): container finished" podID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerID="272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e" exitCode=0
Sep 19 10:37:11.868392 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:11.868391    2579 generic.go:356] "Generic (PLEG): container finished" podID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerID="c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43" exitCode=0
Sep 19 10:37:11.868392 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:11.868399    2579 generic.go:356] "Generic (PLEG): container finished" podID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerID="9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748" exitCode=0
Sep 19 10:37:11.868642 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:11.868434    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerDied","Data":"05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011"}
Sep 19 10:37:11.868642 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:11.868508    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerDied","Data":"272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e"}
Sep 19 10:37:11.868642 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:11.868538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerDied","Data":"c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43"}
Sep 19 10:37:11.868642 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:11.868566    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerDied","Data":"9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748"}
Sep 19 10:37:12.161673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.161651    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:12.193976 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.193953    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ddaa8857-d392-44a2-8ae2-c304bf320023-alertmanager-main-db\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.194100 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.193986    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-config-volume\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.194100 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194015    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-web-config\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.194100 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194034    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddaa8857-d392-44a2-8ae2-c304bf320023-config-out\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.194100 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddaa8857-d392-44a2-8ae2-c304bf320023-metrics-client-ca\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.194100 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194088    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvp2m\" (UniqueName: \"kubernetes.io/projected/ddaa8857-d392-44a2-8ae2-c304bf320023-kube-api-access-kvp2m\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.194350 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194128    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-main-tls\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.194350 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194162    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddaa8857-d392-44a2-8ae2-c304bf320023-alertmanager-trusted-ca-bundle\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.194350 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194187    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-cluster-tls-config\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.194350 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194222    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.194350 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194289    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddaa8857-d392-44a2-8ae2-c304bf320023-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:37:12.194803 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194765    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddaa8857-d392-44a2-8ae2-c304bf320023-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:37:12.194960 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194921    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy-web\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.195036 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194968    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.195036 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.194994    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddaa8857-d392-44a2-8ae2-c304bf320023-tls-assets\") pod \"ddaa8857-d392-44a2-8ae2-c304bf320023\" (UID: \"ddaa8857-d392-44a2-8ae2-c304bf320023\") "
Sep 19 10:37:12.195157 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.195074    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddaa8857-d392-44a2-8ae2-c304bf320023-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:37:12.195540 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.195228    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ddaa8857-d392-44a2-8ae2-c304bf320023-alertmanager-main-db\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.195540 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.195252    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddaa8857-d392-44a2-8ae2-c304bf320023-metrics-client-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.195540 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.195268    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddaa8857-d392-44a2-8ae2-c304bf320023-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.197258 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.197206    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:37:12.198570 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.198520    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddaa8857-d392-44a2-8ae2-c304bf320023-config-out" (OuterVolumeSpecName: "config-out") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:37:12.200087 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.200061    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddaa8857-d392-44a2-8ae2-c304bf320023-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:37:12.200506 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.200481    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddaa8857-d392-44a2-8ae2-c304bf320023-kube-api-access-kvp2m" (OuterVolumeSpecName: "kube-api-access-kvp2m") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "kube-api-access-kvp2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:37:12.200626 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.200520    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:37:12.201144 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.201112    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:37:12.201271 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.201251    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-config-volume" (OuterVolumeSpecName: "config-volume") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:37:12.201740 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.201673    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:37:12.204281 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.204239    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:37:12.209716 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.209694    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-web-config" (OuterVolumeSpecName: "web-config") pod "ddaa8857-d392-44a2-8ae2-c304bf320023" (UID: "ddaa8857-d392-44a2-8ae2-c304bf320023"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:37:12.295946 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.295924    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.295946 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.295943    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddaa8857-d392-44a2-8ae2-c304bf320023-tls-assets\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.296067 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.295953    2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.296067 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.295961    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-web-config\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.296067 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.295969    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddaa8857-d392-44a2-8ae2-c304bf320023-config-out\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.296067 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.295976    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvp2m\" (UniqueName: \"kubernetes.io/projected/ddaa8857-d392-44a2-8ae2-c304bf320023-kube-api-access-kvp2m\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.296067 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.295984    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-main-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.296067 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.295992    2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-cluster-tls-config\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.296067 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.296001    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.296067 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.296010    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddaa8857-d392-44a2-8ae2-c304bf320023-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:37:12.875329 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.875298    2579 generic.go:356] "Generic (PLEG): container finished" podID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerID="3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac" exitCode=0
Sep 19 10:37:12.875329 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.875324    2579 generic.go:356] "Generic (PLEG): container finished" podID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerID="8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef" exitCode=0
Sep 19 10:37:12.875497 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.875378    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:12.875497 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.875391    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerDied","Data":"3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac"}
Sep 19 10:37:12.875497 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.875467    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerDied","Data":"8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef"}
Sep 19 10:37:12.875585 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.875501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddaa8857-d392-44a2-8ae2-c304bf320023","Type":"ContainerDied","Data":"1903ae6e59be6f1d76a85606acf1c0f7fcf9d9ee0a9d9b4b879fe3785a378f1f"}
Sep 19 10:37:12.875585 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.875546    2579 scope.go:117] "RemoveContainer" containerID="05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011"
Sep 19 10:37:12.889489 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.889449    2579 scope.go:117] "RemoveContainer" containerID="3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac"
Sep 19 10:37:12.897369 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.897350    2579 scope.go:117] "RemoveContainer" containerID="272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e"
Sep 19 10:37:12.904604 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.904578    2579 scope.go:117] "RemoveContainer" containerID="8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef"
Sep 19 10:37:12.904841 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.904820    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 10:37:12.908792 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.908771    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 10:37:12.911443 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.911426    2579 scope.go:117] "RemoveContainer" containerID="c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43"
Sep 19 10:37:12.917808 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.917740    2579 scope.go:117] "RemoveContainer" containerID="9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748"
Sep 19 10:37:12.924339 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.924324    2579 scope.go:117] "RemoveContainer" containerID="c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85"
Sep 19 10:37:12.930675 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.930657    2579 scope.go:117] "RemoveContainer" containerID="05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011"
Sep 19 10:37:12.930936 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:37:12.930919    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011\": container with ID starting with 05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011 not found: ID does not exist" containerID="05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011"
Sep 19 10:37:12.930989 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.930940    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011"} err="failed to get container status \"05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011\": rpc error: code = NotFound desc = could not find container \"05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011\": container with ID starting with 05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011 not found: ID does not exist"
Sep 19 10:37:12.930989 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.930958    2579 scope.go:117] "RemoveContainer" containerID="3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac"
Sep 19 10:37:12.931208 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:37:12.931190    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac\": container with ID starting with 3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac not found: ID does not exist" containerID="3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac"
Sep 19 10:37:12.931248 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.931216    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac"} err="failed to get container status \"3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac\": rpc error: code = NotFound desc = could not find container \"3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac\": container with ID starting with 3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac not found: ID does not exist"
Sep 19 10:37:12.931248 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.931234    2579 scope.go:117] "RemoveContainer" containerID="272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e"
Sep 19 10:37:12.931451 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:37:12.931435    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e\": container with ID starting with 272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e not found: ID does not exist" containerID="272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e"
Sep 19 10:37:12.931490 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.931455    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e"} err="failed to get container status \"272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e\": rpc error: code = NotFound desc = could not find container \"272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e\": container with ID starting with 272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e not found: ID does not exist"
Sep 19 10:37:12.931490 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.931468    2579 scope.go:117] "RemoveContainer" containerID="8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef"
Sep 19 10:37:12.931682 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:37:12.931666    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef\": container with ID starting with 8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef not found: ID does not exist" containerID="8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef"
Sep 19 10:37:12.931737 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.931685    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef"} err="failed to get container status \"8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef\": rpc error: code = NotFound desc = could not find container \"8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef\": container with ID starting with 8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef not found: ID does not exist"
Sep 19 10:37:12.931737 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.931697    2579 scope.go:117] "RemoveContainer" containerID="c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43"
Sep 19 10:37:12.931918 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:37:12.931905    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43\": container with ID starting with c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43 not found: ID does not exist" containerID="c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43"
Sep 19 10:37:12.931957 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.931920    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43"} err="failed to get container status \"c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43\": rpc error: code = NotFound desc = could not find container \"c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43\": container with ID starting with c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43 not found: ID does not exist"
Sep 19 10:37:12.931957 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.931932    2579 scope.go:117] "RemoveContainer" containerID="9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748"
Sep 19 10:37:12.932126 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:37:12.932110    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748\": container with ID starting with 9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748 not found: ID does not exist" containerID="9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748"
Sep 19 10:37:12.932162 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.932130    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748"} err="failed to get container status \"9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748\": rpc error: code = NotFound desc = could not find container \"9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748\": container with ID starting with 9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748 not found: ID does not exist"
Sep 19 10:37:12.932162 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.932145    2579 scope.go:117] "RemoveContainer" containerID="c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85"
Sep 19 10:37:12.932343 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:37:12.932327    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85\": container with ID starting with c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85 not found: ID does not exist" containerID="c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85"
Sep 19 10:37:12.932382 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.932347    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85"} err="failed to get container status \"c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85\": rpc error: code = NotFound desc = could not find container \"c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85\": container with ID starting with c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85 not found: ID does not exist"
Sep 19 10:37:12.932382 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.932358    2579 scope.go:117] "RemoveContainer" containerID="05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011"
Sep 19 10:37:12.932540 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.932525    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011"} err="failed to get container status \"05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011\": rpc error: code = NotFound desc = could not find container \"05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011\": container with ID starting with 05df38b8de46a70c06928297c20fd91b7368a8157744cc9644042f4dff42c011 not found: ID does not exist"
Sep 19 10:37:12.932581 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.932540    2579 scope.go:117] "RemoveContainer" containerID="3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac"
Sep 19 10:37:12.932746 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.932712    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac"} err="failed to get container status \"3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac\": rpc error: code = NotFound desc = could not find container \"3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac\": container with ID starting with 3006f7302da7b220cbe8311413e4396ba9d9c32c1b4fb6c12c1e91007e37afac not found: ID does not exist"
Sep 19 10:37:12.932794 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.932747    2579 scope.go:117] "RemoveContainer" containerID="272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e"
Sep 19 10:37:12.932951 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.932936    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e"} err="failed to get container status \"272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e\": rpc error: code = NotFound desc = could not find container \"272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e\": container with ID starting with 272af805dbabb63c1724e0c93fdfe3b4d8d5b2bf01a3b045864eb1ff0bed1a5e not found: ID does not exist"
Sep 19 10:37:12.932992 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.932951    2579 scope.go:117] "RemoveContainer" containerID="8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef"
Sep 19 10:37:12.933142 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.933125    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef"} err="failed to get container status \"8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef\": rpc error: code = NotFound desc = could not find container \"8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef\": container with ID starting with 8b997d4b26d0be99aacb77954c08323f4b60053b47236f642ef1d0442b1a54ef not found: ID does not exist"
Sep 19 10:37:12.933183 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.933143    2579 scope.go:117] "RemoveContainer" containerID="c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43"
Sep 19 10:37:12.933343 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.933317    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43"} err="failed to get container status \"c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43\": rpc error: code = NotFound desc = could not find container \"c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43\": container with ID starting with c7a9ab52d825fe7bc2a35f6aaf29d34c8c69c86b3928e0d380097bae410f7d43 not found: ID does not exist"
Sep 19 10:37:12.933343 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.933342    2579 scope.go:117] "RemoveContainer" containerID="9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748"
Sep 19 10:37:12.933589 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.933571    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748"} err="failed to get container status \"9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748\": rpc error: code = NotFound desc = could not find container \"9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748\": container with ID starting with 9839ffda3e55a320265ff7a5b7205a161dfd03762a45192474d75d3906fba748 not found: ID does not exist"
Sep 19 10:37:12.933661 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.933591    2579 scope.go:117] "RemoveContainer" containerID="c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85"
Sep 19 10:37:12.933804 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.933785    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85"} err="failed to get container status \"c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85\": rpc error: code = NotFound desc = could not find container \"c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85\": container with ID starting with c03388d824c90e8fcd438bb8aba4930407e64756bf1fe0c1629b237fa0485f85 not found: ID does not exist"
Sep 19 10:37:12.938809 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.938790    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 10:37:12.939034 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939023    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="kube-rbac-proxy-metric"
Sep 19 10:37:12.939073 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939036    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="kube-rbac-proxy-metric"
Sep 19 10:37:12.939073 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939046    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="kube-rbac-proxy"
Sep 19 10:37:12.939073 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939052    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="kube-rbac-proxy"
Sep 19 10:37:12.939073 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939061    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="prom-label-proxy"
Sep 19 10:37:12.939073 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939067    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="prom-label-proxy"
Sep 19 10:37:12.939073 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939075    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="kube-rbac-proxy-web"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939080    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="kube-rbac-proxy-web"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939089    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="init-config-reloader"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939094    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="init-config-reloader"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939101    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="config-reloader"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939106    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="config-reloader"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939114    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="alertmanager"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939119    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="alertmanager"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939126    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7943ea-7c5f-49e1-9935-6d26d149bd40" containerName="console"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939132    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7943ea-7c5f-49e1-9935-6d26d149bd40" containerName="console"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939170    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7943ea-7c5f-49e1-9935-6d26d149bd40" containerName="console"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939177    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="config-reloader"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939182    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="kube-rbac-proxy-web"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939188    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="prom-label-proxy"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939193    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="kube-rbac-proxy-metric"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939198    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="kube-rbac-proxy"
Sep 19 10:37:12.939242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.939204    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" containerName="alertmanager"
Sep 19 10:37:12.943250 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.943235    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:12.945496 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.945465    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 19 10:37:12.945644 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.945544    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 19 10:37:12.945644 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.945570    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 19 10:37:12.945644 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.945575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 19 10:37:12.945644 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.945591    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 19 10:37:12.945985 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.945892    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 19 10:37:12.945985 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.945920    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kqbtj\""
Sep 19 10:37:12.946112 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.945999    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 19 10:37:12.946112 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.946030    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 19 10:37:12.950868 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.950852    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 19 10:37:12.959838 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:12.959807    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 10:37:13.000255 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.000341 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-config-out\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.000341 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000282    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.000341 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n9gk\" (UniqueName: \"kubernetes.io/projected/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-kube-api-access-4n9gk\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.000494 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.000494 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-web-config\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.000494 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.000494 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.000494 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000474    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.000671 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000499    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.000671 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000554    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.000671 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000573    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.000671 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.000596    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.101084 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.101059    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-web-config\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.101084 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.101084    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.101224 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.101104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.101224 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.101144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.101224 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.101165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.101224 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.101186    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.101224 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.101215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.101466 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.101351    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.101466 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.101410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.101595 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.101573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.102673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.102039    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.102673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.102097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-config-out\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.102673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.102140    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.102673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.102159    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.102673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.102169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n9gk\" (UniqueName: \"kubernetes.io/projected/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-kube-api-access-4n9gk\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.102673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.102227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.104341 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.104293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.104341 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.104334    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.104535 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.104418    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-web-config\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.104606 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.104583    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.104640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.104620    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.104939 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.104918    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.105366 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.105349    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.105917 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.105889    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.106019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.105951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-config-out\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.110029 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.110008    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n9gk\" (UniqueName: \"kubernetes.io/projected/9f3eba0f-65d4-42d3-82bb-a56fb515fd75-kube-api-access-4n9gk\") pod \"alertmanager-main-0\" (UID: \"9f3eba0f-65d4-42d3-82bb-a56fb515fd75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.200701 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.200648    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddaa8857-d392-44a2-8ae2-c304bf320023" path="/var/lib/kubelet/pods/ddaa8857-d392-44a2-8ae2-c304bf320023/volumes"
Sep 19 10:37:13.252708 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.252688    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 10:37:13.533576 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.533556    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 10:37:13.535060 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:37:13.535037    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3eba0f_65d4_42d3_82bb_a56fb515fd75.slice/crio-f5135507cea0ad7b80b8a909843366be564794430df173e5c29dd89eb8c941f9 WatchSource:0}: Error finding container f5135507cea0ad7b80b8a909843366be564794430df173e5c29dd89eb8c941f9: Status 404 returned error can't find the container with id f5135507cea0ad7b80b8a909843366be564794430df173e5c29dd89eb8c941f9
Sep 19 10:37:13.882322 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.882291    2579 generic.go:356] "Generic (PLEG): container finished" podID="9f3eba0f-65d4-42d3-82bb-a56fb515fd75" containerID="7629e170bafe4893c6bee9f35df9cdff66687f009f0721bfe46123746d13a47c" exitCode=0
Sep 19 10:37:13.882420 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.882335    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f3eba0f-65d4-42d3-82bb-a56fb515fd75","Type":"ContainerDied","Data":"7629e170bafe4893c6bee9f35df9cdff66687f009f0721bfe46123746d13a47c"}
Sep 19 10:37:13.882420 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:13.882387    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f3eba0f-65d4-42d3-82bb-a56fb515fd75","Type":"ContainerStarted","Data":"f5135507cea0ad7b80b8a909843366be564794430df173e5c29dd89eb8c941f9"}
Sep 19 10:37:14.888915 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:14.888884    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f3eba0f-65d4-42d3-82bb-a56fb515fd75","Type":"ContainerStarted","Data":"ba04a5ff4e82962aa3b5a441951711ddbf0973b6f613ed3903629818876e50c8"}
Sep 19 10:37:14.889239 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:14.888973    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f3eba0f-65d4-42d3-82bb-a56fb515fd75","Type":"ContainerStarted","Data":"b847581140c23953550585417c96e430d0e158771e6794fca70aee5c4793e632"}
Sep 19 10:37:14.889239 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:14.889008    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f3eba0f-65d4-42d3-82bb-a56fb515fd75","Type":"ContainerStarted","Data":"04db23ae6f72ce5f88da0de2c159280008716ead75e8055a569c7dd1aa944aba"}
Sep 19 10:37:14.889239 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:14.889033    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f3eba0f-65d4-42d3-82bb-a56fb515fd75","Type":"ContainerStarted","Data":"a9e1f2fcf75fcca37bb94979f401110c4206a14c3603b42f7b213a56d1ad706b"}
Sep 19 10:37:14.889239 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:14.889059    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f3eba0f-65d4-42d3-82bb-a56fb515fd75","Type":"ContainerStarted","Data":"00c7d88d12e803767274b95a276751c8d59434a17aa198313a9608ced3e35f8d"}
Sep 19 10:37:14.889239 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:14.889083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f3eba0f-65d4-42d3-82bb-a56fb515fd75","Type":"ContainerStarted","Data":"7ba8e6c7d859aedce76fd2afe71aefe8632a073e8096032f9f1ebf72098abf93"}
Sep 19 10:37:14.919530 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:14.919487    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.904261295 podStartE2EDuration="2.919472853s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.211558ms" isStatefulPod=false podCreationTimestamp="2026-09-19 10:37:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:14.913819738 +0000 UTC m=+157.813009631" watchObservedRunningTime="2026-09-19 10:37:14.919472853 +0000 UTC m=+157.818662745"
Sep 19 10:37:24.052646 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.052556    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ddfddd548-krh5n"]
Sep 19 10:37:24.055641 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.055622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.058670 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.058644    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 19 10:37:24.058797 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.058717    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 19 10:37:24.059514 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.059495    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 19 10:37:24.059937 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.059885    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 19 10:37:24.059937 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.059911    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z4n2v\""
Sep 19 10:37:24.060149 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.059967    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 19 10:37:24.060548 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.060527    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 19 10:37:24.060655 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.060572    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 19 10:37:24.063679 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.063657    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 19 10:37:24.068505 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.068482    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ddfddd548-krh5n"]
Sep 19 10:37:24.078485 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.078466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-oauth-config\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.078580 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.078492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-config\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.078580 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.078509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-oauth-serving-cert\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.078580 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.078543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4t6s\" (UniqueName: \"kubernetes.io/projected/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-kube-api-access-w4t6s\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.078695 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.078638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-service-ca\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.078750 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.078710    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-serving-cert\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.078786 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.078752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-trusted-ca-bundle\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.179640 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.179612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4t6s\" (UniqueName: \"kubernetes.io/projected/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-kube-api-access-w4t6s\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.179762 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.179648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-service-ca\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.179762 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.179698    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-serving-cert\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.179762 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.179746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-trusted-ca-bundle\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.179931 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.179876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-oauth-config\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.179931 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.179910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-config\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.180042 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.179933    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-oauth-serving-cert\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.180580 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.180550    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-service-ca\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.180580 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.180566    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-config\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.180702 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.180644    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-oauth-serving-cert\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.180894 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.180869    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-trusted-ca-bundle\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.182542 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.182507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-serving-cert\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.182648 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.182603    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-oauth-config\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.187080 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.187054    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4t6s\" (UniqueName: \"kubernetes.io/projected/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-kube-api-access-w4t6s\") pod \"console-5ddfddd548-krh5n\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") " pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.366075 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.366011    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:24.639483 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.639405    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ddfddd548-krh5n"]
Sep 19 10:37:24.642310 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:37:24.642276    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccb7118_f0d4_4ff9_8deb_a40b1455071e.slice/crio-9ba4b7286bcc8d171212108c007c79ef08121581509a6be01db61db85a81586b WatchSource:0}: Error finding container 9ba4b7286bcc8d171212108c007c79ef08121581509a6be01db61db85a81586b: Status 404 returned error can't find the container with id 9ba4b7286bcc8d171212108c007c79ef08121581509a6be01db61db85a81586b
Sep 19 10:37:24.930679 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.930589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddfddd548-krh5n" event={"ID":"5ccb7118-f0d4-4ff9-8deb-a40b1455071e","Type":"ContainerStarted","Data":"25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a"}
Sep 19 10:37:24.930679 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.930636    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddfddd548-krh5n" event={"ID":"5ccb7118-f0d4-4ff9-8deb-a40b1455071e","Type":"ContainerStarted","Data":"9ba4b7286bcc8d171212108c007c79ef08121581509a6be01db61db85a81586b"}
Sep 19 10:37:24.948966 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:24.948926    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5ddfddd548-krh5n" podStartSLOduration=0.948911867 podStartE2EDuration="948.911867ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:37:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:37:24.947017776 +0000 UTC m=+167.846207667" watchObservedRunningTime="2026-09-19 10:37:24.948911867 +0000 UTC m=+167.848101759"
Sep 19 10:37:34.366329 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:34.366292    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:34.366917 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:34.366388    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:34.371377 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:34.371352    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:37:34.973335 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:37:34.973310    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:38:45.143439 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.143398    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xn84p"]
Sep 19 10:38:45.146474 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.146452    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p"
Sep 19 10:38:45.148827 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.148798    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 19 10:38:45.149603 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.149550    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 19 10:38:45.149735 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.149650    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hhtzp\""
Sep 19 10:38:45.155084 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.155056    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xn84p"]
Sep 19 10:38:45.328124 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.328097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3448e3d-473e-4f2c-a1ce-abf822fece02-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xn84p\" (UID: \"a3448e3d-473e-4f2c-a1ce-abf822fece02\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p"
Sep 19 10:38:45.328232 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.328140    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6cpt\" (UniqueName: \"kubernetes.io/projected/a3448e3d-473e-4f2c-a1ce-abf822fece02-kube-api-access-p6cpt\") pod \"cert-manager-webhook-6486ffd997-xn84p\" (UID: \"a3448e3d-473e-4f2c-a1ce-abf822fece02\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p"
Sep 19 10:38:45.428919 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.428838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6cpt\" (UniqueName: \"kubernetes.io/projected/a3448e3d-473e-4f2c-a1ce-abf822fece02-kube-api-access-p6cpt\") pod \"cert-manager-webhook-6486ffd997-xn84p\" (UID: \"a3448e3d-473e-4f2c-a1ce-abf822fece02\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p"
Sep 19 10:38:45.429028 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.428924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3448e3d-473e-4f2c-a1ce-abf822fece02-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xn84p\" (UID: \"a3448e3d-473e-4f2c-a1ce-abf822fece02\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p"
Sep 19 10:38:45.437581 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.437549    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3448e3d-473e-4f2c-a1ce-abf822fece02-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xn84p\" (UID: \"a3448e3d-473e-4f2c-a1ce-abf822fece02\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p"
Sep 19 10:38:45.437748 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.437709    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6cpt\" (UniqueName: \"kubernetes.io/projected/a3448e3d-473e-4f2c-a1ce-abf822fece02-kube-api-access-p6cpt\") pod \"cert-manager-webhook-6486ffd997-xn84p\" (UID: \"a3448e3d-473e-4f2c-a1ce-abf822fece02\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p"
Sep 19 10:38:45.456423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.456395    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p"
Sep 19 10:38:45.727897 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:45.727817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xn84p"]
Sep 19 10:38:45.730930 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:38:45.730901    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3448e3d_473e_4f2c_a1ce_abf822fece02.slice/crio-549b5aa9dc25c32db215f72dfcb70c3c97eaff5ed531e160b7d88a442120c3a2 WatchSource:0}: Error finding container 549b5aa9dc25c32db215f72dfcb70c3c97eaff5ed531e160b7d88a442120c3a2: Status 404 returned error can't find the container with id 549b5aa9dc25c32db215f72dfcb70c3c97eaff5ed531e160b7d88a442120c3a2
Sep 19 10:38:46.233642 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:46.233603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p" event={"ID":"a3448e3d-473e-4f2c-a1ce-abf822fece02","Type":"ContainerStarted","Data":"549b5aa9dc25c32db215f72dfcb70c3c97eaff5ed531e160b7d88a442120c3a2"}
Sep 19 10:38:49.246241 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:49.246205    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p" event={"ID":"a3448e3d-473e-4f2c-a1ce-abf822fece02","Type":"ContainerStarted","Data":"069107967de589babae11a7e2b56386a574584d286a8a5b7cea0dabb3d35f728"}
Sep 19 10:38:49.246616 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:49.246294    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p"
Sep 19 10:38:49.263006 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:49.262952    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p" podStartSLOduration=1.443111391 podStartE2EDuration="4.262938371s" totalImagesPullingTime="2.81982698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:49.261864091 +0000 UTC m=+252.161053984" watchObservedRunningTime="2026-09-19 10:38:49.262938371 +0000 UTC m=+252.162128262"
Sep 19 10:38:52.345000 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:52.344913    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr"]
Sep 19 10:38:52.348012 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:52.347994    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr"
Sep 19 10:38:52.350386 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:52.350361    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tq7t8\""
Sep 19 10:38:52.355836 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:52.355814    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr"]
Sep 19 10:38:52.378694 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:52.378667    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebba517a-05fa-4cbb-811b-64fb81f63a5f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fwhtr\" (UID: \"ebba517a-05fa-4cbb-811b-64fb81f63a5f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr"
Sep 19 10:38:52.378812 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:52.378712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwhkj\" (UniqueName: \"kubernetes.io/projected/ebba517a-05fa-4cbb-811b-64fb81f63a5f-kube-api-access-kwhkj\") pod \"cert-manager-cainjector-559cdd8c87-fwhtr\" (UID: \"ebba517a-05fa-4cbb-811b-64fb81f63a5f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr"
Sep 19 10:38:52.479998 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:52.479973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebba517a-05fa-4cbb-811b-64fb81f63a5f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fwhtr\" (UID: \"ebba517a-05fa-4cbb-811b-64fb81f63a5f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr"
Sep 19 10:38:52.480100 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:52.480016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwhkj\" (UniqueName: \"kubernetes.io/projected/ebba517a-05fa-4cbb-811b-64fb81f63a5f-kube-api-access-kwhkj\") pod \"cert-manager-cainjector-559cdd8c87-fwhtr\" (UID: \"ebba517a-05fa-4cbb-811b-64fb81f63a5f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr"
Sep 19 10:38:52.487895 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:52.487863    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebba517a-05fa-4cbb-811b-64fb81f63a5f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fwhtr\" (UID: \"ebba517a-05fa-4cbb-811b-64fb81f63a5f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr"
Sep 19 10:38:52.488007 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:52.487963    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwhkj\" (UniqueName: \"kubernetes.io/projected/ebba517a-05fa-4cbb-811b-64fb81f63a5f-kube-api-access-kwhkj\") pod \"cert-manager-cainjector-559cdd8c87-fwhtr\" (UID: \"ebba517a-05fa-4cbb-811b-64fb81f63a5f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr"
Sep 19 10:38:52.658212 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:52.658155    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr"
Sep 19 10:38:52.928946 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:52.928884    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr"]
Sep 19 10:38:52.931922 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:38:52.931891    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebba517a_05fa_4cbb_811b_64fb81f63a5f.slice/crio-366054b5c605a1eea8504de4c97b5defeab0a87faac7b6ec0b6193514f4fa0a4 WatchSource:0}: Error finding container 366054b5c605a1eea8504de4c97b5defeab0a87faac7b6ec0b6193514f4fa0a4: Status 404 returned error can't find the container with id 366054b5c605a1eea8504de4c97b5defeab0a87faac7b6ec0b6193514f4fa0a4
Sep 19 10:38:53.263951 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:53.263865    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr" event={"ID":"ebba517a-05fa-4cbb-811b-64fb81f63a5f","Type":"ContainerStarted","Data":"b2a7429759142b418501ed84aa33ea6cc5acde4cd6334aed0c93edd5dd5bf110"}
Sep 19 10:38:53.263951 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:53.263900    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr" event={"ID":"ebba517a-05fa-4cbb-811b-64fb81f63a5f","Type":"ContainerStarted","Data":"366054b5c605a1eea8504de4c97b5defeab0a87faac7b6ec0b6193514f4fa0a4"}
Sep 19 10:38:53.280160 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:53.280113    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fwhtr" podStartSLOduration=1.280098852 podStartE2EDuration="1.280098852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:38:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:38:53.279874728 +0000 UTC m=+256.179064619" watchObservedRunningTime="2026-09-19 10:38:53.280098852 +0000 UTC m=+256.179288743"
Sep 19 10:38:55.253100 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:55.253070    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xn84p"
Sep 19 10:38:57.542537 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.542500    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8"]
Sep 19 10:38:57.549411 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.549384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8"
Sep 19 10:38:57.551686 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.551665    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 19 10:38:57.551827 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.551739    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 19 10:38:57.551827 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.551773    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-l5grr\""
Sep 19 10:38:57.554484 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.554460    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8"]
Sep 19 10:38:57.615471 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.615444    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtvxn\" (UniqueName: \"kubernetes.io/projected/7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c-kube-api-access-rtvxn\") pod \"openshift-lws-operator-fd8ccff4c-mfdm8\" (UID: \"7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8"
Sep 19 10:38:57.615562 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.615498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mfdm8\" (UID: \"7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8"
Sep 19 10:38:57.716639 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.716616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mfdm8\" (UID: \"7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8"
Sep 19 10:38:57.716748 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.716656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtvxn\" (UniqueName: \"kubernetes.io/projected/7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c-kube-api-access-rtvxn\") pod \"openshift-lws-operator-fd8ccff4c-mfdm8\" (UID: \"7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8"
Sep 19 10:38:57.716982 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.716965    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mfdm8\" (UID: \"7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8"
Sep 19 10:38:57.727943 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.727920    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtvxn\" (UniqueName: \"kubernetes.io/projected/7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c-kube-api-access-rtvxn\") pod \"openshift-lws-operator-fd8ccff4c-mfdm8\" (UID: \"7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8"
Sep 19 10:38:57.860567 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:57.860545    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8"
Sep 19 10:38:58.127336 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:58.127314    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8"]
Sep 19 10:38:58.129682 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:38:58.129657    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d5965d9_25f6_4c92_bdc9_5996fd1d7f9c.slice/crio-346515e934a3f4cfc442799a6fb5f4f2532767b243bc026f8c149095ba8577d4 WatchSource:0}: Error finding container 346515e934a3f4cfc442799a6fb5f4f2532767b243bc026f8c149095ba8577d4: Status 404 returned error can't find the container with id 346515e934a3f4cfc442799a6fb5f4f2532767b243bc026f8c149095ba8577d4
Sep 19 10:38:58.283732 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:38:58.283704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8" event={"ID":"7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c","Type":"ContainerStarted","Data":"346515e934a3f4cfc442799a6fb5f4f2532767b243bc026f8c149095ba8577d4"}
Sep 19 10:39:01.298046 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:01.298018    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8" event={"ID":"7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c","Type":"ContainerStarted","Data":"79dfb21fd902d4936209138912015b6ebaae9add6499e698149deda5caddfb86"}
Sep 19 10:39:01.316602 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:01.316562    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mfdm8" podStartSLOduration=1.866907015 podStartE2EDuration="4.316548123s" totalImagesPullingTime="2.449641108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:39:01.31559717 +0000 UTC m=+264.214787086" watchObservedRunningTime="2026-09-19 10:39:01.316548123 +0000 UTC m=+264.215738016"
Sep 19 10:39:16.348795 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.348750    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"]
Sep 19 10:39:16.351924 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.351901    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.356904 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.356781    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bmfwr\""
Sep 19 10:39:16.359920 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.357036    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 19 10:39:16.359920 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.357982    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 19 10:39:16.359920 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.358305    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 19 10:39:16.359920 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.359250    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 19 10:39:16.371085 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.371061    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"]
Sep 19 10:39:16.443559 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.443534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-tmp\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.443656 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.443569    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.443656 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.443587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.443656 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.443646    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-manifests\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.443800 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.443684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk7np\" (UniqueName: \"kubernetes.io/projected/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-kube-api-access-xk7np\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.544364 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.544342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk7np\" (UniqueName: \"kubernetes.io/projected/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-kube-api-access-xk7np\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.544461 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.544385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-tmp\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.544461 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.544412    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.544461 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.544443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.544601 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.544486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-manifests\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.544871 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.544845    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-manifests\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.546905 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.546875    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-tmp\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.547016 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.546997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.547078 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.547035    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.555630 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.555608    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk7np\" (UniqueName: \"kubernetes.io/projected/ca84fb4f-7a1f-41b1-99b3-7610fc668af7-kube-api-access-xk7np\") pod \"opendatahub-operator-controller-manager-9b87889df-s448x\" (UID: \"ca84fb4f-7a1f-41b1-99b3-7610fc668af7\") " pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.665833 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.665784    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:16.956872 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:16.956844    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"]
Sep 19 10:39:16.959784 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:39:16.959756    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca84fb4f_7a1f_41b1_99b3_7610fc668af7.slice/crio-442910c0d0e904bc77178ff1ad3909a47709ca1f891d7f69f6a60bc93d50863e WatchSource:0}: Error finding container 442910c0d0e904bc77178ff1ad3909a47709ca1f891d7f69f6a60bc93d50863e: Status 404 returned error can't find the container with id 442910c0d0e904bc77178ff1ad3909a47709ca1f891d7f69f6a60bc93d50863e
Sep 19 10:39:17.363693 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:17.363663    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x" event={"ID":"ca84fb4f-7a1f-41b1-99b3-7610fc668af7","Type":"ContainerStarted","Data":"442910c0d0e904bc77178ff1ad3909a47709ca1f891d7f69f6a60bc93d50863e"}
Sep 19 10:39:20.377669 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:20.377625    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x" event={"ID":"ca84fb4f-7a1f-41b1-99b3-7610fc668af7","Type":"ContainerStarted","Data":"24b7cd0b894870382b71518e7e7c5772fd76d1c146a5c9024ec6fecfb89dd587"}
Sep 19 10:39:21.382582 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:21.382549    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca84fb4f-7a1f-41b1-99b3-7610fc668af7" containerID="24b7cd0b894870382b71518e7e7c5772fd76d1c146a5c9024ec6fecfb89dd587" exitCode=0
Sep 19 10:39:21.382921 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:21.382640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x" event={"ID":"ca84fb4f-7a1f-41b1-99b3-7610fc668af7","Type":"ContainerDied","Data":"24b7cd0b894870382b71518e7e7c5772fd76d1c146a5c9024ec6fecfb89dd587"}
Sep 19 10:39:22.389527 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:22.389492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x" event={"ID":"ca84fb4f-7a1f-41b1-99b3-7610fc668af7","Type":"ContainerStarted","Data":"7caf86a9c1eecda963171d5ddc6422d3703e6c0270ce245bcddec868f006ee25"}
Sep 19 10:39:22.389917 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:22.389577    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:22.412943 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:22.412902    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x" podStartSLOduration=2.029670636 podStartE2EDuration="6.412890076s" totalImagesPullingTime="3.374038923s" totalInitContainerRuntime="1.009180517s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:39:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:39:22.411997384 +0000 UTC m=+285.311187280" watchObservedRunningTime="2026-09-19 10:39:22.412890076 +0000 UTC m=+285.312079968"
Sep 19 10:39:33.396124 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:33.396095    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9b87889df-s448x"
Sep 19 10:39:35.553138 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.553105    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"]
Sep 19 10:39:35.561994 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.561971    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"
Sep 19 10:39:35.566748 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.565307    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 19 10:39:35.566748 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.565325    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 19 10:39:35.566748 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.565801    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 19 10:39:35.566748 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.565850    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 19 10:39:35.566748 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.566122    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wxd2h\""
Sep 19 10:39:35.578112 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.578087    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"]
Sep 19 10:39:35.678243 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.678220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nppdh\" (UniqueName: \"kubernetes.io/projected/a6b2f6f7-4482-4e38-9564-c9dff59414fc-kube-api-access-nppdh\") pod \"kube-auth-proxy-8b786b9b5-h9glx\" (UID: \"a6b2f6f7-4482-4e38-9564-c9dff59414fc\") " pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"
Sep 19 10:39:35.678351 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.678261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6b2f6f7-4482-4e38-9564-c9dff59414fc-tmp\") pod \"kube-auth-proxy-8b786b9b5-h9glx\" (UID: \"a6b2f6f7-4482-4e38-9564-c9dff59414fc\") " pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"
Sep 19 10:39:35.678351 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.678287    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6b2f6f7-4482-4e38-9564-c9dff59414fc-tls-certs\") pod \"kube-auth-proxy-8b786b9b5-h9glx\" (UID: \"a6b2f6f7-4482-4e38-9564-c9dff59414fc\") " pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"
Sep 19 10:39:35.778867 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.778846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nppdh\" (UniqueName: \"kubernetes.io/projected/a6b2f6f7-4482-4e38-9564-c9dff59414fc-kube-api-access-nppdh\") pod \"kube-auth-proxy-8b786b9b5-h9glx\" (UID: \"a6b2f6f7-4482-4e38-9564-c9dff59414fc\") " pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"
Sep 19 10:39:35.778968 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.778888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6b2f6f7-4482-4e38-9564-c9dff59414fc-tmp\") pod \"kube-auth-proxy-8b786b9b5-h9glx\" (UID: \"a6b2f6f7-4482-4e38-9564-c9dff59414fc\") " pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"
Sep 19 10:39:35.778968 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.778907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6b2f6f7-4482-4e38-9564-c9dff59414fc-tls-certs\") pod \"kube-auth-proxy-8b786b9b5-h9glx\" (UID: \"a6b2f6f7-4482-4e38-9564-c9dff59414fc\") " pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"
Sep 19 10:39:35.781330 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.781301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6b2f6f7-4482-4e38-9564-c9dff59414fc-tmp\") pod \"kube-auth-proxy-8b786b9b5-h9glx\" (UID: \"a6b2f6f7-4482-4e38-9564-c9dff59414fc\") " pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"
Sep 19 10:39:35.781416 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.781369    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6b2f6f7-4482-4e38-9564-c9dff59414fc-tls-certs\") pod \"kube-auth-proxy-8b786b9b5-h9glx\" (UID: \"a6b2f6f7-4482-4e38-9564-c9dff59414fc\") " pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"
Sep 19 10:39:35.788808 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.788781    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nppdh\" (UniqueName: \"kubernetes.io/projected/a6b2f6f7-4482-4e38-9564-c9dff59414fc-kube-api-access-nppdh\") pod \"kube-auth-proxy-8b786b9b5-h9glx\" (UID: \"a6b2f6f7-4482-4e38-9564-c9dff59414fc\") " pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"
Sep 19 10:39:35.878868 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:35.878821    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"
Sep 19 10:39:36.147571 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:36.147550    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx"]
Sep 19 10:39:36.150165 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:39:36.150124    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b2f6f7_4482_4e38_9564_c9dff59414fc.slice/crio-71475c3de1257a28feb5c32b2b5419f0d8e8fe92d8fc3f084fecda68fd131a0b WatchSource:0}: Error finding container 71475c3de1257a28feb5c32b2b5419f0d8e8fe92d8fc3f084fecda68fd131a0b: Status 404 returned error can't find the container with id 71475c3de1257a28feb5c32b2b5419f0d8e8fe92d8fc3f084fecda68fd131a0b
Sep 19 10:39:36.455626 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:36.455548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx" event={"ID":"a6b2f6f7-4482-4e38-9564-c9dff59414fc","Type":"ContainerStarted","Data":"71475c3de1257a28feb5c32b2b5419f0d8e8fe92d8fc3f084fecda68fd131a0b"}
Sep 19 10:39:37.036975 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.036916    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"]
Sep 19 10:39:37.040457 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.040432    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.042922 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.042884    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 19 10:39:37.043029 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.042884    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jj8ff\""
Sep 19 10:39:37.043205 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.042990    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 19 10:39:37.043707 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.043493    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 19 10:39:37.043707 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.043503    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 19 10:39:37.055908 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.055883    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"]
Sep 19 10:39:37.088970 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.088940    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n888\" (UniqueName: \"kubernetes.io/projected/77ae00eb-5d62-4095-98d5-a0366b523041-kube-api-access-2n888\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.089073 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.089016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77ae00eb-5d62-4095-98d5-a0366b523041-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.089073 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.089057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.089168 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.089084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77ae00eb-5d62-4095-98d5-a0366b523041-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.089168 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.089148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.089279 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.089258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.089322 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.089305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77ae00eb-5d62-4095-98d5-a0366b523041-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.189876 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.189845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.190016 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.189888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77ae00eb-5d62-4095-98d5-a0366b523041-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.190016 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.189924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.190016 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.189954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.190016 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.189986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77ae00eb-5d62-4095-98d5-a0366b523041-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.190235 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.190035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n888\" (UniqueName: \"kubernetes.io/projected/77ae00eb-5d62-4095-98d5-a0366b523041-kube-api-access-2n888\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.190235 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.190096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77ae00eb-5d62-4095-98d5-a0366b523041-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.190610 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.190583    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77ae00eb-5d62-4095-98d5-a0366b523041-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.192773 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.192706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77ae00eb-5d62-4095-98d5-a0366b523041-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.192940 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.192918    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.193105 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.193081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.193163 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.193108    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.198567 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.198524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n888\" (UniqueName: \"kubernetes.io/projected/77ae00eb-5d62-4095-98d5-a0366b523041-kube-api-access-2n888\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.198662 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.198594    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77ae00eb-5d62-4095-98d5-a0366b523041-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-slfdj\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.353199 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.353175    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:37.641310 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:37.641225    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"]
Sep 19 10:39:38.815309 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:39:38.815276    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ae00eb_5d62_4095_98d5_a0366b523041.slice/crio-59282788af70b578e69f6e44680c2b93bbfad0d5e8c893f8a14bad2897259937 WatchSource:0}: Error finding container 59282788af70b578e69f6e44680c2b93bbfad0d5e8c893f8a14bad2897259937: Status 404 returned error can't find the container with id 59282788af70b578e69f6e44680c2b93bbfad0d5e8c893f8a14bad2897259937
Sep 19 10:39:39.108852 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:39.108785    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:39:39.114863 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:39.114835    2579 kubelet.go:1648] "Image garbage collection succeeded"
Sep 19 10:39:39.117527 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:39.117502    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:39:39.471818 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:39.471749    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx" event={"ID":"a6b2f6f7-4482-4e38-9564-c9dff59414fc","Type":"ContainerStarted","Data":"3a10c97bf77514d4912e52b20aee2af2d94c8092c31301b6b269cca7fa2a4a5f"}
Sep 19 10:39:39.473980 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:39.472930    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj" event={"ID":"77ae00eb-5d62-4095-98d5-a0366b523041","Type":"ContainerStarted","Data":"59282788af70b578e69f6e44680c2b93bbfad0d5e8c893f8a14bad2897259937"}
Sep 19 10:39:39.489095 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:39.489049    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx" podStartSLOduration=1.7730736870000001 podStartE2EDuration="4.489031177s" totalImagesPullingTime="2.71595749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:39:39.488314711 +0000 UTC m=+302.387504597" watchObservedRunningTime="2026-09-19 10:39:39.489031177 +0000 UTC m=+302.388221069"
Sep 19 10:39:41.235078 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:41.235043    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:39:41.235322 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:41.235117    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:39:41.488355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:41.488258    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj" event={"ID":"77ae00eb-5d62-4095-98d5-a0366b523041","Type":"ContainerStarted","Data":"d99d15c7e3a2c3ee3a6badeef77cb497a032d8e9e0c8bdb51b2dfd7667b359fa"}
Sep 19 10:39:41.488355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:41.488355    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:41.508438 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:41.508395    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj" podStartSLOduration=2.090971145 podStartE2EDuration="4.508379761s" totalImagesPullingTime="2.417408616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:39:41.506387054 +0000 UTC m=+304.405576958" watchObservedRunningTime="2026-09-19 10:39:41.508379761 +0000 UTC m=+304.407569653"
Sep 19 10:39:42.494091 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:42.494060    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:46.815216 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:46.815182    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4j9vr"]
Sep 19 10:39:46.818821 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:46.818792    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr"
Sep 19 10:39:46.822543 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:46.822525    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 19 10:39:46.830300 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:46.830278    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4j9vr"]
Sep 19 10:39:46.967268 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:46.967235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34c5053-1baa-47f4-a7f7-10f286a89925-tls-certs\") pod \"model-serving-api-54d89bd5fc-4j9vr\" (UID: \"f34c5053-1baa-47f4-a7f7-10f286a89925\") " pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr"
Sep 19 10:39:46.967406 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:46.967299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x8fm\" (UniqueName: \"kubernetes.io/projected/f34c5053-1baa-47f4-a7f7-10f286a89925-kube-api-access-7x8fm\") pod \"model-serving-api-54d89bd5fc-4j9vr\" (UID: \"f34c5053-1baa-47f4-a7f7-10f286a89925\") " pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr"
Sep 19 10:39:47.068512 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:47.068444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x8fm\" (UniqueName: \"kubernetes.io/projected/f34c5053-1baa-47f4-a7f7-10f286a89925-kube-api-access-7x8fm\") pod \"model-serving-api-54d89bd5fc-4j9vr\" (UID: \"f34c5053-1baa-47f4-a7f7-10f286a89925\") " pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr"
Sep 19 10:39:47.068512 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:47.068496    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34c5053-1baa-47f4-a7f7-10f286a89925-tls-certs\") pod \"model-serving-api-54d89bd5fc-4j9vr\" (UID: \"f34c5053-1baa-47f4-a7f7-10f286a89925\") " pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr"
Sep 19 10:39:47.071161 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:47.071138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34c5053-1baa-47f4-a7f7-10f286a89925-tls-certs\") pod \"model-serving-api-54d89bd5fc-4j9vr\" (UID: \"f34c5053-1baa-47f4-a7f7-10f286a89925\") " pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr"
Sep 19 10:39:47.077526 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:47.077505    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x8fm\" (UniqueName: \"kubernetes.io/projected/f34c5053-1baa-47f4-a7f7-10f286a89925-kube-api-access-7x8fm\") pod \"model-serving-api-54d89bd5fc-4j9vr\" (UID: \"f34c5053-1baa-47f4-a7f7-10f286a89925\") " pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr"
Sep 19 10:39:47.129433 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:47.129407    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr"
Sep 19 10:39:47.402806 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:47.402714    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4j9vr"]
Sep 19 10:39:47.406447 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:39:47.406417    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34c5053_1baa_47f4_a7f7_10f286a89925.slice/crio-34b6cda9849ea4739c84570a9591350e76d086652617b94074f097917a7838ee WatchSource:0}: Error finding container 34b6cda9849ea4739c84570a9591350e76d086652617b94074f097917a7838ee: Status 404 returned error can't find the container with id 34b6cda9849ea4739c84570a9591350e76d086652617b94074f097917a7838ee
Sep 19 10:39:47.408176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:47.408160    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 10:39:47.515263 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:47.515233    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr" event={"ID":"f34c5053-1baa-47f4-a7f7-10f286a89925","Type":"ContainerStarted","Data":"34b6cda9849ea4739c84570a9591350e76d086652617b94074f097917a7838ee"}
Sep 19 10:39:49.525777 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:49.525743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr" event={"ID":"f34c5053-1baa-47f4-a7f7-10f286a89925","Type":"ContainerStarted","Data":"7c9ff63d9f45db0197f495dd977de1be931a049c3a2453e0cbef8a5f21b59089"}
Sep 19 10:39:49.526160 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:49.525814    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr"
Sep 19 10:39:49.543045 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:49.542999    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr" podStartSLOduration=2.121712397 podStartE2EDuration="3.542983848s" totalImagesPullingTime="1.421271451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:39:49.541893916 +0000 UTC m=+312.441083838" watchObservedRunningTime="2026-09-19 10:39:49.542983848 +0000 UTC m=+312.442173740"
Sep 19 10:39:55.703266 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.703228    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"]
Sep 19 10:39:55.706628 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.706608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"
Sep 19 10:39:55.709633 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.709614    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9sbz6\""
Sep 19 10:39:55.710486 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.710468    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 19 10:39:55.718561 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.718537    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"]
Sep 19 10:39:55.723075 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.723057    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"]
Sep 19 10:39:55.726061 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.726047    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"
Sep 19 10:39:55.728580 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.728565    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-84jkk\""
Sep 19 10:39:55.728885 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.728872    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 19 10:39:55.746019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.745999    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"]
Sep 19 10:39:55.836259 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.836236    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7e48adf-6645-4680-8ea2-32671aa63241-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xb6vx\" (UID: \"d7e48adf-6645-4680-8ea2-32671aa63241\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"
Sep 19 10:39:55.836360 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.836273    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14a05ed2-5cc5-4c38-8db6-77360789dcfb-cert\") pod \"kserve-controller-manager-d6f4b65b8-c5fml\" (UID: \"14a05ed2-5cc5-4c38-8db6-77360789dcfb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"
Sep 19 10:39:55.836412 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.836393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l679v\" (UniqueName: \"kubernetes.io/projected/14a05ed2-5cc5-4c38-8db6-77360789dcfb-kube-api-access-l679v\") pod \"kserve-controller-manager-d6f4b65b8-c5fml\" (UID: \"14a05ed2-5cc5-4c38-8db6-77360789dcfb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"
Sep 19 10:39:55.836462 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.836438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8svzq\" (UniqueName: \"kubernetes.io/projected/d7e48adf-6645-4680-8ea2-32671aa63241-kube-api-access-8svzq\") pod \"llmisvc-controller-manager-777c6bd7d5-xb6vx\" (UID: \"d7e48adf-6645-4680-8ea2-32671aa63241\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"
Sep 19 10:39:55.936911 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.936886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7e48adf-6645-4680-8ea2-32671aa63241-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xb6vx\" (UID: \"d7e48adf-6645-4680-8ea2-32671aa63241\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"
Sep 19 10:39:55.937001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.936914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14a05ed2-5cc5-4c38-8db6-77360789dcfb-cert\") pod \"kserve-controller-manager-d6f4b65b8-c5fml\" (UID: \"14a05ed2-5cc5-4c38-8db6-77360789dcfb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"
Sep 19 10:39:55.937001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.936956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l679v\" (UniqueName: \"kubernetes.io/projected/14a05ed2-5cc5-4c38-8db6-77360789dcfb-kube-api-access-l679v\") pod \"kserve-controller-manager-d6f4b65b8-c5fml\" (UID: \"14a05ed2-5cc5-4c38-8db6-77360789dcfb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"
Sep 19 10:39:55.937001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.936977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8svzq\" (UniqueName: \"kubernetes.io/projected/d7e48adf-6645-4680-8ea2-32671aa63241-kube-api-access-8svzq\") pod \"llmisvc-controller-manager-777c6bd7d5-xb6vx\" (UID: \"d7e48adf-6645-4680-8ea2-32671aa63241\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"
Sep 19 10:39:55.939315 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.939293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7e48adf-6645-4680-8ea2-32671aa63241-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xb6vx\" (UID: \"d7e48adf-6645-4680-8ea2-32671aa63241\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"
Sep 19 10:39:55.939390 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.939352    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14a05ed2-5cc5-4c38-8db6-77360789dcfb-cert\") pod \"kserve-controller-manager-d6f4b65b8-c5fml\" (UID: \"14a05ed2-5cc5-4c38-8db6-77360789dcfb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"
Sep 19 10:39:55.945746 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.945692    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8svzq\" (UniqueName: \"kubernetes.io/projected/d7e48adf-6645-4680-8ea2-32671aa63241-kube-api-access-8svzq\") pod \"llmisvc-controller-manager-777c6bd7d5-xb6vx\" (UID: \"d7e48adf-6645-4680-8ea2-32671aa63241\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"
Sep 19 10:39:55.945848 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:55.945698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l679v\" (UniqueName: \"kubernetes.io/projected/14a05ed2-5cc5-4c38-8db6-77360789dcfb-kube-api-access-l679v\") pod \"kserve-controller-manager-d6f4b65b8-c5fml\" (UID: \"14a05ed2-5cc5-4c38-8db6-77360789dcfb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"
Sep 19 10:39:56.016527 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:56.016476    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"
Sep 19 10:39:56.034644 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:56.034622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"
Sep 19 10:39:56.305671 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:56.305640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"]
Sep 19 10:39:56.308063 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:39:56.308037    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a05ed2_5cc5_4c38_8db6_77360789dcfb.slice/crio-90e1b9cbedcf39925bc15fac372ecb98bb74d45c4cc8ec864676111594483313 WatchSource:0}: Error finding container 90e1b9cbedcf39925bc15fac372ecb98bb74d45c4cc8ec864676111594483313: Status 404 returned error can't find the container with id 90e1b9cbedcf39925bc15fac372ecb98bb74d45c4cc8ec864676111594483313
Sep 19 10:39:56.325147 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:56.325125    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"]
Sep 19 10:39:56.326139 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:39:56.326117    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd7e48adf_6645_4680_8ea2_32671aa63241.slice/crio-19aced2c1b679701e93dbcaec85ebdd192355b24e689184db8b66f32ad07740c WatchSource:0}: Error finding container 19aced2c1b679701e93dbcaec85ebdd192355b24e689184db8b66f32ad07740c: Status 404 returned error can't find the container with id 19aced2c1b679701e93dbcaec85ebdd192355b24e689184db8b66f32ad07740c
Sep 19 10:39:56.557080 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:56.557010    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx" event={"ID":"d7e48adf-6645-4680-8ea2-32671aa63241","Type":"ContainerStarted","Data":"19aced2c1b679701e93dbcaec85ebdd192355b24e689184db8b66f32ad07740c"}
Sep 19 10:39:56.558118 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:56.558095    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml" event={"ID":"14a05ed2-5cc5-4c38-8db6-77360789dcfb","Type":"ContainerStarted","Data":"90e1b9cbedcf39925bc15fac372ecb98bb74d45c4cc8ec864676111594483313"}
Sep 19 10:39:57.924488 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:57.924432    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"]
Sep 19 10:39:57.925711 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:57.925525    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj" podUID="77ae00eb-5d62-4095-98d5-a0366b523041" containerName="discovery" containerID="cri-o://d99d15c7e3a2c3ee3a6badeef77cb497a032d8e9e0c8bdb51b2dfd7667b359fa" gracePeriod=30
Sep 19 10:39:58.573242 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.573197    2579 generic.go:356] "Generic (PLEG): container finished" podID="77ae00eb-5d62-4095-98d5-a0366b523041" containerID="d99d15c7e3a2c3ee3a6badeef77cb497a032d8e9e0c8bdb51b2dfd7667b359fa" exitCode=0
Sep 19 10:39:58.573538 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.573273    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj" event={"ID":"77ae00eb-5d62-4095-98d5-a0366b523041","Type":"ContainerDied","Data":"d99d15c7e3a2c3ee3a6badeef77cb497a032d8e9e0c8bdb51b2dfd7667b359fa"}
Sep 19 10:39:58.658024 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.657943    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:58.759259 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.759224    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-istio-kubeconfig\") pod \"77ae00eb-5d62-4095-98d5-a0366b523041\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") "
Sep 19 10:39:58.759443 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.759283    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-cacerts\") pod \"77ae00eb-5d62-4095-98d5-a0366b523041\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") "
Sep 19 10:39:58.759443 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.759342    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n888\" (UniqueName: \"kubernetes.io/projected/77ae00eb-5d62-4095-98d5-a0366b523041-kube-api-access-2n888\") pod \"77ae00eb-5d62-4095-98d5-a0366b523041\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") "
Sep 19 10:39:58.759443 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.759371    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-istio-csr-dns-cert\") pod \"77ae00eb-5d62-4095-98d5-a0366b523041\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") "
Sep 19 10:39:58.759443 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.759415    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77ae00eb-5d62-4095-98d5-a0366b523041-istio-csr-ca-configmap\") pod \"77ae00eb-5d62-4095-98d5-a0366b523041\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") "
Sep 19 10:39:58.759443 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.759441    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77ae00eb-5d62-4095-98d5-a0366b523041-istio-token\") pod \"77ae00eb-5d62-4095-98d5-a0366b523041\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") "
Sep 19 10:39:58.759709 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.759495    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77ae00eb-5d62-4095-98d5-a0366b523041-local-certs\") pod \"77ae00eb-5d62-4095-98d5-a0366b523041\" (UID: \"77ae00eb-5d62-4095-98d5-a0366b523041\") "
Sep 19 10:39:58.760398 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.760350    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77ae00eb-5d62-4095-98d5-a0366b523041-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "77ae00eb-5d62-4095-98d5-a0366b523041" (UID: "77ae00eb-5d62-4095-98d5-a0366b523041"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:39:58.762794 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.762755    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77ae00eb-5d62-4095-98d5-a0366b523041-local-certs" (OuterVolumeSpecName: "local-certs") pod "77ae00eb-5d62-4095-98d5-a0366b523041" (UID: "77ae00eb-5d62-4095-98d5-a0366b523041"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:39:58.762914 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.762784    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77ae00eb-5d62-4095-98d5-a0366b523041-istio-token" (OuterVolumeSpecName: "istio-token") pod "77ae00eb-5d62-4095-98d5-a0366b523041" (UID: "77ae00eb-5d62-4095-98d5-a0366b523041"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:39:58.762914 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.762855    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "77ae00eb-5d62-4095-98d5-a0366b523041" (UID: "77ae00eb-5d62-4095-98d5-a0366b523041"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:39:58.763092 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.762911    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77ae00eb-5d62-4095-98d5-a0366b523041-kube-api-access-2n888" (OuterVolumeSpecName: "kube-api-access-2n888") pod "77ae00eb-5d62-4095-98d5-a0366b523041" (UID: "77ae00eb-5d62-4095-98d5-a0366b523041"). InnerVolumeSpecName "kube-api-access-2n888". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:39:58.763092 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.762995    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-cacerts" (OuterVolumeSpecName: "cacerts") pod "77ae00eb-5d62-4095-98d5-a0366b523041" (UID: "77ae00eb-5d62-4095-98d5-a0366b523041"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:39:58.763092 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.763068    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "77ae00eb-5d62-4095-98d5-a0366b523041" (UID: "77ae00eb-5d62-4095-98d5-a0366b523041"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:39:58.861237 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.861157    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n888\" (UniqueName: \"kubernetes.io/projected/77ae00eb-5d62-4095-98d5-a0366b523041-kube-api-access-2n888\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:39:58.861237 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.861189    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-istio-csr-dns-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:39:58.861237 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.861199    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77ae00eb-5d62-4095-98d5-a0366b523041-istio-csr-ca-configmap\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:39:58.861237 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.861207    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77ae00eb-5d62-4095-98d5-a0366b523041-istio-token\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:39:58.861237 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.861216    2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77ae00eb-5d62-4095-98d5-a0366b523041-local-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:39:58.861237 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.861229    2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-istio-kubeconfig\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:39:58.861237 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:58.861240    2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77ae00eb-5d62-4095-98d5-a0366b523041-cacerts\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:39:59.578868 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:59.578843    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"
Sep 19 10:39:59.578868 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:59.578847    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj" event={"ID":"77ae00eb-5d62-4095-98d5-a0366b523041","Type":"ContainerDied","Data":"59282788af70b578e69f6e44680c2b93bbfad0d5e8c893f8a14bad2897259937"}
Sep 19 10:39:59.579344 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:59.578910    2579 scope.go:117] "RemoveContainer" containerID="d99d15c7e3a2c3ee3a6badeef77cb497a032d8e9e0c8bdb51b2dfd7667b359fa"
Sep 19 10:39:59.580677 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:59.580641    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx" event={"ID":"d7e48adf-6645-4680-8ea2-32671aa63241","Type":"ContainerStarted","Data":"c1b2a89e9723d3ec326de202b4202b99ab53402ef5e47fa615afae950c516106"}
Sep 19 10:39:59.580831 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:59.580757    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"
Sep 19 10:39:59.582452 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:59.582432    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml" event={"ID":"14a05ed2-5cc5-4c38-8db6-77360789dcfb","Type":"ContainerStarted","Data":"78e81ab8489dad4cb99fb579f6721975277496deb474ddb21cd1c0908f7bf12a"}
Sep 19 10:39:59.582568 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:59.582468    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"
Sep 19 10:39:59.603799 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:59.603762    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml" podStartSLOduration=1.675154974 podStartE2EDuration="4.603750032s" totalImagesPullingTime="2.928595058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:39:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:39:59.602098379 +0000 UTC m=+322.501288287" watchObservedRunningTime="2026-09-19 10:39:59.603750032 +0000 UTC m=+322.502939923"
Sep 19 10:39:59.618602 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:59.618582    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"]
Sep 19 10:39:59.622408 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:59.622382    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj"]
Sep 19 10:39:59.640123 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:39:59.640083    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx" podStartSLOduration=1.725437548 podStartE2EDuration="4.640069757s" totalImagesPullingTime="2.914632209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:39:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:39:59.638961198 +0000 UTC m=+322.538151091" watchObservedRunningTime="2026-09-19 10:39:59.640069757 +0000 UTC m=+322.539259648"
Sep 19 10:40:00.534367 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:40:00.534340    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-4j9vr"
Sep 19 10:40:01.201966 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:40:01.201935    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77ae00eb-5d62-4095-98d5-a0366b523041" path="/var/lib/kubelet/pods/77ae00eb-5d62-4095-98d5-a0366b523041/volumes"
Sep 19 10:40:30.591016 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:40:30.590985    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xb6vx"
Sep 19 10:40:30.594313 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:40:30.594291    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c5fml"
Sep 19 10:41:04.727355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.727307    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"]
Sep 19 10:41:04.727890 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.727643    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77ae00eb-5d62-4095-98d5-a0366b523041" containerName="discovery"
Sep 19 10:41:04.727890 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.727655    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="77ae00eb-5d62-4095-98d5-a0366b523041" containerName="discovery"
Sep 19 10:41:04.727890 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.727711    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="77ae00eb-5d62-4095-98d5-a0366b523041" containerName="discovery"
Sep 19 10:41:04.730266 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.730249    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:04.733045 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.733019    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 19 10:41:04.733215 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.733085    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-smhjc\""
Sep 19 10:41:04.733341 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.733325    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 19 10:41:04.742433 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.742409    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"]
Sep 19 10:41:04.847805 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.847775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpbsp\" (UniqueName: \"kubernetes.io/projected/bc3e122b-34a0-4688-a2b8-30e26c8d2586-kube-api-access-lpbsp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-bxfb4\" (UID: \"bc3e122b-34a0-4688-a2b8-30e26c8d2586\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:04.847928 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.847871    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc3e122b-34a0-4688-a2b8-30e26c8d2586-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-bxfb4\" (UID: \"bc3e122b-34a0-4688-a2b8-30e26c8d2586\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:04.948121 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.948094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc3e122b-34a0-4688-a2b8-30e26c8d2586-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-bxfb4\" (UID: \"bc3e122b-34a0-4688-a2b8-30e26c8d2586\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:04.948231 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.948139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpbsp\" (UniqueName: \"kubernetes.io/projected/bc3e122b-34a0-4688-a2b8-30e26c8d2586-kube-api-access-lpbsp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-bxfb4\" (UID: \"bc3e122b-34a0-4688-a2b8-30e26c8d2586\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:04.948447 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.948428    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc3e122b-34a0-4688-a2b8-30e26c8d2586-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-bxfb4\" (UID: \"bc3e122b-34a0-4688-a2b8-30e26c8d2586\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:04.960826 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:04.960806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpbsp\" (UniqueName: \"kubernetes.io/projected/bc3e122b-34a0-4688-a2b8-30e26c8d2586-kube-api-access-lpbsp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-bxfb4\" (UID: \"bc3e122b-34a0-4688-a2b8-30e26c8d2586\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:05.041256 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:05.041197    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:05.316871 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:05.316848    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"]
Sep 19 10:41:05.319278 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:41:05.319253    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3e122b_34a0_4688_a2b8_30e26c8d2586.slice/crio-0a9bcebf3d94b97ccadd28046d6003a14f0d8f1fe370401fecb7c5645e9cb785 WatchSource:0}: Error finding container 0a9bcebf3d94b97ccadd28046d6003a14f0d8f1fe370401fecb7c5645e9cb785: Status 404 returned error can't find the container with id 0a9bcebf3d94b97ccadd28046d6003a14f0d8f1fe370401fecb7c5645e9cb785
Sep 19 10:41:05.883259 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:05.883222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4" event={"ID":"bc3e122b-34a0-4688-a2b8-30e26c8d2586","Type":"ContainerStarted","Data":"0a9bcebf3d94b97ccadd28046d6003a14f0d8f1fe370401fecb7c5645e9cb785"}
Sep 19 10:41:06.657212 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:06.657047    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"]
Sep 19 10:41:06.662350 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:06.662328    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"
Sep 19 10:41:06.664953 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:06.664917    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2wn8x\""
Sep 19 10:41:06.673996 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:06.673971    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"]
Sep 19 10:41:06.764352 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:06.764302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t48nh\" (UniqueName: \"kubernetes.io/projected/76f93cc2-8671-48b3-98ef-12c314f1620e-kube-api-access-t48nh\") pod \"limitador-operator-controller-manager-74495c69f8-mfs8h\" (UID: \"76f93cc2-8671-48b3-98ef-12c314f1620e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"
Sep 19 10:41:06.865330 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:06.865262    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t48nh\" (UniqueName: \"kubernetes.io/projected/76f93cc2-8671-48b3-98ef-12c314f1620e-kube-api-access-t48nh\") pod \"limitador-operator-controller-manager-74495c69f8-mfs8h\" (UID: \"76f93cc2-8671-48b3-98ef-12c314f1620e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"
Sep 19 10:41:06.874275 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:06.874245    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t48nh\" (UniqueName: \"kubernetes.io/projected/76f93cc2-8671-48b3-98ef-12c314f1620e-kube-api-access-t48nh\") pod \"limitador-operator-controller-manager-74495c69f8-mfs8h\" (UID: \"76f93cc2-8671-48b3-98ef-12c314f1620e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"
Sep 19 10:41:06.978027 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:06.977951    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"
Sep 19 10:41:07.687995 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:07.687943    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"]
Sep 19 10:41:07.690288 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:41:07.690261    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f93cc2_8671_48b3_98ef_12c314f1620e.slice/crio-a52ec5f16dc62c76decce71598a9f6194fac295db8e2636443aa2715e7782e46 WatchSource:0}: Error finding container a52ec5f16dc62c76decce71598a9f6194fac295db8e2636443aa2715e7782e46: Status 404 returned error can't find the container with id a52ec5f16dc62c76decce71598a9f6194fac295db8e2636443aa2715e7782e46
Sep 19 10:41:07.894214 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:07.894183    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h" event={"ID":"76f93cc2-8671-48b3-98ef-12c314f1620e","Type":"ContainerStarted","Data":"a52ec5f16dc62c76decce71598a9f6194fac295db8e2636443aa2715e7782e46"}
Sep 19 10:41:08.977135 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:08.977106    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9"]
Sep 19 10:41:08.980828 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:08.980802    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9"
Sep 19 10:41:08.983234 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:08.983212    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 19 10:41:08.983360 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:08.983337    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6n274\""
Sep 19 10:41:08.991190 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:08.991141    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9"]
Sep 19 10:41:09.082465 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:09.082437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll7xb\" (UniqueName: \"kubernetes.io/projected/c46d2897-15ff-4572-b72f-373e60dbd9b5-kube-api-access-ll7xb\") pod \"dns-operator-controller-manager-7b84cd7c9c-c4vg9\" (UID: \"c46d2897-15ff-4572-b72f-373e60dbd9b5\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9"
Sep 19 10:41:09.183173 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:09.183146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll7xb\" (UniqueName: \"kubernetes.io/projected/c46d2897-15ff-4572-b72f-373e60dbd9b5-kube-api-access-ll7xb\") pod \"dns-operator-controller-manager-7b84cd7c9c-c4vg9\" (UID: \"c46d2897-15ff-4572-b72f-373e60dbd9b5\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9"
Sep 19 10:41:09.203171 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:09.203149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll7xb\" (UniqueName: \"kubernetes.io/projected/c46d2897-15ff-4572-b72f-373e60dbd9b5-kube-api-access-ll7xb\") pod \"dns-operator-controller-manager-7b84cd7c9c-c4vg9\" (UID: \"c46d2897-15ff-4572-b72f-373e60dbd9b5\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9"
Sep 19 10:41:09.294249 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:09.294175    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9"
Sep 19 10:41:09.578098 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:09.578073    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9"]
Sep 19 10:41:09.582082 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:41:09.582053    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46d2897_15ff_4572_b72f_373e60dbd9b5.slice/crio-f94ed6fc8c5869fc685b989d8182a5cd97a8eedb1199286a65a6ab5a8d087ffe WatchSource:0}: Error finding container f94ed6fc8c5869fc685b989d8182a5cd97a8eedb1199286a65a6ab5a8d087ffe: Status 404 returned error can't find the container with id f94ed6fc8c5869fc685b989d8182a5cd97a8eedb1199286a65a6ab5a8d087ffe
Sep 19 10:41:09.907058 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:09.906977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9" event={"ID":"c46d2897-15ff-4572-b72f-373e60dbd9b5","Type":"ContainerStarted","Data":"f94ed6fc8c5869fc685b989d8182a5cd97a8eedb1199286a65a6ab5a8d087ffe"}
Sep 19 10:41:09.909180 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:09.909140    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4" event={"ID":"bc3e122b-34a0-4688-a2b8-30e26c8d2586","Type":"ContainerStarted","Data":"f8dcd51f5b8894e2d837937fec5ccf3787f04b080ea1ef8204b5ed42147c0621"}
Sep 19 10:41:09.909319 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:09.909289    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:09.937461 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:09.937403    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4" podStartSLOduration=1.8828184879999998 podStartE2EDuration="5.937385429s" totalImagesPullingTime="4.054566941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:41:09.937278635 +0000 UTC m=+392.836468528" watchObservedRunningTime="2026-09-19 10:41:09.937385429 +0000 UTC m=+392.836575323"
Sep 19 10:41:10.916741 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:10.916672    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h" event={"ID":"76f93cc2-8671-48b3-98ef-12c314f1620e","Type":"ContainerStarted","Data":"7b59c9031d0363058b97f2a58017580cf8972c8b6c9682585db1b06b32fe1fd7"}
Sep 19 10:41:10.917192 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:10.917029    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"
Sep 19 10:41:10.943145 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:10.943094    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h" podStartSLOduration=2.437810746 podStartE2EDuration="4.943079545s" totalImagesPullingTime="2.505268799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:41:10.940949849 +0000 UTC m=+393.840139776" watchObservedRunningTime="2026-09-19 10:41:10.943079545 +0000 UTC m=+393.842269437"
Sep 19 10:41:11.923132 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:11.923093    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9" event={"ID":"c46d2897-15ff-4572-b72f-373e60dbd9b5","Type":"ContainerStarted","Data":"09b7b7cfea3295632d5903af0cc222fccc38ba62f14625ebb11c00358ae5d457"}
Sep 19 10:41:11.923509 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:11.923376    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9"
Sep 19 10:41:11.955262 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:11.955218    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9" podStartSLOduration=2.406346172 podStartE2EDuration="3.955202491s" totalImagesPullingTime="1.548856319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:41:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:41:11.953170019 +0000 UTC m=+394.852359911" watchObservedRunningTime="2026-09-19 10:41:11.955202491 +0000 UTC m=+394.854392384"
Sep 19 10:41:11.956985 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:11.956967    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-w8bth"]
Sep 19 10:41:11.960289 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:11.960274    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-w8bth"
Sep 19 10:41:11.962477 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:11.962457    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2jp22\""
Sep 19 10:41:11.973310 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:11.973291    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-w8bth"]
Sep 19 10:41:12.110401 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:12.110372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjxcb\" (UniqueName: \"kubernetes.io/projected/60bc21e1-feea-4ab0-829f-1e98bd65fa63-kube-api-access-sjxcb\") pod \"authorino-operator-76b478bd78-w8bth\" (UID: \"60bc21e1-feea-4ab0-829f-1e98bd65fa63\") " pod="kuadrant-system/authorino-operator-76b478bd78-w8bth"
Sep 19 10:41:12.211006 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:12.210945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjxcb\" (UniqueName: \"kubernetes.io/projected/60bc21e1-feea-4ab0-829f-1e98bd65fa63-kube-api-access-sjxcb\") pod \"authorino-operator-76b478bd78-w8bth\" (UID: \"60bc21e1-feea-4ab0-829f-1e98bd65fa63\") " pod="kuadrant-system/authorino-operator-76b478bd78-w8bth"
Sep 19 10:41:12.224625 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:12.224597    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjxcb\" (UniqueName: \"kubernetes.io/projected/60bc21e1-feea-4ab0-829f-1e98bd65fa63-kube-api-access-sjxcb\") pod \"authorino-operator-76b478bd78-w8bth\" (UID: \"60bc21e1-feea-4ab0-829f-1e98bd65fa63\") " pod="kuadrant-system/authorino-operator-76b478bd78-w8bth"
Sep 19 10:41:12.270065 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:12.270045    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-w8bth"
Sep 19 10:41:12.548899 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:12.548824    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-w8bth"]
Sep 19 10:41:12.551936 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:41:12.551906    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bc21e1_feea_4ab0_829f_1e98bd65fa63.slice/crio-d07a68acc213d87ee4ac43e31e2a76a7efe28ae7cd5cbb4ab5197ed7f46c2ab8 WatchSource:0}: Error finding container d07a68acc213d87ee4ac43e31e2a76a7efe28ae7cd5cbb4ab5197ed7f46c2ab8: Status 404 returned error can't find the container with id d07a68acc213d87ee4ac43e31e2a76a7efe28ae7cd5cbb4ab5197ed7f46c2ab8
Sep 19 10:41:12.929905 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:12.929874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-w8bth" event={"ID":"60bc21e1-feea-4ab0-829f-1e98bd65fa63","Type":"ContainerStarted","Data":"d07a68acc213d87ee4ac43e31e2a76a7efe28ae7cd5cbb4ab5197ed7f46c2ab8"}
Sep 19 10:41:14.941387 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:14.941355    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-w8bth" event={"ID":"60bc21e1-feea-4ab0-829f-1e98bd65fa63","Type":"ContainerStarted","Data":"d7b57d0c10789e3578211a063caa9a9b047598e2d1daab7809a3ec379b39c68c"}
Sep 19 10:41:14.941825 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:14.941487    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-w8bth"
Sep 19 10:41:14.960760 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:14.960703    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-w8bth" podStartSLOduration=2.622534722 podStartE2EDuration="3.960690482s" totalImagesPullingTime="1.33815576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:41:14.958757158 +0000 UTC m=+397.857947048" watchObservedRunningTime="2026-09-19 10:41:14.960690482 +0000 UTC m=+397.859880375"
Sep 19 10:41:19.016595 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.016555    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86588cd8f4-2mdzt"]
Sep 19 10:41:19.020196 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.020176    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.032950 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.032921    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86588cd8f4-2mdzt"]
Sep 19 10:41:19.160885 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.160850    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e8a638-7305-41dd-a166-3b98a092d400-trusted-ca-bundle\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.160997 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.160894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85e8a638-7305-41dd-a166-3b98a092d400-console-serving-cert\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.160997 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.160933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4gvp\" (UniqueName: \"kubernetes.io/projected/85e8a638-7305-41dd-a166-3b98a092d400-kube-api-access-j4gvp\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.161078 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.160996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85e8a638-7305-41dd-a166-3b98a092d400-service-ca\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.161078 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.161025    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85e8a638-7305-41dd-a166-3b98a092d400-oauth-serving-cert\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.161078 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.161052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85e8a638-7305-41dd-a166-3b98a092d400-console-oauth-config\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.161171 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.161092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85e8a638-7305-41dd-a166-3b98a092d400-console-config\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.261413 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.261389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85e8a638-7305-41dd-a166-3b98a092d400-console-oauth-config\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.261547 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.261419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85e8a638-7305-41dd-a166-3b98a092d400-console-config\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.261547 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.261446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e8a638-7305-41dd-a166-3b98a092d400-trusted-ca-bundle\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.261547 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.261470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85e8a638-7305-41dd-a166-3b98a092d400-console-serving-cert\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.261547 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.261526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4gvp\" (UniqueName: \"kubernetes.io/projected/85e8a638-7305-41dd-a166-3b98a092d400-kube-api-access-j4gvp\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.261834 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.261597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85e8a638-7305-41dd-a166-3b98a092d400-service-ca\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.261834 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.261631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85e8a638-7305-41dd-a166-3b98a092d400-oauth-serving-cert\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.262359 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.262333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85e8a638-7305-41dd-a166-3b98a092d400-console-config\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.262474 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.262390    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85e8a638-7305-41dd-a166-3b98a092d400-service-ca\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.262935 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.262906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e8a638-7305-41dd-a166-3b98a092d400-trusted-ca-bundle\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.263036 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.262979    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85e8a638-7305-41dd-a166-3b98a092d400-oauth-serving-cert\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.264583 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.264558    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85e8a638-7305-41dd-a166-3b98a092d400-console-oauth-config\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.264834 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.264814    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85e8a638-7305-41dd-a166-3b98a092d400-console-serving-cert\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.270514 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.270455    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4gvp\" (UniqueName: \"kubernetes.io/projected/85e8a638-7305-41dd-a166-3b98a092d400-kube-api-access-j4gvp\") pod \"console-86588cd8f4-2mdzt\" (UID: \"85e8a638-7305-41dd-a166-3b98a092d400\") " pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.329866 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.329845    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:19.601678 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.601653    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86588cd8f4-2mdzt"]
Sep 19 10:41:19.603801 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:41:19.603777    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e8a638_7305_41dd_a166_3b98a092d400.slice/crio-38620c824af8b3122b07009f5aaad3a8fa25058874b8a901eccc054e755bfb6e WatchSource:0}: Error finding container 38620c824af8b3122b07009f5aaad3a8fa25058874b8a901eccc054e755bfb6e: Status 404 returned error can't find the container with id 38620c824af8b3122b07009f5aaad3a8fa25058874b8a901eccc054e755bfb6e
Sep 19 10:41:19.966802 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.966715    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86588cd8f4-2mdzt" event={"ID":"85e8a638-7305-41dd-a166-3b98a092d400","Type":"ContainerStarted","Data":"bf4727522a542b53205fa69d978ffeff7767a8ae8f1d3ee4c7451e66ae9cdac8"}
Sep 19 10:41:19.966802 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:19.966776    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86588cd8f4-2mdzt" event={"ID":"85e8a638-7305-41dd-a166-3b98a092d400","Type":"ContainerStarted","Data":"38620c824af8b3122b07009f5aaad3a8fa25058874b8a901eccc054e755bfb6e"}
Sep 19 10:41:20.025555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:20.025506    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86588cd8f4-2mdzt" podStartSLOduration=2.02549082 podStartE2EDuration="2.02549082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:41:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:41:20.024682043 +0000 UTC m=+402.923871926" watchObservedRunningTime="2026-09-19 10:41:20.02549082 +0000 UTC m=+402.924680712"
Sep 19 10:41:20.919168 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:20.919134    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:21.925267 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:21.925234    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"
Sep 19 10:41:22.932526 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:22.932496    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c4vg9"
Sep 19 10:41:23.067454 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.067421    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"]
Sep 19 10:41:23.067636 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.067610    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4" podUID="bc3e122b-34a0-4688-a2b8-30e26c8d2586" containerName="manager" containerID="cri-o://f8dcd51f5b8894e2d837937fec5ccf3787f04b080ea1ef8204b5ed42147c0621" gracePeriod=2
Sep 19 10:41:23.080308 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:41:23.080274    2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"bc3e122b-34a0-4688-a2b8-30e26c8d2586\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-bxfb4\": pods \"kuadrant-operator-controller-manager-76f8f686bf-bxfb4\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:23.080780 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.080750    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"]
Sep 19 10:41:23.103982 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.103959    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"]
Sep 19 10:41:23.104353 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.104324    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h" podUID="76f93cc2-8671-48b3-98ef-12c314f1620e" containerName="manager" containerID="cri-o://7b59c9031d0363058b97f2a58017580cf8972c8b6c9682585db1b06b32fe1fd7" gracePeriod=2
Sep 19 10:41:23.117003 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.116981    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"]
Sep 19 10:41:23.117163 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:41:23.117123    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mfs8h\" is forbidden: User \"system:node:ip-10-0-143-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-186.ec2.internal' and this object" podUID="76f93cc2-8671-48b3-98ef-12c314f1620e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"
Sep 19 10:41:23.117749 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.117713    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3e122b-34a0-4688-a2b8-30e26c8d2586" containerName="manager"
Sep 19 10:41:23.117850 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.117835    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3e122b-34a0-4688-a2b8-30e26c8d2586" containerName="manager"
Sep 19 10:41:23.118148 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.118128    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc3e122b-34a0-4688-a2b8-30e26c8d2586" containerName="manager"
Sep 19 10:41:23.119803 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:41:23.119769    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-bxfb4\" is forbidden: User \"system:node:ip-10-0-143-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-186.ec2.internal' and this object" podUID="bc3e122b-34a0-4688-a2b8-30e26c8d2586" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:23.121749 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.121707    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"]
Sep 19 10:41:23.122054 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.122030    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"]
Sep 19 10:41:23.122152 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.121986    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"
Sep 19 10:41:23.126453 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.126432    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9"]
Sep 19 10:41:23.126965 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.126944    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76f93cc2-8671-48b3-98ef-12c314f1620e" containerName="manager"
Sep 19 10:41:23.126965 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.126965    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="76f93cc2-8671-48b3-98ef-12c314f1620e" containerName="manager"
Sep 19 10:41:23.127123 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.127075    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="76f93cc2-8671-48b3-98ef-12c314f1620e" containerName="manager"
Sep 19 10:41:23.130011 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.129993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9"
Sep 19 10:41:23.144911 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.144892    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9"]
Sep 19 10:41:23.148834 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:41:23.148799    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mfs8h\" is forbidden: User \"system:node:ip-10-0-143-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-186.ec2.internal' and this object" podUID="76f93cc2-8671-48b3-98ef-12c314f1620e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"
Sep 19 10:41:23.150576 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:41:23.150551    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-bxfb4\" is forbidden: User \"system:node:ip-10-0-143-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-186.ec2.internal' and this object" podUID="bc3e122b-34a0-4688-a2b8-30e26c8d2586" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:23.152597 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:41:23.152567    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mfs8h\" is forbidden: User \"system:node:ip-10-0-143-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-186.ec2.internal' and this object" podUID="76f93cc2-8671-48b3-98ef-12c314f1620e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"
Sep 19 10:41:23.154289 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:41:23.154263    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-bxfb4\" is forbidden: User \"system:node:ip-10-0-143-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-186.ec2.internal' and this object" podUID="bc3e122b-34a0-4688-a2b8-30e26c8d2586" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:23.195070 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.195014    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjwlb\" (UniqueName: \"kubernetes.io/projected/0f209e4b-d76c-4eac-873f-62d0ec094244-kube-api-access-mjwlb\") pod \"limitador-operator-controller-manager-74495c69f8-pbkp9\" (UID: \"0f209e4b-d76c-4eac-873f-62d0ec094244\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9"
Sep 19 10:41:23.195169 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.195065    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df69s\" (UniqueName: \"kubernetes.io/projected/90c2fc80-a432-46c4-a922-b7b8057b700d-kube-api-access-df69s\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hrxs5\" (UID: \"90c2fc80-a432-46c4-a922-b7b8057b700d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"
Sep 19 10:41:23.195228 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.195198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90c2fc80-a432-46c4-a922-b7b8057b700d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hrxs5\" (UID: \"90c2fc80-a432-46c4-a922-b7b8057b700d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"
Sep 19 10:41:23.296335 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.296305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90c2fc80-a432-46c4-a922-b7b8057b700d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hrxs5\" (UID: \"90c2fc80-a432-46c4-a922-b7b8057b700d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"
Sep 19 10:41:23.296462 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.296359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjwlb\" (UniqueName: \"kubernetes.io/projected/0f209e4b-d76c-4eac-873f-62d0ec094244-kube-api-access-mjwlb\") pod \"limitador-operator-controller-manager-74495c69f8-pbkp9\" (UID: \"0f209e4b-d76c-4eac-873f-62d0ec094244\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9"
Sep 19 10:41:23.296462 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.296402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df69s\" (UniqueName: \"kubernetes.io/projected/90c2fc80-a432-46c4-a922-b7b8057b700d-kube-api-access-df69s\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hrxs5\" (UID: \"90c2fc80-a432-46c4-a922-b7b8057b700d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"
Sep 19 10:41:23.296800 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.296771    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90c2fc80-a432-46c4-a922-b7b8057b700d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hrxs5\" (UID: \"90c2fc80-a432-46c4-a922-b7b8057b700d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"
Sep 19 10:41:23.315188 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.315165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjwlb\" (UniqueName: \"kubernetes.io/projected/0f209e4b-d76c-4eac-873f-62d0ec094244-kube-api-access-mjwlb\") pod \"limitador-operator-controller-manager-74495c69f8-pbkp9\" (UID: \"0f209e4b-d76c-4eac-873f-62d0ec094244\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9"
Sep 19 10:41:23.315396 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.315374    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df69s\" (UniqueName: \"kubernetes.io/projected/90c2fc80-a432-46c4-a922-b7b8057b700d-kube-api-access-df69s\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hrxs5\" (UID: \"90c2fc80-a432-46c4-a922-b7b8057b700d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"
Sep 19 10:41:23.346747 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.346712    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:23.349387 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.349370    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"
Sep 19 10:41:23.498555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.498500    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t48nh\" (UniqueName: \"kubernetes.io/projected/76f93cc2-8671-48b3-98ef-12c314f1620e-kube-api-access-t48nh\") pod \"76f93cc2-8671-48b3-98ef-12c314f1620e\" (UID: \"76f93cc2-8671-48b3-98ef-12c314f1620e\") "
Sep 19 10:41:23.498555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.498553    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpbsp\" (UniqueName: \"kubernetes.io/projected/bc3e122b-34a0-4688-a2b8-30e26c8d2586-kube-api-access-lpbsp\") pod \"bc3e122b-34a0-4688-a2b8-30e26c8d2586\" (UID: \"bc3e122b-34a0-4688-a2b8-30e26c8d2586\") "
Sep 19 10:41:23.498690 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.498637    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc3e122b-34a0-4688-a2b8-30e26c8d2586-extensions-socket-volume\") pod \"bc3e122b-34a0-4688-a2b8-30e26c8d2586\" (UID: \"bc3e122b-34a0-4688-a2b8-30e26c8d2586\") "
Sep 19 10:41:23.499181 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.499154    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc3e122b-34a0-4688-a2b8-30e26c8d2586-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bc3e122b-34a0-4688-a2b8-30e26c8d2586" (UID: "bc3e122b-34a0-4688-a2b8-30e26c8d2586"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:41:23.500610 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.500584    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76f93cc2-8671-48b3-98ef-12c314f1620e-kube-api-access-t48nh" (OuterVolumeSpecName: "kube-api-access-t48nh") pod "76f93cc2-8671-48b3-98ef-12c314f1620e" (UID: "76f93cc2-8671-48b3-98ef-12c314f1620e"). InnerVolumeSpecName "kube-api-access-t48nh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:41:23.500610 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.500601    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc3e122b-34a0-4688-a2b8-30e26c8d2586-kube-api-access-lpbsp" (OuterVolumeSpecName: "kube-api-access-lpbsp") pod "bc3e122b-34a0-4688-a2b8-30e26c8d2586" (UID: "bc3e122b-34a0-4688-a2b8-30e26c8d2586"). InnerVolumeSpecName "kube-api-access-lpbsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:41:23.513789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.513770    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"
Sep 19 10:41:23.519514 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.519495    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9"
Sep 19 10:41:23.599203 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.599177    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc3e122b-34a0-4688-a2b8-30e26c8d2586-extensions-socket-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:41:23.599203 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.599205    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t48nh\" (UniqueName: \"kubernetes.io/projected/76f93cc2-8671-48b3-98ef-12c314f1620e-kube-api-access-t48nh\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:41:23.599338 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.599219    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpbsp\" (UniqueName: \"kubernetes.io/projected/bc3e122b-34a0-4688-a2b8-30e26c8d2586-kube-api-access-lpbsp\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:41:23.799378 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.799352    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9"]
Sep 19 10:41:23.802836 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:41:23.802798    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f209e4b_d76c_4eac_873f_62d0ec094244.slice/crio-3ae464174bd3469d8d4988bcad7af56f1511a8c5a2fa6747462c07137408b151 WatchSource:0}: Error finding container 3ae464174bd3469d8d4988bcad7af56f1511a8c5a2fa6747462c07137408b151: Status 404 returned error can't find the container with id 3ae464174bd3469d8d4988bcad7af56f1511a8c5a2fa6747462c07137408b151
Sep 19 10:41:23.804240 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.804217    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"]
Sep 19 10:41:23.805947 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:41:23.805925    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c2fc80_a432_46c4_a922_b7b8057b700d.slice/crio-4cc57ddcf7b0b60c6f5cbb320d56b89f153daee56d82f4f7ec5bd7cd363201ae WatchSource:0}: Error finding container 4cc57ddcf7b0b60c6f5cbb320d56b89f153daee56d82f4f7ec5bd7cd363201ae: Status 404 returned error can't find the container with id 4cc57ddcf7b0b60c6f5cbb320d56b89f153daee56d82f4f7ec5bd7cd363201ae
Sep 19 10:41:23.996654 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.996619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9" event={"ID":"0f209e4b-d76c-4eac-873f-62d0ec094244","Type":"ContainerStarted","Data":"dd9ff90708be116f9103ac8a913f4f145828cbfd8664c734acbc279a0f104767"}
Sep 19 10:41:23.997104 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.996690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9"
Sep 19 10:41:23.997104 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.996714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9" event={"ID":"0f209e4b-d76c-4eac-873f-62d0ec094244","Type":"ContainerStarted","Data":"3ae464174bd3469d8d4988bcad7af56f1511a8c5a2fa6747462c07137408b151"}
Sep 19 10:41:23.998775 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.998714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5" event={"ID":"90c2fc80-a432-46c4-a922-b7b8057b700d","Type":"ContainerStarted","Data":"5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76"}
Sep 19 10:41:23.998917 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.998782    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5" event={"ID":"90c2fc80-a432-46c4-a922-b7b8057b700d","Type":"ContainerStarted","Data":"4cc57ddcf7b0b60c6f5cbb320d56b89f153daee56d82f4f7ec5bd7cd363201ae"}
Sep 19 10:41:23.998917 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:23.998813    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"
Sep 19 10:41:24.000385 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:24.000362    2579 generic.go:356] "Generic (PLEG): container finished" podID="bc3e122b-34a0-4688-a2b8-30e26c8d2586" containerID="f8dcd51f5b8894e2d837937fec5ccf3787f04b080ea1ef8204b5ed42147c0621" exitCode=0
Sep 19 10:41:24.000485 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:24.000402    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bxfb4"
Sep 19 10:41:24.000485 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:24.000452    2579 scope.go:117] "RemoveContainer" containerID="f8dcd51f5b8894e2d837937fec5ccf3787f04b080ea1ef8204b5ed42147c0621"
Sep 19 10:41:24.001969 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:24.001945    2579 generic.go:356] "Generic (PLEG): container finished" podID="76f93cc2-8671-48b3-98ef-12c314f1620e" containerID="7b59c9031d0363058b97f2a58017580cf8972c8b6c9682585db1b06b32fe1fd7" exitCode=0
Sep 19 10:41:24.002038 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:24.002006    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mfs8h"
Sep 19 10:41:24.009458 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:24.009431    2579 scope.go:117] "RemoveContainer" containerID="f8dcd51f5b8894e2d837937fec5ccf3787f04b080ea1ef8204b5ed42147c0621"
Sep 19 10:41:24.009781 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:41:24.009760    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8dcd51f5b8894e2d837937fec5ccf3787f04b080ea1ef8204b5ed42147c0621\": container with ID starting with f8dcd51f5b8894e2d837937fec5ccf3787f04b080ea1ef8204b5ed42147c0621 not found: ID does not exist" containerID="f8dcd51f5b8894e2d837937fec5ccf3787f04b080ea1ef8204b5ed42147c0621"
Sep 19 10:41:24.009874 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:24.009790    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8dcd51f5b8894e2d837937fec5ccf3787f04b080ea1ef8204b5ed42147c0621"} err="failed to get container status \"f8dcd51f5b8894e2d837937fec5ccf3787f04b080ea1ef8204b5ed42147c0621\": rpc error: code = NotFound desc = could not find container \"f8dcd51f5b8894e2d837937fec5ccf3787f04b080ea1ef8204b5ed42147c0621\": container with ID starting with f8dcd51f5b8894e2d837937fec5ccf3787f04b080ea1ef8204b5ed42147c0621 not found: ID does not exist"
Sep 19 10:41:24.009874 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:24.009813    2579 scope.go:117] "RemoveContainer" containerID="7b59c9031d0363058b97f2a58017580cf8972c8b6c9682585db1b06b32fe1fd7"
Sep 19 10:41:24.018396 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:24.018375    2579 scope.go:117] "RemoveContainer" containerID="7b59c9031d0363058b97f2a58017580cf8972c8b6c9682585db1b06b32fe1fd7"
Sep 19 10:41:24.018627 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:41:24.018611    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b59c9031d0363058b97f2a58017580cf8972c8b6c9682585db1b06b32fe1fd7\": container with ID starting with 7b59c9031d0363058b97f2a58017580cf8972c8b6c9682585db1b06b32fe1fd7 not found: ID does not exist" containerID="7b59c9031d0363058b97f2a58017580cf8972c8b6c9682585db1b06b32fe1fd7"
Sep 19 10:41:24.018672 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:24.018633    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b59c9031d0363058b97f2a58017580cf8972c8b6c9682585db1b06b32fe1fd7"} err="failed to get container status \"7b59c9031d0363058b97f2a58017580cf8972c8b6c9682585db1b06b32fe1fd7\": rpc error: code = NotFound desc = could not find container \"7b59c9031d0363058b97f2a58017580cf8972c8b6c9682585db1b06b32fe1fd7\": container with ID starting with 7b59c9031d0363058b97f2a58017580cf8972c8b6c9682585db1b06b32fe1fd7 not found: ID does not exist"
Sep 19 10:41:24.021913 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:24.021874    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9" podStartSLOduration=1.021861331 podStartE2EDuration="1.021861331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:41:24.02088221 +0000 UTC m=+406.920072119" watchObservedRunningTime="2026-09-19 10:41:24.021861331 +0000 UTC m=+406.921051241"
Sep 19 10:41:24.047438 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:24.047397    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5" podStartSLOduration=1.047385752 podStartE2EDuration="1.047385752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:41:24.046040041 +0000 UTC m=+406.945229932" watchObservedRunningTime="2026-09-19 10:41:24.047385752 +0000 UTC m=+406.946575645"
Sep 19 10:41:25.201176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:25.201140    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76f93cc2-8671-48b3-98ef-12c314f1620e" path="/var/lib/kubelet/pods/76f93cc2-8671-48b3-98ef-12c314f1620e/volumes"
Sep 19 10:41:25.201558 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:25.201525    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc3e122b-34a0-4688-a2b8-30e26c8d2586" path="/var/lib/kubelet/pods/bc3e122b-34a0-4688-a2b8-30e26c8d2586/volumes"
Sep 19 10:41:25.948632 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:25.948602    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-w8bth"
Sep 19 10:41:29.330315 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:29.330279    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:29.330716 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:29.330358    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:29.334810 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:29.334788    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:30.039791 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:30.039764    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86588cd8f4-2mdzt"
Sep 19 10:41:30.089236 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:30.089210    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ddfddd548-krh5n"]
Sep 19 10:41:35.012020 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:35.011991    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pbkp9"
Sep 19 10:41:35.012396 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:35.012052    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"
Sep 19 10:41:40.280531 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:40.280493    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"]
Sep 19 10:41:40.281057 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:40.280701    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5" podUID="90c2fc80-a432-46c4-a922-b7b8057b700d" containerName="manager" containerID="cri-o://5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76" gracePeriod=10
Sep 19 10:41:40.528752 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:40.528716    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"
Sep 19 10:41:40.631338 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:40.631309    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df69s\" (UniqueName: \"kubernetes.io/projected/90c2fc80-a432-46c4-a922-b7b8057b700d-kube-api-access-df69s\") pod \"90c2fc80-a432-46c4-a922-b7b8057b700d\" (UID: \"90c2fc80-a432-46c4-a922-b7b8057b700d\") "
Sep 19 10:41:40.631555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:40.631350    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90c2fc80-a432-46c4-a922-b7b8057b700d-extensions-socket-volume\") pod \"90c2fc80-a432-46c4-a922-b7b8057b700d\" (UID: \"90c2fc80-a432-46c4-a922-b7b8057b700d\") "
Sep 19 10:41:40.631776 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:40.631749    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c2fc80-a432-46c4-a922-b7b8057b700d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "90c2fc80-a432-46c4-a922-b7b8057b700d" (UID: "90c2fc80-a432-46c4-a922-b7b8057b700d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:41:40.633312 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:40.633292    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c2fc80-a432-46c4-a922-b7b8057b700d-kube-api-access-df69s" (OuterVolumeSpecName: "kube-api-access-df69s") pod "90c2fc80-a432-46c4-a922-b7b8057b700d" (UID: "90c2fc80-a432-46c4-a922-b7b8057b700d"). InnerVolumeSpecName "kube-api-access-df69s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:41:40.732276 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:40.732252    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df69s\" (UniqueName: \"kubernetes.io/projected/90c2fc80-a432-46c4-a922-b7b8057b700d-kube-api-access-df69s\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:41:40.732276 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:40.732275    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90c2fc80-a432-46c4-a922-b7b8057b700d-extensions-socket-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:41:41.096594 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:41.096568    2579 generic.go:356] "Generic (PLEG): container finished" podID="90c2fc80-a432-46c4-a922-b7b8057b700d" containerID="5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76" exitCode=0
Sep 19 10:41:41.096695 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:41.096623    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"
Sep 19 10:41:41.096695 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:41.096662    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5" event={"ID":"90c2fc80-a432-46c4-a922-b7b8057b700d","Type":"ContainerDied","Data":"5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76"}
Sep 19 10:41:41.096804 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:41.096739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5" event={"ID":"90c2fc80-a432-46c4-a922-b7b8057b700d","Type":"ContainerDied","Data":"4cc57ddcf7b0b60c6f5cbb320d56b89f153daee56d82f4f7ec5bd7cd363201ae"}
Sep 19 10:41:41.096804 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:41.096772    2579 scope.go:117] "RemoveContainer" containerID="5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76"
Sep 19 10:41:41.105317 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:41.105300    2579 scope.go:117] "RemoveContainer" containerID="5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76"
Sep 19 10:41:41.105608 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:41:41.105588    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76\": container with ID starting with 5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76 not found: ID does not exist" containerID="5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76"
Sep 19 10:41:41.105657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:41.105618    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76"} err="failed to get container status \"5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76\": rpc error: code = NotFound desc = could not find container \"5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76\": container with ID starting with 5fc40e3920d7801eeaf637cb7357a729444432ff12c39e52ebeb68f8f5d0da76 not found: ID does not exist"
Sep 19 10:41:41.120707 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:41.120683    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"]
Sep 19 10:41:41.125196 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:41.125174    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hrxs5"]
Sep 19 10:41:41.200822 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:41.200801    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c2fc80-a432-46c4-a922-b7b8057b700d" path="/var/lib/kubelet/pods/90c2fc80-a432-46c4-a922-b7b8057b700d/volumes"
Sep 19 10:41:55.108806 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.108710    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5ddfddd548-krh5n" podUID="5ccb7118-f0d4-4ff9-8deb-a40b1455071e" containerName="console" containerID="cri-o://25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a" gracePeriod=15
Sep 19 10:41:55.344355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.344331    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:41:55.427929 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.427866    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-serving-cert\") pod \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") "
Sep 19 10:41:55.427929 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.427908    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-oauth-serving-cert\") pod \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") "
Sep 19 10:41:55.427929 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.427934    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-service-ca\") pod \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") "
Sep 19 10:41:55.428136 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.428112    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-config\") pod \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") "
Sep 19 10:41:55.428260 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.428151    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-trusted-ca-bundle\") pod \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") "
Sep 19 10:41:55.428260 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.428172    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4t6s\" (UniqueName: \"kubernetes.io/projected/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-kube-api-access-w4t6s\") pod \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") "
Sep 19 10:41:55.428260 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.428237    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5ccb7118-f0d4-4ff9-8deb-a40b1455071e" (UID: "5ccb7118-f0d4-4ff9-8deb-a40b1455071e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:41:55.428432 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.428286    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-oauth-config\") pod \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\" (UID: \"5ccb7118-f0d4-4ff9-8deb-a40b1455071e\") "
Sep 19 10:41:55.428432 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.428290    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-service-ca" (OuterVolumeSpecName: "service-ca") pod "5ccb7118-f0d4-4ff9-8deb-a40b1455071e" (UID: "5ccb7118-f0d4-4ff9-8deb-a40b1455071e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:41:55.428562 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.428528    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5ccb7118-f0d4-4ff9-8deb-a40b1455071e" (UID: "5ccb7118-f0d4-4ff9-8deb-a40b1455071e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:41:55.428562 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.428541    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-config" (OuterVolumeSpecName: "console-config") pod "5ccb7118-f0d4-4ff9-8deb-a40b1455071e" (UID: "5ccb7118-f0d4-4ff9-8deb-a40b1455071e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:41:55.428679 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.428661    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-config\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:41:55.428749 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.428686    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-trusted-ca-bundle\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:41:55.428749 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.428702    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-oauth-serving-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:41:55.428749 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.428715    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-service-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:41:55.430215 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.430196    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5ccb7118-f0d4-4ff9-8deb-a40b1455071e" (UID: "5ccb7118-f0d4-4ff9-8deb-a40b1455071e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:41:55.430293 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.430253    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-kube-api-access-w4t6s" (OuterVolumeSpecName: "kube-api-access-w4t6s") pod "5ccb7118-f0d4-4ff9-8deb-a40b1455071e" (UID: "5ccb7118-f0d4-4ff9-8deb-a40b1455071e"). InnerVolumeSpecName "kube-api-access-w4t6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:41:55.430293 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.430277    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5ccb7118-f0d4-4ff9-8deb-a40b1455071e" (UID: "5ccb7118-f0d4-4ff9-8deb-a40b1455071e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:41:55.529209 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.529186    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-oauth-config\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:41:55.529209 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.529207    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-console-serving-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:41:55.529337 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:55.529218    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4t6s\" (UniqueName: \"kubernetes.io/projected/5ccb7118-f0d4-4ff9-8deb-a40b1455071e-kube-api-access-w4t6s\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:41:56.173112 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.173077    2579 generic.go:356] "Generic (PLEG): container finished" podID="5ccb7118-f0d4-4ff9-8deb-a40b1455071e" containerID="25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a" exitCode=0
Sep 19 10:41:56.173657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.173131    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddfddd548-krh5n" event={"ID":"5ccb7118-f0d4-4ff9-8deb-a40b1455071e","Type":"ContainerDied","Data":"25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a"}
Sep 19 10:41:56.173657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.173147    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddfddd548-krh5n"
Sep 19 10:41:56.173657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.173183    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddfddd548-krh5n" event={"ID":"5ccb7118-f0d4-4ff9-8deb-a40b1455071e","Type":"ContainerDied","Data":"9ba4b7286bcc8d171212108c007c79ef08121581509a6be01db61db85a81586b"}
Sep 19 10:41:56.173657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.173208    2579 scope.go:117] "RemoveContainer" containerID="25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a"
Sep 19 10:41:56.182682 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.182661    2579 scope.go:117] "RemoveContainer" containerID="25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a"
Sep 19 10:41:56.183022 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:41:56.183001    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a\": container with ID starting with 25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a not found: ID does not exist" containerID="25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a"
Sep 19 10:41:56.183146 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.183031    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a"} err="failed to get container status \"25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a\": rpc error: code = NotFound desc = could not find container \"25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a\": container with ID starting with 25d3e549a33cbcf03ed9a9dc9547592be93a6ddc75feb2209e1bf4eedad8fb1a not found: ID does not exist"
Sep 19 10:41:56.194737 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.194695    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ddfddd548-krh5n"]
Sep 19 10:41:56.198232 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.198206    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ddfddd548-krh5n"]
Sep 19 10:41:56.552596 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.552567    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"]
Sep 19 10:41:56.553075 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.553059    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c2fc80-a432-46c4-a922-b7b8057b700d" containerName="manager"
Sep 19 10:41:56.553134 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.553079    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c2fc80-a432-46c4-a922-b7b8057b700d" containerName="manager"
Sep 19 10:41:56.553134 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.553113    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccb7118-f0d4-4ff9-8deb-a40b1455071e" containerName="console"
Sep 19 10:41:56.553134 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.553122    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccb7118-f0d4-4ff9-8deb-a40b1455071e" containerName="console"
Sep 19 10:41:56.553228 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.553192    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ccb7118-f0d4-4ff9-8deb-a40b1455071e" containerName="console"
Sep 19 10:41:56.553228 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.553203    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c2fc80-a432-46c4-a922-b7b8057b700d" containerName="manager"
Sep 19 10:41:56.556415 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.556393    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.558687 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.558666    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 19 10:41:56.559334 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.559313    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4dxp5\""
Sep 19 10:41:56.572238 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.572217    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"]
Sep 19 10:41:56.636590 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.636565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35caa86b-d1ee-48fe-a901-9faa53de020c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.636708 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.636617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.636708 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.636695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.636851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.636748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.636851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.636779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35caa86b-d1ee-48fe-a901-9faa53de020c-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.636851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.636807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35caa86b-d1ee-48fe-a901-9faa53de020c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.637012 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.636903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.637012 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.636945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.637012 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.636975    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p27mz\" (UniqueName: \"kubernetes.io/projected/35caa86b-d1ee-48fe-a901-9faa53de020c-kube-api-access-p27mz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.737857 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.737836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.737943 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.737864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.737943 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.737882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.737943 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.737896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35caa86b-d1ee-48fe-a901-9faa53de020c-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.738188 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.738167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35caa86b-d1ee-48fe-a901-9faa53de020c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.738271 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.738219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.738271 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.738233    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.738271 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.738262    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.738445 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.738287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.738445 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.738296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p27mz\" (UniqueName: \"kubernetes.io/projected/35caa86b-d1ee-48fe-a901-9faa53de020c-kube-api-access-p27mz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.738445 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.738381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35caa86b-d1ee-48fe-a901-9faa53de020c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.738587 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.738507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.738650 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.738593    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.738996 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.738976    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35caa86b-d1ee-48fe-a901-9faa53de020c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.740297 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.740277    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35caa86b-d1ee-48fe-a901-9faa53de020c-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.740482 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.740465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35caa86b-d1ee-48fe-a901-9faa53de020c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.745531 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.745507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p27mz\" (UniqueName: \"kubernetes.io/projected/35caa86b-d1ee-48fe-a901-9faa53de020c-kube-api-access-p27mz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.745612 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.745594    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35caa86b-d1ee-48fe-a901-9faa53de020c-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g4xvk\" (UID: \"35caa86b-d1ee-48fe-a901-9faa53de020c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:56.867926 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:56.867870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:41:57.154994 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:57.154969    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"]
Sep 19 10:41:57.156886 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:41:57.156856    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35caa86b_d1ee_48fe_a901_9faa53de020c.slice/crio-56f8db55da383ef82e95e0ebecd0d18609e5d286d72867409966ba7a9faa583d WatchSource:0}: Error finding container 56f8db55da383ef82e95e0ebecd0d18609e5d286d72867409966ba7a9faa583d: Status 404 returned error can't find the container with id 56f8db55da383ef82e95e0ebecd0d18609e5d286d72867409966ba7a9faa583d
Sep 19 10:41:57.178793 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:57.178768    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk" event={"ID":"35caa86b-d1ee-48fe-a901-9faa53de020c","Type":"ContainerStarted","Data":"56f8db55da383ef82e95e0ebecd0d18609e5d286d72867409966ba7a9faa583d"}
Sep 19 10:41:57.201129 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:57.201103    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ccb7118-f0d4-4ff9-8deb-a40b1455071e" path="/var/lib/kubelet/pods/5ccb7118-f0d4-4ff9-8deb-a40b1455071e/volumes"
Sep 19 10:41:59.597896 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:59.597860    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:41:59.598145 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:59.597935    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:41:59.598145 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:41:59.597962    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:42:00.198234 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:00.198198    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk" event={"ID":"35caa86b-d1ee-48fe-a901-9faa53de020c","Type":"ContainerStarted","Data":"f5da2f8b9056d4cc082b7c2c7d215b1319479f11831ad7e4618f3e818e3dafc1"}
Sep 19 10:42:00.219690 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:00.219621    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk" podStartSLOduration=1.780962638 podStartE2EDuration="4.219602861s" totalImagesPullingTime="2.438640223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:42:00.217890789 +0000 UTC m=+443.117080704" watchObservedRunningTime="2026-09-19 10:42:00.219602861 +0000 UTC m=+443.118792753"
Sep 19 10:42:00.868489 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:00.868453    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:42:00.873157 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:00.873127    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:42:01.202537 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.202470    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5m6rc"]
Sep 19 10:42:01.205815 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.205796    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:42:01.205917 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.205845    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:42:01.205917 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.205897    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5m6rc"
Sep 19 10:42:01.208045 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.208023    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mwjf4\""
Sep 19 10:42:01.208154 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.208023    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 19 10:42:01.213940 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.213918    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5m6rc"]
Sep 19 10:42:01.275580 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.275550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33be66ee-3b51-47ee-863e-05eae657a05d-config-file\") pod \"limitador-limitador-8588749977-5m6rc\" (UID: \"33be66ee-3b51-47ee-863e-05eae657a05d\") " pod="kuadrant-system/limitador-limitador-8588749977-5m6rc"
Sep 19 10:42:01.275779 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.275640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftbcn\" (UniqueName: \"kubernetes.io/projected/33be66ee-3b51-47ee-863e-05eae657a05d-kube-api-access-ftbcn\") pod \"limitador-limitador-8588749977-5m6rc\" (UID: \"33be66ee-3b51-47ee-863e-05eae657a05d\") " pod="kuadrant-system/limitador-limitador-8588749977-5m6rc"
Sep 19 10:42:01.290167 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.290142    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5m6rc"]
Sep 19 10:42:01.376886 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.376856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftbcn\" (UniqueName: \"kubernetes.io/projected/33be66ee-3b51-47ee-863e-05eae657a05d-kube-api-access-ftbcn\") pod \"limitador-limitador-8588749977-5m6rc\" (UID: \"33be66ee-3b51-47ee-863e-05eae657a05d\") " pod="kuadrant-system/limitador-limitador-8588749977-5m6rc"
Sep 19 10:42:01.377005 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.376937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33be66ee-3b51-47ee-863e-05eae657a05d-config-file\") pod \"limitador-limitador-8588749977-5m6rc\" (UID: \"33be66ee-3b51-47ee-863e-05eae657a05d\") " pod="kuadrant-system/limitador-limitador-8588749977-5m6rc"
Sep 19 10:42:01.377591 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.377570    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33be66ee-3b51-47ee-863e-05eae657a05d-config-file\") pod \"limitador-limitador-8588749977-5m6rc\" (UID: \"33be66ee-3b51-47ee-863e-05eae657a05d\") " pod="kuadrant-system/limitador-limitador-8588749977-5m6rc"
Sep 19 10:42:01.390463 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.390423    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftbcn\" (UniqueName: \"kubernetes.io/projected/33be66ee-3b51-47ee-863e-05eae657a05d-kube-api-access-ftbcn\") pod \"limitador-limitador-8588749977-5m6rc\" (UID: \"33be66ee-3b51-47ee-863e-05eae657a05d\") " pod="kuadrant-system/limitador-limitador-8588749977-5m6rc"
Sep 19 10:42:01.517756 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.517677    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5m6rc"
Sep 19 10:42:01.786776 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:01.786753    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5m6rc"]
Sep 19 10:42:01.788413 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:42:01.788373    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33be66ee_3b51_47ee_863e_05eae657a05d.slice/crio-8208f0da64278e0fe81f36aa2694e510b572ab1d2ca4f897a6092325127fc7f4 WatchSource:0}: Error finding container 8208f0da64278e0fe81f36aa2694e510b572ab1d2ca4f897a6092325127fc7f4: Status 404 returned error can't find the container with id 8208f0da64278e0fe81f36aa2694e510b572ab1d2ca4f897a6092325127fc7f4
Sep 19 10:42:02.049028 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:02.048967    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-btl4h"]
Sep 19 10:42:02.053874 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:02.053855    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h"
Sep 19 10:42:02.056058 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:02.056039    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dq945\""
Sep 19 10:42:02.058850 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:02.058828    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-btl4h"]
Sep 19 10:42:02.082346 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:02.082323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggqtb\" (UniqueName: \"kubernetes.io/projected/643773af-67f0-4a30-b5e0-0398dd8366ad-kube-api-access-ggqtb\") pod \"authorino-7bcfd8f9cd-btl4h\" (UID: \"643773af-67f0-4a30-b5e0-0398dd8366ad\") " pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h"
Sep 19 10:42:02.183597 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:02.183569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqtb\" (UniqueName: \"kubernetes.io/projected/643773af-67f0-4a30-b5e0-0398dd8366ad-kube-api-access-ggqtb\") pod \"authorino-7bcfd8f9cd-btl4h\" (UID: \"643773af-67f0-4a30-b5e0-0398dd8366ad\") " pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h"
Sep 19 10:42:02.191354 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:02.191328    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggqtb\" (UniqueName: \"kubernetes.io/projected/643773af-67f0-4a30-b5e0-0398dd8366ad-kube-api-access-ggqtb\") pod \"authorino-7bcfd8f9cd-btl4h\" (UID: \"643773af-67f0-4a30-b5e0-0398dd8366ad\") " pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h"
Sep 19 10:42:02.210131 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:02.210105    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5m6rc" event={"ID":"33be66ee-3b51-47ee-863e-05eae657a05d","Type":"ContainerStarted","Data":"8208f0da64278e0fe81f36aa2694e510b572ab1d2ca4f897a6092325127fc7f4"}
Sep 19 10:42:02.364514 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:02.364494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h"
Sep 19 10:42:02.635385 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:02.635135    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-btl4h"]
Sep 19 10:42:02.637803 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:42:02.637774    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod643773af_67f0_4a30_b5e0_0398dd8366ad.slice/crio-ff0cd844754f383411345aca1a96eca790454797660ad6ab0bb88ffbd2627f24 WatchSource:0}: Error finding container ff0cd844754f383411345aca1a96eca790454797660ad6ab0bb88ffbd2627f24: Status 404 returned error can't find the container with id ff0cd844754f383411345aca1a96eca790454797660ad6ab0bb88ffbd2627f24
Sep 19 10:42:03.216589 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:03.216554    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h" event={"ID":"643773af-67f0-4a30-b5e0-0398dd8366ad","Type":"ContainerStarted","Data":"ff0cd844754f383411345aca1a96eca790454797660ad6ab0bb88ffbd2627f24"}
Sep 19 10:42:04.222939 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:04.222913    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h" event={"ID":"643773af-67f0-4a30-b5e0-0398dd8366ad","Type":"ContainerStarted","Data":"53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183"}
Sep 19 10:42:04.240811 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:04.240750    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h" podStartSLOduration=0.717419214 podStartE2EDuration="2.240713435s" totalImagesPullingTime="1.523294221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:42:04.239957976 +0000 UTC m=+447.139147897" watchObservedRunningTime="2026-09-19 10:42:04.240713435 +0000 UTC m=+447.139903327"
Sep 19 10:42:06.149896 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:06.149863    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-btl4h"]
Sep 19 10:42:06.233077 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:06.233037    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h" podUID="643773af-67f0-4a30-b5e0-0398dd8366ad" containerName="authorino" containerID="cri-o://53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183" gracePeriod=30
Sep 19 10:42:06.470540 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:06.470518    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h"
Sep 19 10:42:06.518664 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:06.518632    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggqtb\" (UniqueName: \"kubernetes.io/projected/643773af-67f0-4a30-b5e0-0398dd8366ad-kube-api-access-ggqtb\") pod \"643773af-67f0-4a30-b5e0-0398dd8366ad\" (UID: \"643773af-67f0-4a30-b5e0-0398dd8366ad\") "
Sep 19 10:42:06.520430 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:06.520409    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/643773af-67f0-4a30-b5e0-0398dd8366ad-kube-api-access-ggqtb" (OuterVolumeSpecName: "kube-api-access-ggqtb") pod "643773af-67f0-4a30-b5e0-0398dd8366ad" (UID: "643773af-67f0-4a30-b5e0-0398dd8366ad"). InnerVolumeSpecName "kube-api-access-ggqtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:42:06.619538 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:06.619519    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggqtb\" (UniqueName: \"kubernetes.io/projected/643773af-67f0-4a30-b5e0-0398dd8366ad-kube-api-access-ggqtb\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:42:07.238451 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:07.238421    2579 generic.go:356] "Generic (PLEG): container finished" podID="643773af-67f0-4a30-b5e0-0398dd8366ad" containerID="53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183" exitCode=0
Sep 19 10:42:07.238814 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:07.238457    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h"
Sep 19 10:42:07.238814 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:07.238511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h" event={"ID":"643773af-67f0-4a30-b5e0-0398dd8366ad","Type":"ContainerDied","Data":"53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183"}
Sep 19 10:42:07.238814 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:07.238551    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-btl4h" event={"ID":"643773af-67f0-4a30-b5e0-0398dd8366ad","Type":"ContainerDied","Data":"ff0cd844754f383411345aca1a96eca790454797660ad6ab0bb88ffbd2627f24"}
Sep 19 10:42:07.238814 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:07.238568    2579 scope.go:117] "RemoveContainer" containerID="53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183"
Sep 19 10:42:07.240389 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:07.240363    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5m6rc" event={"ID":"33be66ee-3b51-47ee-863e-05eae657a05d","Type":"ContainerStarted","Data":"a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055"}
Sep 19 10:42:07.240574 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:07.240550    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-5m6rc"
Sep 19 10:42:07.246179 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:07.246160    2579 scope.go:117] "RemoveContainer" containerID="53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183"
Sep 19 10:42:07.246425 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:42:07.246407    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183\": container with ID starting with 53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183 not found: ID does not exist" containerID="53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183"
Sep 19 10:42:07.246468 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:07.246432    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183"} err="failed to get container status \"53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183\": rpc error: code = NotFound desc = could not find container \"53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183\": container with ID starting with 53b60621efaa3ccecffe5f163421e828f7982573223455c646ecb3b66fb6c183 not found: ID does not exist"
Sep 19 10:42:07.267009 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:07.263821    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-5m6rc" podStartSLOduration=1.001598511 podStartE2EDuration="6.263791699s" totalImagesPullingTime="5.262193188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:42:07.260674629 +0000 UTC m=+450.159864525" watchObservedRunningTime="2026-09-19 10:42:07.263791699 +0000 UTC m=+450.162981613"
Sep 19 10:42:07.276782 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:07.276762    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-btl4h"]
Sep 19 10:42:07.280443 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:07.280424    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-btl4h"]
Sep 19 10:42:09.202773 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:09.202716    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="643773af-67f0-4a30-b5e0-0398dd8366ad" path="/var/lib/kubelet/pods/643773af-67f0-4a30-b5e0-0398dd8366ad/volumes"
Sep 19 10:42:17.155077 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:17.155039    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5m6rc"]
Sep 19 10:42:17.155649 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:17.155273    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-5m6rc" podUID="33be66ee-3b51-47ee-863e-05eae657a05d" containerName="limitador" containerID="cri-o://a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055" gracePeriod=30
Sep 19 10:42:17.157641 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:17.157602    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-5m6rc"
Sep 19 10:42:17.689809 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:17.689779    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5m6rc"
Sep 19 10:42:17.802249 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:17.802224    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33be66ee-3b51-47ee-863e-05eae657a05d-config-file\") pod \"33be66ee-3b51-47ee-863e-05eae657a05d\" (UID: \"33be66ee-3b51-47ee-863e-05eae657a05d\") "
Sep 19 10:42:17.802396 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:17.802316    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftbcn\" (UniqueName: \"kubernetes.io/projected/33be66ee-3b51-47ee-863e-05eae657a05d-kube-api-access-ftbcn\") pod \"33be66ee-3b51-47ee-863e-05eae657a05d\" (UID: \"33be66ee-3b51-47ee-863e-05eae657a05d\") "
Sep 19 10:42:17.802553 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:17.802531    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33be66ee-3b51-47ee-863e-05eae657a05d-config-file" (OuterVolumeSpecName: "config-file") pod "33be66ee-3b51-47ee-863e-05eae657a05d" (UID: "33be66ee-3b51-47ee-863e-05eae657a05d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:42:17.804210 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:17.804186    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33be66ee-3b51-47ee-863e-05eae657a05d-kube-api-access-ftbcn" (OuterVolumeSpecName: "kube-api-access-ftbcn") pod "33be66ee-3b51-47ee-863e-05eae657a05d" (UID: "33be66ee-3b51-47ee-863e-05eae657a05d"). InnerVolumeSpecName "kube-api-access-ftbcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:42:17.902817 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:17.902791    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33be66ee-3b51-47ee-863e-05eae657a05d-config-file\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:42:17.902817 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:17.902816    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftbcn\" (UniqueName: \"kubernetes.io/projected/33be66ee-3b51-47ee-863e-05eae657a05d-kube-api-access-ftbcn\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:42:18.296657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:18.296555    2579 generic.go:356] "Generic (PLEG): container finished" podID="33be66ee-3b51-47ee-863e-05eae657a05d" containerID="a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055" exitCode=0
Sep 19 10:42:18.296657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:18.296615    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5m6rc"
Sep 19 10:42:18.297249 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:18.296658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5m6rc" event={"ID":"33be66ee-3b51-47ee-863e-05eae657a05d","Type":"ContainerDied","Data":"a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055"}
Sep 19 10:42:18.297249 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:18.296740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5m6rc" event={"ID":"33be66ee-3b51-47ee-863e-05eae657a05d","Type":"ContainerDied","Data":"8208f0da64278e0fe81f36aa2694e510b572ab1d2ca4f897a6092325127fc7f4"}
Sep 19 10:42:18.297249 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:18.296781    2579 scope.go:117] "RemoveContainer" containerID="a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055"
Sep 19 10:42:18.306412 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:18.306387    2579 scope.go:117] "RemoveContainer" containerID="a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055"
Sep 19 10:42:18.306684 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:42:18.306668    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055\": container with ID starting with a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055 not found: ID does not exist" containerID="a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055"
Sep 19 10:42:18.306744 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:18.306692    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055"} err="failed to get container status \"a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055\": rpc error: code = NotFound desc = could not find container \"a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055\": container with ID starting with a22e86312c6f1d26f29aa9970829231de5b095e42839027b1bcb33ffdb0ad055 not found: ID does not exist"
Sep 19 10:42:18.318419 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:18.318386    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5m6rc"]
Sep 19 10:42:18.324611 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:18.324587    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5m6rc"]
Sep 19 10:42:19.203180 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:19.203147    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33be66ee-3b51-47ee-863e-05eae657a05d" path="/var/lib/kubelet/pods/33be66ee-3b51-47ee-863e-05eae657a05d/volumes"
Sep 19 10:42:22.860244 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.860201    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"]
Sep 19 10:42:22.860636 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.860586    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33be66ee-3b51-47ee-863e-05eae657a05d" containerName="limitador"
Sep 19 10:42:22.860636 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.860599    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="33be66ee-3b51-47ee-863e-05eae657a05d" containerName="limitador"
Sep 19 10:42:22.860636 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.860612    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="643773af-67f0-4a30-b5e0-0398dd8366ad" containerName="authorino"
Sep 19 10:42:22.860636 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.860618    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="643773af-67f0-4a30-b5e0-0398dd8366ad" containerName="authorino"
Sep 19 10:42:22.860801 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.860681    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="643773af-67f0-4a30-b5e0-0398dd8366ad" containerName="authorino"
Sep 19 10:42:22.860801 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.860693    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="33be66ee-3b51-47ee-863e-05eae657a05d" containerName="limitador"
Sep 19 10:42:22.865192 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.865165    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"
Sep 19 10:42:22.867814 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.867786    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 10:42:22.867949 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.867816    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 19 10:42:22.868538 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.868515    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 19 10:42:22.868653 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.868549    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-nlfhf\""
Sep 19 10:42:22.878429 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.878395    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"]
Sep 19 10:42:22.938326 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.938298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ad3b5958-b13e-44c2-ab84-e9f0ac877e97-data\") pod \"postgres-69fb4594cf-56dr7\" (UID: \"ad3b5958-b13e-44c2-ab84-e9f0ac877e97\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"
Sep 19 10:42:22.938452 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:22.938334    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5b6d\" (UniqueName: \"kubernetes.io/projected/ad3b5958-b13e-44c2-ab84-e9f0ac877e97-kube-api-access-k5b6d\") pod \"postgres-69fb4594cf-56dr7\" (UID: \"ad3b5958-b13e-44c2-ab84-e9f0ac877e97\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"
Sep 19 10:42:23.038793 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:23.038765    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ad3b5958-b13e-44c2-ab84-e9f0ac877e97-data\") pod \"postgres-69fb4594cf-56dr7\" (UID: \"ad3b5958-b13e-44c2-ab84-e9f0ac877e97\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"
Sep 19 10:42:23.038924 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:23.038806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5b6d\" (UniqueName: \"kubernetes.io/projected/ad3b5958-b13e-44c2-ab84-e9f0ac877e97-kube-api-access-k5b6d\") pod \"postgres-69fb4594cf-56dr7\" (UID: \"ad3b5958-b13e-44c2-ab84-e9f0ac877e97\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"
Sep 19 10:42:23.039219 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:23.039202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ad3b5958-b13e-44c2-ab84-e9f0ac877e97-data\") pod \"postgres-69fb4594cf-56dr7\" (UID: \"ad3b5958-b13e-44c2-ab84-e9f0ac877e97\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"
Sep 19 10:42:23.047222 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:23.047195    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5b6d\" (UniqueName: \"kubernetes.io/projected/ad3b5958-b13e-44c2-ab84-e9f0ac877e97-kube-api-access-k5b6d\") pod \"postgres-69fb4594cf-56dr7\" (UID: \"ad3b5958-b13e-44c2-ab84-e9f0ac877e97\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"
Sep 19 10:42:23.176159 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:23.176106    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"
Sep 19 10:42:23.445669 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:23.445593    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"]
Sep 19 10:42:23.449030 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:42:23.449006    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3b5958_b13e_44c2_ab84_e9f0ac877e97.slice/crio-8b0009520793226177a82e1aa6aa712d44f3f37395cc6c631dda384e7c5d8633 WatchSource:0}: Error finding container 8b0009520793226177a82e1aa6aa712d44f3f37395cc6c631dda384e7c5d8633: Status 404 returned error can't find the container with id 8b0009520793226177a82e1aa6aa712d44f3f37395cc6c631dda384e7c5d8633
Sep 19 10:42:24.331487 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:24.331430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7" event={"ID":"ad3b5958-b13e-44c2-ab84-e9f0ac877e97","Type":"ContainerStarted","Data":"8b0009520793226177a82e1aa6aa712d44f3f37395cc6c631dda384e7c5d8633"}
Sep 19 10:42:28.354167 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:28.354128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7" event={"ID":"ad3b5958-b13e-44c2-ab84-e9f0ac877e97","Type":"ContainerStarted","Data":"2a92fa6d0815efd9e3dbdf5aa9fe4e4b23800e6eee329935daac6dee2a5ad6a0"}
Sep 19 10:42:28.354576 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:28.354205    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"
Sep 19 10:42:28.371712 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:28.371672    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7" podStartSLOduration=1.879472288 podStartE2EDuration="6.371659735s" totalImagesPullingTime="4.492187447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:42:28.370257883 +0000 UTC m=+471.269447775" watchObservedRunningTime="2026-09-19 10:42:28.371659735 +0000 UTC m=+471.270849627"
Sep 19 10:42:34.390288 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:34.390254    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-56dr7"
Sep 19 10:42:34.920851 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:34.920818    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-w4r8k"]
Sep 19 10:42:34.925833 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:34.925814    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-w4r8k"
Sep 19 10:42:34.929524 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:34.929508    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dq945\""
Sep 19 10:42:34.932947 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:34.932922    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-w4r8k"]
Sep 19 10:42:34.984912 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:34.984883    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-w4r8k"]
Sep 19 10:42:34.985110 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:42:34.985089    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-f8lcn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-w4r8k" podUID="f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee"
Sep 19 10:42:35.011408 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.011386    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-pwjsd"]
Sep 19 10:42:35.013917 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.013901    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-pwjsd"
Sep 19 10:42:35.016059 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.016042    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 19 10:42:35.021718 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.021699    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-pwjsd"]
Sep 19 10:42:35.035226 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.035202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8lcn\" (UniqueName: \"kubernetes.io/projected/f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee-kube-api-access-f8lcn\") pod \"authorino-557f876f69-w4r8k\" (UID: \"f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee\") " pod="kuadrant-system/authorino-557f876f69-w4r8k"
Sep 19 10:42:35.135659 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.135633    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c43b4053-e0d9-4b81-aaff-77b4d9691f03-tls-cert\") pod \"authorino-6d4dfc649f-pwjsd\" (UID: \"c43b4053-e0d9-4b81-aaff-77b4d9691f03\") " pod="kuadrant-system/authorino-6d4dfc649f-pwjsd"
Sep 19 10:42:35.135783 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.135670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbj6d\" (UniqueName: \"kubernetes.io/projected/c43b4053-e0d9-4b81-aaff-77b4d9691f03-kube-api-access-zbj6d\") pod \"authorino-6d4dfc649f-pwjsd\" (UID: \"c43b4053-e0d9-4b81-aaff-77b4d9691f03\") " pod="kuadrant-system/authorino-6d4dfc649f-pwjsd"
Sep 19 10:42:35.135856 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.135789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8lcn\" (UniqueName: \"kubernetes.io/projected/f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee-kube-api-access-f8lcn\") pod \"authorino-557f876f69-w4r8k\" (UID: \"f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee\") " pod="kuadrant-system/authorino-557f876f69-w4r8k"
Sep 19 10:42:35.143705 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.143684    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8lcn\" (UniqueName: \"kubernetes.io/projected/f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee-kube-api-access-f8lcn\") pod \"authorino-557f876f69-w4r8k\" (UID: \"f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee\") " pod="kuadrant-system/authorino-557f876f69-w4r8k"
Sep 19 10:42:35.155328 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.155309    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-pwjsd"]
Sep 19 10:42:35.155507 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:42:35.155490    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zbj6d tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-pwjsd" podUID="c43b4053-e0d9-4b81-aaff-77b4d9691f03"
Sep 19 10:42:35.182861 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.182811    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77dc4d45fb-k4rjc"]
Sep 19 10:42:35.185359 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.185344    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77dc4d45fb-k4rjc"
Sep 19 10:42:35.193863 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.193844    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77dc4d45fb-k4rjc"]
Sep 19 10:42:35.236995 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.236973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbj6d\" (UniqueName: \"kubernetes.io/projected/c43b4053-e0d9-4b81-aaff-77b4d9691f03-kube-api-access-zbj6d\") pod \"authorino-6d4dfc649f-pwjsd\" (UID: \"c43b4053-e0d9-4b81-aaff-77b4d9691f03\") " pod="kuadrant-system/authorino-6d4dfc649f-pwjsd"
Sep 19 10:42:35.237089 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.237075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c43b4053-e0d9-4b81-aaff-77b4d9691f03-tls-cert\") pod \"authorino-6d4dfc649f-pwjsd\" (UID: \"c43b4053-e0d9-4b81-aaff-77b4d9691f03\") " pod="kuadrant-system/authorino-6d4dfc649f-pwjsd"
Sep 19 10:42:35.239331 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.239314    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c43b4053-e0d9-4b81-aaff-77b4d9691f03-tls-cert\") pod \"authorino-6d4dfc649f-pwjsd\" (UID: \"c43b4053-e0d9-4b81-aaff-77b4d9691f03\") " pod="kuadrant-system/authorino-6d4dfc649f-pwjsd"
Sep 19 10:42:35.244830 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.244803    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbj6d\" (UniqueName: \"kubernetes.io/projected/c43b4053-e0d9-4b81-aaff-77b4d9691f03-kube-api-access-zbj6d\") pod \"authorino-6d4dfc649f-pwjsd\" (UID: \"c43b4053-e0d9-4b81-aaff-77b4d9691f03\") " pod="kuadrant-system/authorino-6d4dfc649f-pwjsd"
Sep 19 10:42:35.337625 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.337600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e27e22de-d816-42a5-98dd-2f4e227bd431-tls-cert\") pod \"authorino-77dc4d45fb-k4rjc\" (UID: \"e27e22de-d816-42a5-98dd-2f4e227bd431\") " pod="kuadrant-system/authorino-77dc4d45fb-k4rjc"
Sep 19 10:42:35.337756 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.337687    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2n4b\" (UniqueName: \"kubernetes.io/projected/e27e22de-d816-42a5-98dd-2f4e227bd431-kube-api-access-x2n4b\") pod \"authorino-77dc4d45fb-k4rjc\" (UID: \"e27e22de-d816-42a5-98dd-2f4e227bd431\") " pod="kuadrant-system/authorino-77dc4d45fb-k4rjc"
Sep 19 10:42:35.386622 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.386599    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-pwjsd"
Sep 19 10:42:35.386708 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.386601    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-w4r8k"
Sep 19 10:42:35.393013 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.392996    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-pwjsd"
Sep 19 10:42:35.396053 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.396036    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-w4r8k"
Sep 19 10:42:35.438564 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.438518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2n4b\" (UniqueName: \"kubernetes.io/projected/e27e22de-d816-42a5-98dd-2f4e227bd431-kube-api-access-x2n4b\") pod \"authorino-77dc4d45fb-k4rjc\" (UID: \"e27e22de-d816-42a5-98dd-2f4e227bd431\") " pod="kuadrant-system/authorino-77dc4d45fb-k4rjc"
Sep 19 10:42:35.438564 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.438556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e27e22de-d816-42a5-98dd-2f4e227bd431-tls-cert\") pod \"authorino-77dc4d45fb-k4rjc\" (UID: \"e27e22de-d816-42a5-98dd-2f4e227bd431\") " pod="kuadrant-system/authorino-77dc4d45fb-k4rjc"
Sep 19 10:42:35.440829 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.440811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e27e22de-d816-42a5-98dd-2f4e227bd431-tls-cert\") pod \"authorino-77dc4d45fb-k4rjc\" (UID: \"e27e22de-d816-42a5-98dd-2f4e227bd431\") " pod="kuadrant-system/authorino-77dc4d45fb-k4rjc"
Sep 19 10:42:35.446435 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.446414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2n4b\" (UniqueName: \"kubernetes.io/projected/e27e22de-d816-42a5-98dd-2f4e227bd431-kube-api-access-x2n4b\") pod \"authorino-77dc4d45fb-k4rjc\" (UID: \"e27e22de-d816-42a5-98dd-2f4e227bd431\") " pod="kuadrant-system/authorino-77dc4d45fb-k4rjc"
Sep 19 10:42:35.494878 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.494859    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77dc4d45fb-k4rjc"
Sep 19 10:42:35.539106 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.539079    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbj6d\" (UniqueName: \"kubernetes.io/projected/c43b4053-e0d9-4b81-aaff-77b4d9691f03-kube-api-access-zbj6d\") pod \"c43b4053-e0d9-4b81-aaff-77b4d9691f03\" (UID: \"c43b4053-e0d9-4b81-aaff-77b4d9691f03\") "
Sep 19 10:42:35.539274 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.539142    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c43b4053-e0d9-4b81-aaff-77b4d9691f03-tls-cert\") pod \"c43b4053-e0d9-4b81-aaff-77b4d9691f03\" (UID: \"c43b4053-e0d9-4b81-aaff-77b4d9691f03\") "
Sep 19 10:42:35.539274 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.539252    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8lcn\" (UniqueName: \"kubernetes.io/projected/f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee-kube-api-access-f8lcn\") pod \"f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee\" (UID: \"f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee\") "
Sep 19 10:42:35.541927 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.541591    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c43b4053-e0d9-4b81-aaff-77b4d9691f03-kube-api-access-zbj6d" (OuterVolumeSpecName: "kube-api-access-zbj6d") pod "c43b4053-e0d9-4b81-aaff-77b4d9691f03" (UID: "c43b4053-e0d9-4b81-aaff-77b4d9691f03"). InnerVolumeSpecName "kube-api-access-zbj6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:42:35.542100 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.542070    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c43b4053-e0d9-4b81-aaff-77b4d9691f03-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c43b4053-e0d9-4b81-aaff-77b4d9691f03" (UID: "c43b4053-e0d9-4b81-aaff-77b4d9691f03"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:42:35.542953 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.542903    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee-kube-api-access-f8lcn" (OuterVolumeSpecName: "kube-api-access-f8lcn") pod "f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee" (UID: "f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee"). InnerVolumeSpecName "kube-api-access-f8lcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:42:35.640312 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.640288    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8lcn\" (UniqueName: \"kubernetes.io/projected/f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee-kube-api-access-f8lcn\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:42:35.640312 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.640311    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbj6d\" (UniqueName: \"kubernetes.io/projected/c43b4053-e0d9-4b81-aaff-77b4d9691f03-kube-api-access-zbj6d\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:42:35.640462 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.640321    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c43b4053-e0d9-4b81-aaff-77b4d9691f03-tls-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:42:35.761411 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:35.761390    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77dc4d45fb-k4rjc"]
Sep 19 10:42:35.763854 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:42:35.763832    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode27e22de_d816_42a5_98dd_2f4e227bd431.slice/crio-48c66554ecd2fe4ecfe456446fda5d66d1afdcdaff7940949cf3868c4ec46e44 WatchSource:0}: Error finding container 48c66554ecd2fe4ecfe456446fda5d66d1afdcdaff7940949cf3868c4ec46e44: Status 404 returned error can't find the container with id 48c66554ecd2fe4ecfe456446fda5d66d1afdcdaff7940949cf3868c4ec46e44
Sep 19 10:42:36.392875 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:36.392833    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77dc4d45fb-k4rjc" event={"ID":"e27e22de-d816-42a5-98dd-2f4e227bd431","Type":"ContainerStarted","Data":"3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb"}
Sep 19 10:42:36.392875 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:36.392880    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77dc4d45fb-k4rjc" event={"ID":"e27e22de-d816-42a5-98dd-2f4e227bd431","Type":"ContainerStarted","Data":"48c66554ecd2fe4ecfe456446fda5d66d1afdcdaff7940949cf3868c4ec46e44"}
Sep 19 10:42:36.393395 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:36.392886    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-w4r8k"
Sep 19 10:42:36.393395 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:36.392880    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-pwjsd"
Sep 19 10:42:36.409379 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:36.409310    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77dc4d45fb-k4rjc" podStartSLOduration=0.942806006 podStartE2EDuration="1.409297806s" totalImagesPullingTime="466.4918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:42:36.407772244 +0000 UTC m=+479.306962137" watchObservedRunningTime="2026-09-19 10:42:36.409297806 +0000 UTC m=+479.308487697"
Sep 19 10:42:36.430474 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:36.430450    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-w4r8k"]
Sep 19 10:42:36.437641 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:36.437621    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-w4r8k"]
Sep 19 10:42:36.461856 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:36.461821    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-pwjsd"]
Sep 19 10:42:36.467222 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:36.467202    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-pwjsd"]
Sep 19 10:42:37.202696 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:37.202662    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c43b4053-e0d9-4b81-aaff-77b4d9691f03" path="/var/lib/kubelet/pods/c43b4053-e0d9-4b81-aaff-77b4d9691f03/volumes"
Sep 19 10:42:37.202947 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:37.202931    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee" path="/var/lib/kubelet/pods/f2dfbafb-eaa4-42d6-9579-4c0b1d0925ee/volumes"
Sep 19 10:42:41.167187 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.167151    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7884b58df-qm4wq"]
Sep 19 10:42:41.173392 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.173372    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:41.176072 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.176046    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 19 10:42:41.176180 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.176049    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7vkjd\""
Sep 19 10:42:41.176180 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.176076    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 19 10:42:41.176180 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.176084    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 19 10:42:41.181533 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.181469    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7884b58df-qm4wq"]
Sep 19 10:42:41.287543 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.287519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-metrics-certs\") pod \"maas-controller-7884b58df-qm4wq\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") " pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:41.287676 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.287572    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwnkj\" (UniqueName: \"kubernetes.io/projected/58038854-2e12-4a4e-8e41-39578f656618-kube-api-access-pwnkj\") pod \"maas-controller-7884b58df-qm4wq\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") " pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:41.287676 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.287611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-webhook-cert\") pod \"maas-controller-7884b58df-qm4wq\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") " pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:41.342319 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.342295    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-6nrs7"]
Sep 19 10:42:41.346574 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.346556    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:41.354385 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.354363    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-6nrs7"]
Sep 19 10:42:41.388452 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.388423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-metrics-certs\") pod \"maas-controller-7884b58df-qm4wq\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") " pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:41.388559 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.388480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwnkj\" (UniqueName: \"kubernetes.io/projected/58038854-2e12-4a4e-8e41-39578f656618-kube-api-access-pwnkj\") pod \"maas-controller-7884b58df-qm4wq\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") " pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:41.388559 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.388519    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-webhook-cert\") pod \"maas-controller-7884b58df-qm4wq\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") " pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:41.388673 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:42:41.388571    2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 19 10:42:41.388673 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:42:41.388624    2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 19 10:42:41.388673 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:42:41.388631    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-metrics-certs podName:58038854-2e12-4a4e-8e41-39578f656618 nodeName:}" failed. No retries permitted until 2026-09-19 10:42:41.888612359 +0000 UTC m=+484.787802239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-metrics-certs") pod "maas-controller-7884b58df-qm4wq" (UID: "58038854-2e12-4a4e-8e41-39578f656618") : secret "maas-controller-metrics-tls" not found
Sep 19 10:42:41.388673 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:42:41.388656    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-webhook-cert podName:58038854-2e12-4a4e-8e41-39578f656618 nodeName:}" failed. No retries permitted until 2026-09-19 10:42:41.888646649 +0000 UTC m=+484.787836533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-webhook-cert") pod "maas-controller-7884b58df-qm4wq" (UID: "58038854-2e12-4a4e-8e41-39578f656618") : secret "maas-controller-webhook-cert" not found
Sep 19 10:42:41.397634 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.397612    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwnkj\" (UniqueName: \"kubernetes.io/projected/58038854-2e12-4a4e-8e41-39578f656618-kube-api-access-pwnkj\") pod \"maas-controller-7884b58df-qm4wq\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") " pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:41.489519 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.489474    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-webhook-cert\") pod \"maas-controller-bb96ff4f5-6nrs7\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") " pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:41.489611 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.489528    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-metrics-certs\") pod \"maas-controller-bb96ff4f5-6nrs7\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") " pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:41.489650 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.489608    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wlc6\" (UniqueName: \"kubernetes.io/projected/7a07d545-eef1-410a-ae73-b90a5eddad1c-kube-api-access-6wlc6\") pod \"maas-controller-bb96ff4f5-6nrs7\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") " pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:41.590120 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.590100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wlc6\" (UniqueName: \"kubernetes.io/projected/7a07d545-eef1-410a-ae73-b90a5eddad1c-kube-api-access-6wlc6\") pod \"maas-controller-bb96ff4f5-6nrs7\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") " pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:41.590208 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.590131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-webhook-cert\") pod \"maas-controller-bb96ff4f5-6nrs7\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") " pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:41.590208 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.590178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-metrics-certs\") pod \"maas-controller-bb96ff4f5-6nrs7\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") " pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:41.590351 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:42:41.590333    2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 19 10:42:41.590422 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:42:41.590406    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-webhook-cert podName:7a07d545-eef1-410a-ae73-b90a5eddad1c nodeName:}" failed. No retries permitted until 2026-09-19 10:42:42.090381435 +0000 UTC m=+484.989571319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-webhook-cert") pod "maas-controller-bb96ff4f5-6nrs7" (UID: "7a07d545-eef1-410a-ae73-b90a5eddad1c") : secret "maas-controller-webhook-cert" not found
Sep 19 10:42:41.592328 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.592309    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-metrics-certs\") pod \"maas-controller-bb96ff4f5-6nrs7\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") " pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:41.599139 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.599120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wlc6\" (UniqueName: \"kubernetes.io/projected/7a07d545-eef1-410a-ae73-b90a5eddad1c-kube-api-access-6wlc6\") pod \"maas-controller-bb96ff4f5-6nrs7\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") " pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:41.892111 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.892085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-webhook-cert\") pod \"maas-controller-7884b58df-qm4wq\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") " pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:41.892216 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.892137    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-metrics-certs\") pod \"maas-controller-7884b58df-qm4wq\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") " pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:41.894247 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.894221    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-webhook-cert\") pod \"maas-controller-7884b58df-qm4wq\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") " pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:41.894374 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:41.894357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-metrics-certs\") pod \"maas-controller-7884b58df-qm4wq\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") " pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:42.087141 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:42.087115    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:42.093425 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:42.093410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-webhook-cert\") pod \"maas-controller-bb96ff4f5-6nrs7\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") " pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:42.102475 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:42.102452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-webhook-cert\") pod \"maas-controller-bb96ff4f5-6nrs7\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") " pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:42.258330 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:42.258265    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:42.358928 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:42.358902    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7884b58df-qm4wq"]
Sep 19 10:42:42.360744 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:42:42.360707    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58038854_2e12_4a4e_8e41_39578f656618.slice/crio-7ef14c16402f4fc2e9d5dc3845464aa7e6321d719abb3ad18c5879dfc18f9494 WatchSource:0}: Error finding container 7ef14c16402f4fc2e9d5dc3845464aa7e6321d719abb3ad18c5879dfc18f9494: Status 404 returned error can't find the container with id 7ef14c16402f4fc2e9d5dc3845464aa7e6321d719abb3ad18c5879dfc18f9494
Sep 19 10:42:42.422532 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:42.422505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7884b58df-qm4wq" event={"ID":"58038854-2e12-4a4e-8e41-39578f656618","Type":"ContainerStarted","Data":"7ef14c16402f4fc2e9d5dc3845464aa7e6321d719abb3ad18c5879dfc18f9494"}
Sep 19 10:42:42.528285 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:42.528228    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-6nrs7"]
Sep 19 10:42:42.530703 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:42:42.530675    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a07d545_eef1_410a_ae73_b90a5eddad1c.slice/crio-464ff38fc5a8baf8c3c104276f0ea93a15947ee72d980514d7a771f0752a8f8f WatchSource:0}: Error finding container 464ff38fc5a8baf8c3c104276f0ea93a15947ee72d980514d7a771f0752a8f8f: Status 404 returned error can't find the container with id 464ff38fc5a8baf8c3c104276f0ea93a15947ee72d980514d7a771f0752a8f8f
Sep 19 10:42:43.430669 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:43.430629    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96ff4f5-6nrs7" event={"ID":"7a07d545-eef1-410a-ae73-b90a5eddad1c","Type":"ContainerStarted","Data":"464ff38fc5a8baf8c3c104276f0ea93a15947ee72d980514d7a771f0752a8f8f"}
Sep 19 10:42:45.440644 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:45.440605    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96ff4f5-6nrs7" event={"ID":"7a07d545-eef1-410a-ae73-b90a5eddad1c","Type":"ContainerStarted","Data":"b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1"}
Sep 19 10:42:45.441124 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:45.440716    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:45.442333 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:45.442308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7884b58df-qm4wq" event={"ID":"58038854-2e12-4a4e-8e41-39578f656618","Type":"ContainerStarted","Data":"2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21"}
Sep 19 10:42:45.442437 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:45.442386    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:45.462375 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:45.462335    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bb96ff4f5-6nrs7" podStartSLOduration=2.062190841 podStartE2EDuration="4.462319369s" totalImagesPullingTime="2.400128528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:42:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:42:45.461625529 +0000 UTC m=+488.360815420" watchObservedRunningTime="2026-09-19 10:42:45.462319369 +0000 UTC m=+488.361509303"
Sep 19 10:42:45.488447 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:45.488408    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7884b58df-qm4wq" podStartSLOduration=1.92800495 podStartE2EDuration="4.488395486s" totalImagesPullingTime="2.560390536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:42:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:42:45.486444571 +0000 UTC m=+488.385634464" watchObservedRunningTime="2026-09-19 10:42:45.488395486 +0000 UTC m=+488.387585384"
Sep 19 10:42:56.448144 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:56.448105    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:56.448541 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:56.448186    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 10:42:56.516205 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:56.516174    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7884b58df-qm4wq"]
Sep 19 10:42:56.516387 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:56.516360    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7884b58df-qm4wq" podUID="58038854-2e12-4a4e-8e41-39578f656618" containerName="manager" containerID="cri-o://2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21" gracePeriod=30
Sep 19 10:42:56.753712 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:56.753689    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:56.911625 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:56.911596    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-webhook-cert\") pod \"58038854-2e12-4a4e-8e41-39578f656618\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") "
Sep 19 10:42:56.911803 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:56.911632    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwnkj\" (UniqueName: \"kubernetes.io/projected/58038854-2e12-4a4e-8e41-39578f656618-kube-api-access-pwnkj\") pod \"58038854-2e12-4a4e-8e41-39578f656618\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") "
Sep 19 10:42:56.911803 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:56.911690    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-metrics-certs\") pod \"58038854-2e12-4a4e-8e41-39578f656618\" (UID: \"58038854-2e12-4a4e-8e41-39578f656618\") "
Sep 19 10:42:56.913964 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:56.913937    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58038854-2e12-4a4e-8e41-39578f656618-kube-api-access-pwnkj" (OuterVolumeSpecName: "kube-api-access-pwnkj") pod "58038854-2e12-4a4e-8e41-39578f656618" (UID: "58038854-2e12-4a4e-8e41-39578f656618"). InnerVolumeSpecName "kube-api-access-pwnkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:42:56.914079 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:56.913937    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "58038854-2e12-4a4e-8e41-39578f656618" (UID: "58038854-2e12-4a4e-8e41-39578f656618"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:42:56.914079 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:56.913987    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "58038854-2e12-4a4e-8e41-39578f656618" (UID: "58038854-2e12-4a4e-8e41-39578f656618"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:42:57.012419 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:57.012357    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-webhook-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:42:57.012419 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:57.012382    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwnkj\" (UniqueName: \"kubernetes.io/projected/58038854-2e12-4a4e-8e41-39578f656618-kube-api-access-pwnkj\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:42:57.012419 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:57.012392    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58038854-2e12-4a4e-8e41-39578f656618-metrics-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:42:57.501589 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:57.501562    2579 generic.go:356] "Generic (PLEG): container finished" podID="58038854-2e12-4a4e-8e41-39578f656618" containerID="2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21" exitCode=0
Sep 19 10:42:57.501972 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:57.501592    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7884b58df-qm4wq" event={"ID":"58038854-2e12-4a4e-8e41-39578f656618","Type":"ContainerDied","Data":"2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21"}
Sep 19 10:42:57.501972 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:57.501658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7884b58df-qm4wq" event={"ID":"58038854-2e12-4a4e-8e41-39578f656618","Type":"ContainerDied","Data":"7ef14c16402f4fc2e9d5dc3845464aa7e6321d719abb3ad18c5879dfc18f9494"}
Sep 19 10:42:57.501972 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:57.501615    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7884b58df-qm4wq"
Sep 19 10:42:57.501972 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:57.501681    2579 scope.go:117] "RemoveContainer" containerID="2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21"
Sep 19 10:42:57.509891 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:57.509873    2579 scope.go:117] "RemoveContainer" containerID="2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21"
Sep 19 10:42:57.510154 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:42:57.510132    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21\": container with ID starting with 2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21 not found: ID does not exist" containerID="2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21"
Sep 19 10:42:57.510200 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:57.510167    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21"} err="failed to get container status \"2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21\": rpc error: code = NotFound desc = could not find container \"2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21\": container with ID starting with 2b87bae68e6aab3894497b90d83554ae7f01725e89816162ede73bb2809d0f21 not found: ID does not exist"
Sep 19 10:42:57.527424 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:57.527399    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7884b58df-qm4wq"]
Sep 19 10:42:57.549900 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:57.549882    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7884b58df-qm4wq"]
Sep 19 10:42:59.201983 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:42:59.201949    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58038854-2e12-4a4e-8e41-39578f656618" path="/var/lib/kubelet/pods/58038854-2e12-4a4e-8e41-39578f656618/volumes"
Sep 19 10:43:18.654983 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.654953    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f47b4794c-9579x"]
Sep 19 10:43:18.655385 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.655307    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58038854-2e12-4a4e-8e41-39578f656618" containerName="manager"
Sep 19 10:43:18.655385 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.655318    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="58038854-2e12-4a4e-8e41-39578f656618" containerName="manager"
Sep 19 10:43:18.655460 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.655388    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="58038854-2e12-4a4e-8e41-39578f656618" containerName="manager"
Sep 19 10:43:18.675017 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.674993    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f47b4794c-9579x"]
Sep 19 10:43:18.675170 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.675102    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:18.678502 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.678479    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 19 10:43:18.678747 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.678532    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 19 10:43:18.678870 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.678575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8b2hp\""
Sep 19 10:43:18.770198 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.770171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720af5c5-dec6-49dd-b2e5-aef2b26459de-openshift-service-ca\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:18.770321 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.770210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-metrics-certs\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:18.770321 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.770299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n56br\" (UniqueName: \"kubernetes.io/projected/720af5c5-dec6-49dd-b2e5-aef2b26459de-kube-api-access-n56br\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:18.770442 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.770372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-maas-api-tls\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:18.871230 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.871203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-maas-api-tls\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:18.871351 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.871252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720af5c5-dec6-49dd-b2e5-aef2b26459de-openshift-service-ca\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:18.871351 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.871269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-metrics-certs\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:18.871466 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:43:18.871378    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 19 10:43:18.871466 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.871439    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n56br\" (UniqueName: \"kubernetes.io/projected/720af5c5-dec6-49dd-b2e5-aef2b26459de-kube-api-access-n56br\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:18.871466 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:43:18.871463    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-metrics-certs podName:720af5c5-dec6-49dd-b2e5-aef2b26459de nodeName:}" failed. No retries permitted until 2026-09-19 10:43:19.371441865 +0000 UTC m=+522.270631754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-metrics-certs") pod "maas-api-f47b4794c-9579x" (UID: "720af5c5-dec6-49dd-b2e5-aef2b26459de") : secret "maas-api-metrics-tls" not found
Sep 19 10:43:18.871970 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.871953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720af5c5-dec6-49dd-b2e5-aef2b26459de-openshift-service-ca\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:18.873750 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.873718    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-maas-api-tls\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:18.880343 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:18.880317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n56br\" (UniqueName: \"kubernetes.io/projected/720af5c5-dec6-49dd-b2e5-aef2b26459de-kube-api-access-n56br\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:19.051515 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.051485    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-78572"]
Sep 19 10:43:19.055152 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.055132    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572"
Sep 19 10:43:19.057470 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.057445    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 19 10:43:19.057569 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.057445    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pm2vd\""
Sep 19 10:43:19.068663 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.068638    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-78572"]
Sep 19 10:43:19.175329 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.175291    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skkjc\" (UniqueName: \"kubernetes.io/projected/d85185db-4731-4b45-b629-2bc4412c2bee-kube-api-access-skkjc\") pod \"payload-pre-processing-59fbc47bf8-78572\" (UID: \"d85185db-4731-4b45-b629-2bc4412c2bee\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572"
Sep 19 10:43:19.175519 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.175345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d85185db-4731-4b45-b629-2bc4412c2bee-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-78572\" (UID: \"d85185db-4731-4b45-b629-2bc4412c2bee\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572"
Sep 19 10:43:19.276016 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.275978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkjc\" (UniqueName: \"kubernetes.io/projected/d85185db-4731-4b45-b629-2bc4412c2bee-kube-api-access-skkjc\") pod \"payload-pre-processing-59fbc47bf8-78572\" (UID: \"d85185db-4731-4b45-b629-2bc4412c2bee\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572"
Sep 19 10:43:19.276181 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.276027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d85185db-4731-4b45-b629-2bc4412c2bee-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-78572\" (UID: \"d85185db-4731-4b45-b629-2bc4412c2bee\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572"
Sep 19 10:43:19.277568 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.277540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d85185db-4731-4b45-b629-2bc4412c2bee-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-78572\" (UID: \"d85185db-4731-4b45-b629-2bc4412c2bee\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572"
Sep 19 10:43:19.291385 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.291357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skkjc\" (UniqueName: \"kubernetes.io/projected/d85185db-4731-4b45-b629-2bc4412c2bee-kube-api-access-skkjc\") pod \"payload-pre-processing-59fbc47bf8-78572\" (UID: \"d85185db-4731-4b45-b629-2bc4412c2bee\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572"
Sep 19 10:43:19.367826 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.367737    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572"
Sep 19 10:43:19.377078 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.377052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-metrics-certs\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:19.379953 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.379925    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-metrics-certs\") pod \"maas-api-f47b4794c-9579x\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") " pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:19.588921 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.588882    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:19.641589 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.641561    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-78572"]
Sep 19 10:43:19.870436 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:19.870395    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f47b4794c-9579x"]
Sep 19 10:43:19.873172 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:43:19.873142    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720af5c5_dec6_49dd_b2e5_aef2b26459de.slice/crio-573f72a5a11fc472e409229bbb57d075a1106639490562ff1cac1c66da085527 WatchSource:0}: Error finding container 573f72a5a11fc472e409229bbb57d075a1106639490562ff1cac1c66da085527: Status 404 returned error can't find the container with id 573f72a5a11fc472e409229bbb57d075a1106639490562ff1cac1c66da085527
Sep 19 10:43:20.621742 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:20.621633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x" event={"ID":"720af5c5-dec6-49dd-b2e5-aef2b26459de","Type":"ContainerStarted","Data":"573f72a5a11fc472e409229bbb57d075a1106639490562ff1cac1c66da085527"}
Sep 19 10:43:20.623555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:20.623492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572" event={"ID":"d85185db-4731-4b45-b629-2bc4412c2bee","Type":"ContainerStarted","Data":"c6eed8eac5aa07683f9c756ea2abf8e0e4af318c9baed638629e46ac39746796"}
Sep 19 10:43:22.635857 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:22.635826    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x" event={"ID":"720af5c5-dec6-49dd-b2e5-aef2b26459de","Type":"ContainerStarted","Data":"910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d"}
Sep 19 10:43:22.636347 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:22.636032    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:22.637360 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:22.637337    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572" event={"ID":"d85185db-4731-4b45-b629-2bc4412c2bee","Type":"ContainerStarted","Data":"02797f8c7c3ff232e9822e51d88cfc53216d3fdce087d3c61af69732c73fab89"}
Sep 19 10:43:22.637484 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:22.637450    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572"
Sep 19 10:43:22.654013 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:22.653972    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x" podStartSLOduration=2.671241211 podStartE2EDuration="4.653958382s" totalImagesPullingTime="1.982717171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:43:22.652784831 +0000 UTC m=+525.551974725" watchObservedRunningTime="2026-09-19 10:43:22.653958382 +0000 UTC m=+525.553148275"
Sep 19 10:43:22.667694 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:22.667654    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572" podStartSLOduration=1.460271546 podStartE2EDuration="3.667642553s" totalImagesPullingTime="2.207371007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:43:22.667459536 +0000 UTC m=+525.566649428" watchObservedRunningTime="2026-09-19 10:43:22.667642553 +0000 UTC m=+525.566832445"
Sep 19 10:43:28.647451 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:28.647425    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 10:43:28.670190 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:28.670162    2579 generic.go:356] "Generic (PLEG): container finished" podID="35caa86b-d1ee-48fe-a901-9faa53de020c" containerID="f5da2f8b9056d4cc082b7c2c7d215b1319479f11831ad7e4618f3e818e3dafc1" exitCode=0
Sep 19 10:43:28.670329 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:28.670243    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk" event={"ID":"35caa86b-d1ee-48fe-a901-9faa53de020c","Type":"ContainerDied","Data":"f5da2f8b9056d4cc082b7c2c7d215b1319479f11831ad7e4618f3e818e3dafc1"}
Sep 19 10:43:28.670602 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:28.670587    2579 scope.go:117] "RemoveContainer" containerID="f5da2f8b9056d4cc082b7c2c7d215b1319479f11831ad7e4618f3e818e3dafc1"
Sep 19 10:43:28.671601 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:28.671570    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:43:28.671702 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:28.671652    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:43:28.671796 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:28.671704    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:43:29.677420 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:29.677381    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk" event={"ID":"35caa86b-d1ee-48fe-a901-9faa53de020c","Type":"ContainerStarted","Data":"cee8cdba9fa76e8586b7f4b05c2548205d5c5886c916e01bc12f29004d198954"}
Sep 19 10:43:29.868463 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:29.868427    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:43:29.869356 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:29.869333    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g4xvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 19 10:43:29.869424 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:29.869389    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk" podUID="35caa86b-d1ee-48fe-a901-9faa53de020c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 19 10:43:30.869191 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:30.869160    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g4xvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 19 10:43:30.869556 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:30.869220    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk" podUID="35caa86b-d1ee-48fe-a901-9faa53de020c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 19 10:43:31.206503 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:31.206400    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:43:31.868945 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:31.868907    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g4xvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 19 10:43:31.869144 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:31.868972    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk" podUID="35caa86b-d1ee-48fe-a901-9faa53de020c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 19 10:43:32.868941 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:32.868907    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g4xvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 19 10:43:32.869305 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:32.868959    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk" podUID="35caa86b-d1ee-48fe-a901-9faa53de020c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 19 10:43:33.644647 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:33.644616    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572"
Sep 19 10:43:33.868530 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:33.868493    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g4xvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 19 10:43:33.868698 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:33.868545    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk" podUID="35caa86b-d1ee-48fe-a901-9faa53de020c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 19 10:43:34.868925 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:34.868893    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g4xvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 19 10:43:34.869303 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:34.868948    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk" podUID="35caa86b-d1ee-48fe-a901-9faa53de020c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 19 10:43:35.872034 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:35.872004    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:43:35.873018 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:35.872995    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk"
Sep 19 10:43:46.046163 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.046134    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"]
Sep 19 10:43:46.049216 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.049199    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.052603 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.052577    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4rnbf\""
Sep 19 10:43:46.052742 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.052600    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 19 10:43:46.052742 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.052591    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 19 10:43:46.052742 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.052577    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 19 10:43:46.063961 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.063937    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"]
Sep 19 10:43:46.211503 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.211472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqgb7\" (UniqueName: \"kubernetes.io/projected/aa7f1917-4291-47d3-b736-09b95c6f97e5-kube-api-access-wqgb7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.211643 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.211530    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa7f1917-4291-47d3-b736-09b95c6f97e5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.211643 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.211557    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa7f1917-4291-47d3-b736-09b95c6f97e5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.211643 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.211579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa7f1917-4291-47d3-b736-09b95c6f97e5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.211801 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.211690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa7f1917-4291-47d3-b736-09b95c6f97e5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.211801 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.211754    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa7f1917-4291-47d3-b736-09b95c6f97e5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.312278 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.312248    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa7f1917-4291-47d3-b736-09b95c6f97e5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.312422 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.312289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa7f1917-4291-47d3-b736-09b95c6f97e5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.312422 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.312310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqgb7\" (UniqueName: \"kubernetes.io/projected/aa7f1917-4291-47d3-b736-09b95c6f97e5-kube-api-access-wqgb7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.312422 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.312339    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa7f1917-4291-47d3-b736-09b95c6f97e5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.312422 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.312357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa7f1917-4291-47d3-b736-09b95c6f97e5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.312422 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.312372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa7f1917-4291-47d3-b736-09b95c6f97e5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.312800 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.312778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa7f1917-4291-47d3-b736-09b95c6f97e5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.312879 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.312783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa7f1917-4291-47d3-b736-09b95c6f97e5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.312879 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.312830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa7f1917-4291-47d3-b736-09b95c6f97e5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.314615 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.314595    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa7f1917-4291-47d3-b736-09b95c6f97e5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.314882 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.314862    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa7f1917-4291-47d3-b736-09b95c6f97e5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.319756 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.319719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqgb7\" (UniqueName: \"kubernetes.io/projected/aa7f1917-4291-47d3-b736-09b95c6f97e5-kube-api-access-wqgb7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl\" (UID: \"aa7f1917-4291-47d3-b736-09b95c6f97e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.368564 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.368538    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:46.695841 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.695810    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"]
Sep 19 10:43:46.697854 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:43:46.697816    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7f1917_4291_47d3_b736_09b95c6f97e5.slice/crio-d78e1871cea791e2a23306b390f9436602cba6c9778c1f2a724e4f1d991a7707 WatchSource:0}: Error finding container d78e1871cea791e2a23306b390f9436602cba6c9778c1f2a724e4f1d991a7707: Status 404 returned error can't find the container with id d78e1871cea791e2a23306b390f9436602cba6c9778c1f2a724e4f1d991a7707
Sep 19 10:43:46.768578 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:46.768530    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl" event={"ID":"aa7f1917-4291-47d3-b736-09b95c6f97e5","Type":"ContainerStarted","Data":"d78e1871cea791e2a23306b390f9436602cba6c9778c1f2a724e4f1d991a7707"}
Sep 19 10:43:48.782931 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:48.782884    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl" event={"ID":"aa7f1917-4291-47d3-b736-09b95c6f97e5","Type":"ContainerStarted","Data":"0a9794319ee9f37b3f7a81a29723dce6b65345c41814a8728bd9e306da1e30a8"}
Sep 19 10:43:48.800153 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:48.800108    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl" podStartSLOduration=1.722732918 podStartE2EDuration="2.800092619s" totalImagesPullingTime="1.077359701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:43:48.799272762 +0000 UTC m=+551.698462655" watchObservedRunningTime="2026-09-19 10:43:48.800092619 +0000 UTC m=+551.699282510"
Sep 19 10:43:51.243215 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.243185    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"]
Sep 19 10:43:51.250480 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.247253    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.250940 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.250920    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 19 10:43:51.259494 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.259469    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"]
Sep 19 10:43:51.358016 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.357990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23032bbd-1f5e-4d03-aa90-7be4c41e4244-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.358166 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.358041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23032bbd-1f5e-4d03-aa90-7be4c41e4244-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.358166 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.358081    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23032bbd-1f5e-4d03-aa90-7be4c41e4244-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.358166 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.358106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23032bbd-1f5e-4d03-aa90-7be4c41e4244-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.358166 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.358122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23032bbd-1f5e-4d03-aa90-7be4c41e4244-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.358166 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.358155    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j55tk\" (UniqueName: \"kubernetes.io/projected/23032bbd-1f5e-4d03-aa90-7be4c41e4244-kube-api-access-j55tk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.459082 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.459050    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23032bbd-1f5e-4d03-aa90-7be4c41e4244-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.459217 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.459097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23032bbd-1f5e-4d03-aa90-7be4c41e4244-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.459217 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.459135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23032bbd-1f5e-4d03-aa90-7be4c41e4244-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.459217 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.459160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23032bbd-1f5e-4d03-aa90-7be4c41e4244-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.459217 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.459184    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23032bbd-1f5e-4d03-aa90-7be4c41e4244-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.459406 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.459362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j55tk\" (UniqueName: \"kubernetes.io/projected/23032bbd-1f5e-4d03-aa90-7be4c41e4244-kube-api-access-j55tk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.459529 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.459508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23032bbd-1f5e-4d03-aa90-7be4c41e4244-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.459596 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.459546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23032bbd-1f5e-4d03-aa90-7be4c41e4244-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.459635 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.459604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23032bbd-1f5e-4d03-aa90-7be4c41e4244-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.461356 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.461331    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23032bbd-1f5e-4d03-aa90-7be4c41e4244-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.461680 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.461663    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23032bbd-1f5e-4d03-aa90-7be4c41e4244-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.467169 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.467148    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j55tk\" (UniqueName: \"kubernetes.io/projected/23032bbd-1f5e-4d03-aa90-7be4c41e4244-kube-api-access-j55tk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mj79v\" (UID: \"23032bbd-1f5e-4d03-aa90-7be4c41e4244\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.561023 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.561004    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:43:51.829044 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:51.829017    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"]
Sep 19 10:43:51.830557 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:43:51.830530    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23032bbd_1f5e_4d03_aa90_7be4c41e4244.slice/crio-b72aca8089e1410dfe06660a988e9540dd395b53aae15d53ed70283c92ec0bda WatchSource:0}: Error finding container b72aca8089e1410dfe06660a988e9540dd395b53aae15d53ed70283c92ec0bda: Status 404 returned error can't find the container with id b72aca8089e1410dfe06660a988e9540dd395b53aae15d53ed70283c92ec0bda
Sep 19 10:43:52.802648 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:52.802606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v" event={"ID":"23032bbd-1f5e-4d03-aa90-7be4c41e4244","Type":"ContainerStarted","Data":"9fe22f70b358bb56b062e9ee23b10412dd7d3f6cbac286c78ce4f7a384a02c13"}
Sep 19 10:43:52.803037 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:52.802673    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v" event={"ID":"23032bbd-1f5e-4d03-aa90-7be4c41e4244","Type":"ContainerStarted","Data":"b72aca8089e1410dfe06660a988e9540dd395b53aae15d53ed70283c92ec0bda"}
Sep 19 10:43:52.821086 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:52.821040    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v" podStartSLOduration=1.653826892 podStartE2EDuration="1.821025067s" totalImagesPullingTime="167.198175ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:43:52.819878257 +0000 UTC m=+555.719068152" watchObservedRunningTime="2026-09-19 10:43:52.821025067 +0000 UTC m=+555.720214959"
Sep 19 10:43:56.368794 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:56.368764    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:56.369154 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:56.368814    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:56.381061 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:56.381041    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:43:56.838361 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:43:56.838337    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl"
Sep 19 10:44:01.561479 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:44:01.561447    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:44:01.561866 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:44:01.561506    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:44:01.573702 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:44:01.573674    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:44:01.861278 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:44:01.861201    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mj79v"
Sep 19 10:44:39.146645 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:44:39.146611    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:44:39.150923 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:44:39.150904    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:46:06.810188 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:06.810150    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b9547bd8f-m7cgc"]
Sep 19 10:46:06.813628 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:06.813605    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b9547bd8f-m7cgc"
Sep 19 10:46:06.821590 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:06.821566    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b9547bd8f-m7cgc"]
Sep 19 10:46:06.895356 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:06.895328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zx22\" (UniqueName: \"kubernetes.io/projected/bbaf7b45-4cb4-4b44-aed6-3e727b57cb60-kube-api-access-8zx22\") pod \"authorino-5b9547bd8f-m7cgc\" (UID: \"bbaf7b45-4cb4-4b44-aed6-3e727b57cb60\") " pod="kuadrant-system/authorino-5b9547bd8f-m7cgc"
Sep 19 10:46:06.895483 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:06.895372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbaf7b45-4cb4-4b44-aed6-3e727b57cb60-tls-cert\") pod \"authorino-5b9547bd8f-m7cgc\" (UID: \"bbaf7b45-4cb4-4b44-aed6-3e727b57cb60\") " pod="kuadrant-system/authorino-5b9547bd8f-m7cgc"
Sep 19 10:46:06.996652 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:06.996624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zx22\" (UniqueName: \"kubernetes.io/projected/bbaf7b45-4cb4-4b44-aed6-3e727b57cb60-kube-api-access-8zx22\") pod \"authorino-5b9547bd8f-m7cgc\" (UID: \"bbaf7b45-4cb4-4b44-aed6-3e727b57cb60\") " pod="kuadrant-system/authorino-5b9547bd8f-m7cgc"
Sep 19 10:46:06.996790 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:06.996668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbaf7b45-4cb4-4b44-aed6-3e727b57cb60-tls-cert\") pod \"authorino-5b9547bd8f-m7cgc\" (UID: \"bbaf7b45-4cb4-4b44-aed6-3e727b57cb60\") " pod="kuadrant-system/authorino-5b9547bd8f-m7cgc"
Sep 19 10:46:06.999112 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:06.999095    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbaf7b45-4cb4-4b44-aed6-3e727b57cb60-tls-cert\") pod \"authorino-5b9547bd8f-m7cgc\" (UID: \"bbaf7b45-4cb4-4b44-aed6-3e727b57cb60\") " pod="kuadrant-system/authorino-5b9547bd8f-m7cgc"
Sep 19 10:46:07.004896 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:07.004874    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zx22\" (UniqueName: \"kubernetes.io/projected/bbaf7b45-4cb4-4b44-aed6-3e727b57cb60-kube-api-access-8zx22\") pod \"authorino-5b9547bd8f-m7cgc\" (UID: \"bbaf7b45-4cb4-4b44-aed6-3e727b57cb60\") " pod="kuadrant-system/authorino-5b9547bd8f-m7cgc"
Sep 19 10:46:07.123291 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:07.123233    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b9547bd8f-m7cgc"
Sep 19 10:46:07.391089 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:07.391067    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b9547bd8f-m7cgc"]
Sep 19 10:46:07.393260 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:46:07.393231    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbaf7b45_4cb4_4b44_aed6_3e727b57cb60.slice/crio-60d71464861698863a6a2af4ec3c79a210261e05ec3402f594b949a922906c27 WatchSource:0}: Error finding container 60d71464861698863a6a2af4ec3c79a210261e05ec3402f594b949a922906c27: Status 404 returned error can't find the container with id 60d71464861698863a6a2af4ec3c79a210261e05ec3402f594b949a922906c27
Sep 19 10:46:07.394585 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:07.394567    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 10:46:07.478902 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:07.478874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b9547bd8f-m7cgc" event={"ID":"bbaf7b45-4cb4-4b44-aed6-3e727b57cb60","Type":"ContainerStarted","Data":"60d71464861698863a6a2af4ec3c79a210261e05ec3402f594b949a922906c27"}
Sep 19 10:46:08.489208 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.488366    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b9547bd8f-m7cgc" event={"ID":"bbaf7b45-4cb4-4b44-aed6-3e727b57cb60","Type":"ContainerStarted","Data":"9029d9ab9eac67c98d95208a3c9e327f5df1ce8d43a0e5b6b8caa7f7be4adfbf"}
Sep 19 10:46:08.506636 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.506567    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b9547bd8f-m7cgc" podStartSLOduration=1.933993594 podStartE2EDuration="2.506544809s" totalImagesPullingTime="572.551215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:46:08.505987714 +0000 UTC m=+691.405177610" watchObservedRunningTime="2026-09-19 10:46:08.506544809 +0000 UTC m=+691.405734701"
Sep 19 10:46:08.539188 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.539145    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77dc4d45fb-k4rjc"]
Sep 19 10:46:08.540085 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.539609    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-77dc4d45fb-k4rjc" podUID="e27e22de-d816-42a5-98dd-2f4e227bd431" containerName="authorino" containerID="cri-o://3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb" gracePeriod=30
Sep 19 10:46:08.782191 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.782106    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"]
Sep 19 10:46:08.786111 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.786086    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"
Sep 19 10:46:08.789882 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.789861    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Sep 19 10:46:08.790588 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.790568    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-2xlcg\""
Sep 19 10:46:08.803216 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.803192    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"]
Sep 19 10:46:08.808502 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.808477    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77dc4d45fb-k4rjc"
Sep 19 10:46:08.913067 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.913032    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2n4b\" (UniqueName: \"kubernetes.io/projected/e27e22de-d816-42a5-98dd-2f4e227bd431-kube-api-access-x2n4b\") pod \"e27e22de-d816-42a5-98dd-2f4e227bd431\" (UID: \"e27e22de-d816-42a5-98dd-2f4e227bd431\") "
Sep 19 10:46:08.913265 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.913085    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e27e22de-d816-42a5-98dd-2f4e227bd431-tls-cert\") pod \"e27e22de-d816-42a5-98dd-2f4e227bd431\" (UID: \"e27e22de-d816-42a5-98dd-2f4e227bd431\") "
Sep 19 10:46:08.913343 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.913272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvxnq\" (UniqueName: \"kubernetes.io/projected/8f776b57-a1d3-4b4e-9e84-f9d7681ab51e-kube-api-access-hvxnq\") pod \"ai-gateway-controller-65dd9b4479-j2gw6\" (UID: \"8f776b57-a1d3-4b4e-9e84-f9d7681ab51e\") " pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"
Sep 19 10:46:08.915290 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.915262    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e27e22de-d816-42a5-98dd-2f4e227bd431-kube-api-access-x2n4b" (OuterVolumeSpecName: "kube-api-access-x2n4b") pod "e27e22de-d816-42a5-98dd-2f4e227bd431" (UID: "e27e22de-d816-42a5-98dd-2f4e227bd431"). InnerVolumeSpecName "kube-api-access-x2n4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:46:08.923247 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:08.923222    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e27e22de-d816-42a5-98dd-2f4e227bd431-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e27e22de-d816-42a5-98dd-2f4e227bd431" (UID: "e27e22de-d816-42a5-98dd-2f4e227bd431"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:46:09.014478 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.014446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvxnq\" (UniqueName: \"kubernetes.io/projected/8f776b57-a1d3-4b4e-9e84-f9d7681ab51e-kube-api-access-hvxnq\") pod \"ai-gateway-controller-65dd9b4479-j2gw6\" (UID: \"8f776b57-a1d3-4b4e-9e84-f9d7681ab51e\") " pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"
Sep 19 10:46:09.014652 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.014514    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2n4b\" (UniqueName: \"kubernetes.io/projected/e27e22de-d816-42a5-98dd-2f4e227bd431-kube-api-access-x2n4b\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:46:09.014652 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.014525    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e27e22de-d816-42a5-98dd-2f4e227bd431-tls-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:46:09.025689 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.025661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvxnq\" (UniqueName: \"kubernetes.io/projected/8f776b57-a1d3-4b4e-9e84-f9d7681ab51e-kube-api-access-hvxnq\") pod \"ai-gateway-controller-65dd9b4479-j2gw6\" (UID: \"8f776b57-a1d3-4b4e-9e84-f9d7681ab51e\") " pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"
Sep 19 10:46:09.116001 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.115962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"
Sep 19 10:46:09.393915 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.393873    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"]
Sep 19 10:46:09.494636 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.494603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6" event={"ID":"8f776b57-a1d3-4b4e-9e84-f9d7681ab51e","Type":"ContainerStarted","Data":"0edea40b372021ec45a92f3f17ee2a8b86def1484c4ff1b828cbead956d122b3"}
Sep 19 10:46:09.495963 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.495931    2579 generic.go:356] "Generic (PLEG): container finished" podID="e27e22de-d816-42a5-98dd-2f4e227bd431" containerID="3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb" exitCode=0
Sep 19 10:46:09.496089 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.495965    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77dc4d45fb-k4rjc" event={"ID":"e27e22de-d816-42a5-98dd-2f4e227bd431","Type":"ContainerDied","Data":"3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb"}
Sep 19 10:46:09.496089 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.495993    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77dc4d45fb-k4rjc"
Sep 19 10:46:09.496089 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.496016    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77dc4d45fb-k4rjc" event={"ID":"e27e22de-d816-42a5-98dd-2f4e227bd431","Type":"ContainerDied","Data":"48c66554ecd2fe4ecfe456446fda5d66d1afdcdaff7940949cf3868c4ec46e44"}
Sep 19 10:46:09.496089 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.496042    2579 scope.go:117] "RemoveContainer" containerID="3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb"
Sep 19 10:46:09.504835 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.504812    2579 scope.go:117] "RemoveContainer" containerID="3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb"
Sep 19 10:46:09.505132 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:46:09.505111    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb\": container with ID starting with 3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb not found: ID does not exist" containerID="3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb"
Sep 19 10:46:09.505236 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.505138    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb"} err="failed to get container status \"3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb\": rpc error: code = NotFound desc = could not find container \"3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb\": container with ID starting with 3cd24602366c4df3b5cfffc8bf256876c399ce1f308b84ce42e5a51fbc80dceb not found: ID does not exist"
Sep 19 10:46:09.519406 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.519376    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77dc4d45fb-k4rjc"]
Sep 19 10:46:09.523525 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:09.523506    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77dc4d45fb-k4rjc"]
Sep 19 10:46:11.203639 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:11.203594    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e27e22de-d816-42a5-98dd-2f4e227bd431" path="/var/lib/kubelet/pods/e27e22de-d816-42a5-98dd-2f4e227bd431/volumes"
Sep 19 10:46:11.509693 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:11.509608    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6" event={"ID":"8f776b57-a1d3-4b4e-9e84-f9d7681ab51e","Type":"ContainerStarted","Data":"8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3"}
Sep 19 10:46:11.509864 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:11.509752    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"
Sep 19 10:46:22.517630 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:22.517532    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"
Sep 19 10:46:22.536047 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:22.535959    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6" podStartSLOduration=13.314885408 podStartE2EDuration="14.535924687s" totalImagesPullingTime="1.221039279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:46:11.529987772 +0000 UTC m=+694.429177665" watchObservedRunningTime="2026-09-19 10:46:22.535924687 +0000 UTC m=+705.435114621"
Sep 19 10:46:22.709292 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:22.709264    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn"]
Sep 19 10:46:22.709651 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:22.709639    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e27e22de-d816-42a5-98dd-2f4e227bd431" containerName="authorino"
Sep 19 10:46:22.709696 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:22.709653    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e27e22de-d816-42a5-98dd-2f4e227bd431" containerName="authorino"
Sep 19 10:46:22.709749 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:22.709736    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e27e22de-d816-42a5-98dd-2f4e227bd431" containerName="authorino"
Sep 19 10:46:22.714397 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:22.714379    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn"
Sep 19 10:46:22.719539 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:22.719519    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn"]
Sep 19 10:46:22.824791 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:22.824765    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvpp4\" (UniqueName: \"kubernetes.io/projected/17f9bf68-630c-4229-a429-e3cf4ea9a876-kube-api-access-pvpp4\") pod \"ai-gateway-controller-64b9cf4bfb-bqhjn\" (UID: \"17f9bf68-630c-4229-a429-e3cf4ea9a876\") " pod="opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn"
Sep 19 10:46:22.926054 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:22.926027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvpp4\" (UniqueName: \"kubernetes.io/projected/17f9bf68-630c-4229-a429-e3cf4ea9a876-kube-api-access-pvpp4\") pod \"ai-gateway-controller-64b9cf4bfb-bqhjn\" (UID: \"17f9bf68-630c-4229-a429-e3cf4ea9a876\") " pod="opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn"
Sep 19 10:46:22.933741 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:22.933698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvpp4\" (UniqueName: \"kubernetes.io/projected/17f9bf68-630c-4229-a429-e3cf4ea9a876-kube-api-access-pvpp4\") pod \"ai-gateway-controller-64b9cf4bfb-bqhjn\" (UID: \"17f9bf68-630c-4229-a429-e3cf4ea9a876\") " pod="opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn"
Sep 19 10:46:23.026083 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:23.026062    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn"
Sep 19 10:46:23.297779 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:23.297753    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn"]
Sep 19 10:46:23.299973 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:46:23.299943    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f9bf68_630c_4229_a429_e3cf4ea9a876.slice/crio-f4210d5656629d94266232575a3a5e37c477ec48f6212dc29106ec5f083442b1 WatchSource:0}: Error finding container f4210d5656629d94266232575a3a5e37c477ec48f6212dc29106ec5f083442b1: Status 404 returned error can't find the container with id f4210d5656629d94266232575a3a5e37c477ec48f6212dc29106ec5f083442b1
Sep 19 10:46:23.572205 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:23.572176    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn" event={"ID":"17f9bf68-630c-4229-a429-e3cf4ea9a876","Type":"ContainerStarted","Data":"f4210d5656629d94266232575a3a5e37c477ec48f6212dc29106ec5f083442b1"}
Sep 19 10:46:24.578682 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:24.578640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn" event={"ID":"17f9bf68-630c-4229-a429-e3cf4ea9a876","Type":"ContainerStarted","Data":"f9544464b0aa6d7392fd7c590daa85e4b4b584e4150b95195a3afc80f1b1013d"}
Sep 19 10:46:24.579123 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:24.578776    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn"
Sep 19 10:46:24.593425 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:24.593370    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn" podStartSLOduration=2.291206726 podStartE2EDuration="2.593350978s" totalImagesPullingTime="302.144252ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:46:24.593155584 +0000 UTC m=+707.492345478" watchObservedRunningTime="2026-09-19 10:46:24.593350978 +0000 UTC m=+707.492540872"
Sep 19 10:46:35.586994 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:35.586953    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-64b9cf4bfb-bqhjn"
Sep 19 10:46:35.624139 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:35.624108    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"]
Sep 19 10:46:35.624336 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:35.624314    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6" podUID="8f776b57-a1d3-4b4e-9e84-f9d7681ab51e" containerName="manager" containerID="cri-o://8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3" gracePeriod=30
Sep 19 10:46:35.874672 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:35.874647    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"
Sep 19 10:46:35.921532 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:35.921505    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvxnq\" (UniqueName: \"kubernetes.io/projected/8f776b57-a1d3-4b4e-9e84-f9d7681ab51e-kube-api-access-hvxnq\") pod \"8f776b57-a1d3-4b4e-9e84-f9d7681ab51e\" (UID: \"8f776b57-a1d3-4b4e-9e84-f9d7681ab51e\") "
Sep 19 10:46:35.923422 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:35.923395    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f776b57-a1d3-4b4e-9e84-f9d7681ab51e-kube-api-access-hvxnq" (OuterVolumeSpecName: "kube-api-access-hvxnq") pod "8f776b57-a1d3-4b4e-9e84-f9d7681ab51e" (UID: "8f776b57-a1d3-4b4e-9e84-f9d7681ab51e"). InnerVolumeSpecName "kube-api-access-hvxnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:46:36.022215 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.022191    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvxnq\" (UniqueName: \"kubernetes.io/projected/8f776b57-a1d3-4b4e-9e84-f9d7681ab51e-kube-api-access-hvxnq\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:46:36.477376 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.477345    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-78572"]
Sep 19 10:46:36.477560 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.477540    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572" podUID="d85185db-4731-4b45-b629-2bc4412c2bee" containerName="payload-pre-processing" containerID="cri-o://02797f8c7c3ff232e9822e51d88cfc53216d3fdce087d3c61af69732c73fab89" gracePeriod=30
Sep 19 10:46:36.642835 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.642801    2579 generic.go:356] "Generic (PLEG): container finished" podID="8f776b57-a1d3-4b4e-9e84-f9d7681ab51e" containerID="8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3" exitCode=0
Sep 19 10:46:36.643258 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.642844    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"
Sep 19 10:46:36.643258 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.642883    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6" event={"ID":"8f776b57-a1d3-4b4e-9e84-f9d7681ab51e","Type":"ContainerDied","Data":"8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3"}
Sep 19 10:46:36.643258 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.642934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65dd9b4479-j2gw6" event={"ID":"8f776b57-a1d3-4b4e-9e84-f9d7681ab51e","Type":"ContainerDied","Data":"0edea40b372021ec45a92f3f17ee2a8b86def1484c4ff1b828cbead956d122b3"}
Sep 19 10:46:36.643258 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.642963    2579 scope.go:117] "RemoveContainer" containerID="8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3"
Sep 19 10:46:36.645022 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.644938    2579 generic.go:356] "Generic (PLEG): container finished" podID="d85185db-4731-4b45-b629-2bc4412c2bee" containerID="02797f8c7c3ff232e9822e51d88cfc53216d3fdce087d3c61af69732c73fab89" exitCode=0
Sep 19 10:46:36.645022 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.644976    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572" event={"ID":"d85185db-4731-4b45-b629-2bc4412c2bee","Type":"ContainerDied","Data":"02797f8c7c3ff232e9822e51d88cfc53216d3fdce087d3c61af69732c73fab89"}
Sep 19 10:46:36.654082 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.654056    2579 scope.go:117] "RemoveContainer" containerID="8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3"
Sep 19 10:46:36.654333 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:46:36.654314    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3\": container with ID starting with 8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3 not found: ID does not exist" containerID="8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3"
Sep 19 10:46:36.654392 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.654343    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3"} err="failed to get container status \"8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3\": rpc error: code = NotFound desc = could not find container \"8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3\": container with ID starting with 8a06e3687738e06d0c50a75d92d3c80a4d7ad05eb4f82cc9d2b9d2113600dcb3 not found: ID does not exist"
Sep 19 10:46:36.666003 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.665981    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"]
Sep 19 10:46:36.669378 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.669145    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-j2gw6"]
Sep 19 10:46:36.748123 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.748102    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572"
Sep 19 10:46:36.828186 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.828161    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skkjc\" (UniqueName: \"kubernetes.io/projected/d85185db-4731-4b45-b629-2bc4412c2bee-kube-api-access-skkjc\") pod \"d85185db-4731-4b45-b629-2bc4412c2bee\" (UID: \"d85185db-4731-4b45-b629-2bc4412c2bee\") "
Sep 19 10:46:36.828360 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.828226    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d85185db-4731-4b45-b629-2bc4412c2bee-plugins-config-volume\") pod \"d85185db-4731-4b45-b629-2bc4412c2bee\" (UID: \"d85185db-4731-4b45-b629-2bc4412c2bee\") "
Sep 19 10:46:36.828639 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.828600    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d85185db-4731-4b45-b629-2bc4412c2bee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d85185db-4731-4b45-b629-2bc4412c2bee" (UID: "d85185db-4731-4b45-b629-2bc4412c2bee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:46:36.830195 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.830173    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d85185db-4731-4b45-b629-2bc4412c2bee-kube-api-access-skkjc" (OuterVolumeSpecName: "kube-api-access-skkjc") pod "d85185db-4731-4b45-b629-2bc4412c2bee" (UID: "d85185db-4731-4b45-b629-2bc4412c2bee"). InnerVolumeSpecName "kube-api-access-skkjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:46:36.929203 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.929181    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skkjc\" (UniqueName: \"kubernetes.io/projected/d85185db-4731-4b45-b629-2bc4412c2bee-kube-api-access-skkjc\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:46:36.929203 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:36.929203    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d85185db-4731-4b45-b629-2bc4412c2bee-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:46:37.202294 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:37.202269    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f776b57-a1d3-4b4e-9e84-f9d7681ab51e" path="/var/lib/kubelet/pods/8f776b57-a1d3-4b4e-9e84-f9d7681ab51e/volumes"
Sep 19 10:46:37.650445 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:37.650417    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572"
Sep 19 10:46:37.650445 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:37.650437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-78572" event={"ID":"d85185db-4731-4b45-b629-2bc4412c2bee","Type":"ContainerDied","Data":"c6eed8eac5aa07683f9c756ea2abf8e0e4af318c9baed638629e46ac39746796"}
Sep 19 10:46:37.651008 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:37.650491    2579 scope.go:117] "RemoveContainer" containerID="02797f8c7c3ff232e9822e51d88cfc53216d3fdce087d3c61af69732c73fab89"
Sep 19 10:46:37.665963 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:37.665941    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-78572"]
Sep 19 10:46:37.669583 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:37.669561    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-78572"]
Sep 19 10:46:39.202594 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:39.202565    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d85185db-4731-4b45-b629-2bc4412c2bee" path="/var/lib/kubelet/pods/d85185db-4731-4b45-b629-2bc4412c2bee/volumes"
Sep 19 10:46:54.307890 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.307853    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-85fd65c94c-7hp29"]
Sep 19 10:46:54.308252 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.308227    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85185db-4731-4b45-b629-2bc4412c2bee" containerName="payload-pre-processing"
Sep 19 10:46:54.308252 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.308239    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85185db-4731-4b45-b629-2bc4412c2bee" containerName="payload-pre-processing"
Sep 19 10:46:54.308252 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.308253    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f776b57-a1d3-4b4e-9e84-f9d7681ab51e" containerName="manager"
Sep 19 10:46:54.308412 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.308260    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f776b57-a1d3-4b4e-9e84-f9d7681ab51e" containerName="manager"
Sep 19 10:46:54.308412 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.308359    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f776b57-a1d3-4b4e-9e84-f9d7681ab51e" containerName="manager"
Sep 19 10:46:54.308412 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.308367    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85185db-4731-4b45-b629-2bc4412c2bee" containerName="payload-pre-processing"
Sep 19 10:46:54.312999 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.312979    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-85fd65c94c-7hp29"
Sep 19 10:46:54.315384 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.315362    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pm2vd\""
Sep 19 10:46:54.315510 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.315368    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 19 10:46:54.321221 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.320816    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-85fd65c94c-7hp29"]
Sep 19 10:46:54.359217 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.359188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f1164e8-3969-4951-ad45-598c957c21db-plugins-config-volume\") pod \"payload-processing-85fd65c94c-7hp29\" (UID: \"5f1164e8-3969-4951-ad45-598c957c21db\") " pod="openshift-ingress/payload-processing-85fd65c94c-7hp29"
Sep 19 10:46:54.359366 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.359256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hkzw\" (UniqueName: \"kubernetes.io/projected/5f1164e8-3969-4951-ad45-598c957c21db-kube-api-access-7hkzw\") pod \"payload-processing-85fd65c94c-7hp29\" (UID: \"5f1164e8-3969-4951-ad45-598c957c21db\") " pod="openshift-ingress/payload-processing-85fd65c94c-7hp29"
Sep 19 10:46:54.460569 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.460541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f1164e8-3969-4951-ad45-598c957c21db-plugins-config-volume\") pod \"payload-processing-85fd65c94c-7hp29\" (UID: \"5f1164e8-3969-4951-ad45-598c957c21db\") " pod="openshift-ingress/payload-processing-85fd65c94c-7hp29"
Sep 19 10:46:54.460779 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.460592    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hkzw\" (UniqueName: \"kubernetes.io/projected/5f1164e8-3969-4951-ad45-598c957c21db-kube-api-access-7hkzw\") pod \"payload-processing-85fd65c94c-7hp29\" (UID: \"5f1164e8-3969-4951-ad45-598c957c21db\") " pod="openshift-ingress/payload-processing-85fd65c94c-7hp29"
Sep 19 10:46:54.461613 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.461589    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f1164e8-3969-4951-ad45-598c957c21db-plugins-config-volume\") pod \"payload-processing-85fd65c94c-7hp29\" (UID: \"5f1164e8-3969-4951-ad45-598c957c21db\") " pod="openshift-ingress/payload-processing-85fd65c94c-7hp29"
Sep 19 10:46:54.467915 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.467885    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hkzw\" (UniqueName: \"kubernetes.io/projected/5f1164e8-3969-4951-ad45-598c957c21db-kube-api-access-7hkzw\") pod \"payload-processing-85fd65c94c-7hp29\" (UID: \"5f1164e8-3969-4951-ad45-598c957c21db\") " pod="openshift-ingress/payload-processing-85fd65c94c-7hp29"
Sep 19 10:46:54.627186 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.627103    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-85fd65c94c-7hp29"
Sep 19 10:46:54.897582 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:54.897559    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-85fd65c94c-7hp29"]
Sep 19 10:46:54.899359 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:46:54.899330    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1164e8_3969_4951_ad45_598c957c21db.slice/crio-28a5ff172665914d68c6f619777b95202bcf9cd50edb319cdcf07afa30637d93 WatchSource:0}: Error finding container 28a5ff172665914d68c6f619777b95202bcf9cd50edb319cdcf07afa30637d93: Status 404 returned error can't find the container with id 28a5ff172665914d68c6f619777b95202bcf9cd50edb319cdcf07afa30637d93
Sep 19 10:46:55.747344 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:55.747304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-85fd65c94c-7hp29" event={"ID":"5f1164e8-3969-4951-ad45-598c957c21db","Type":"ContainerStarted","Data":"28a5ff172665914d68c6f619777b95202bcf9cd50edb319cdcf07afa30637d93"}
Sep 19 10:46:56.754456 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:56.754410    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-85fd65c94c-7hp29" event={"ID":"5f1164e8-3969-4951-ad45-598c957c21db","Type":"ContainerStarted","Data":"66617d6904fcbba955fb9823d3c32dc906abdca56878e204ec88dbdfaac78832"}
Sep 19 10:46:56.754895 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:56.754555    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-85fd65c94c-7hp29"
Sep 19 10:46:56.771190 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:46:56.771134    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-85fd65c94c-7hp29" podStartSLOduration=1.702058676 podStartE2EDuration="2.7711192s" totalImagesPullingTime="1.069060524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:46:56.769626247 +0000 UTC m=+739.668816142" watchObservedRunningTime="2026-09-19 10:46:56.7711192 +0000 UTC m=+739.670309092"
Sep 19 10:47:07.761476 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:07.761442    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-85fd65c94c-7hp29"
Sep 19 10:47:30.045240 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.045207    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"]
Sep 19 10:47:30.048971 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.048951    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.051243 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.051223    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-cc1b19-openshift-default-dockercfg-z9jjq\""
Sep 19 10:47:30.061075 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.061052    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"]
Sep 19 10:47:30.142536 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.142497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k97b\" (UniqueName: \"kubernetes.io/projected/7348dd3c-1f73-4de6-b771-00a6386e4d53-kube-api-access-6k97b\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.142750 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.142545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-envoy\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.142750 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.142584    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-workload-certs\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.142750 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.142653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7348dd3c-1f73-4de6-b771-00a6386e4d53-istiod-ca-cert\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.142750 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.142682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-workload-socket\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.142750 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.142735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-podinfo\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.143065 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.142774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-data\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.143065 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.142813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-credential-socket\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.143065 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.142961    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-token\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.243919 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.243882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-token\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.244116 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.243935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k97b\" (UniqueName: \"kubernetes.io/projected/7348dd3c-1f73-4de6-b771-00a6386e4d53-kube-api-access-6k97b\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.244116 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.244001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-envoy\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.244116 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.244058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-workload-certs\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.244291 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.244147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7348dd3c-1f73-4de6-b771-00a6386e4d53-istiod-ca-cert\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.244291 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.244180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-workload-socket\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.244291 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.244225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-podinfo\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.244291 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.244258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-data\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.244498 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.244303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-credential-socket\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.244574 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.244546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-workload-certs\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.244700 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.244616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-credential-socket\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.244700 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.244692    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-workload-socket\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.244964 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.244942    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-data\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.245247 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.245224    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7348dd3c-1f73-4de6-b771-00a6386e4d53-istiod-ca-cert\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.246717 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.246695    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-envoy\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.247386 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.247364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-podinfo\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.252101 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.252070    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k97b\" (UniqueName: \"kubernetes.io/projected/7348dd3c-1f73-4de6-b771-00a6386e4d53-kube-api-access-6k97b\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.252101 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.252093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-token\") pod \"e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") " pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.359995 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.359965    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:30.641476 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.641451    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"]
Sep 19 10:47:30.643264 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:47:30.643234    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7348dd3c_1f73_4de6_b771_00a6386e4d53.slice/crio-2d3accbecad88a356a5c707d7e5b583fed5012caf8c73a02fbcbf6804c773b01 WatchSource:0}: Error finding container 2d3accbecad88a356a5c707d7e5b583fed5012caf8c73a02fbcbf6804c773b01: Status 404 returned error can't find the container with id 2d3accbecad88a356a5c707d7e5b583fed5012caf8c73a02fbcbf6804c773b01
Sep 19 10:47:30.645581 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.645535    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:47:30.645663 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.645610    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:47:30.645663 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.645638    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:47:30.931062 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.930973    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" event={"ID":"7348dd3c-1f73-4de6-b771-00a6386e4d53","Type":"ContainerStarted","Data":"5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae"}
Sep 19 10:47:30.931062 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.931035    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" event={"ID":"7348dd3c-1f73-4de6-b771-00a6386e4d53","Type":"ContainerStarted","Data":"2d3accbecad88a356a5c707d7e5b583fed5012caf8c73a02fbcbf6804c773b01"}
Sep 19 10:47:30.951067 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:30.951011    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" podStartSLOduration=0.950990978 podStartE2EDuration="950.990978ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:47:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:47:30.949626476 +0000 UTC m=+773.848816368" watchObservedRunningTime="2026-09-19 10:47:30.950990978 +0000 UTC m=+773.850180871"
Sep 19 10:47:31.360472 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:31.360444    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:31.364989 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:31.364965    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:31.936130 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:31.936095    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:31.936936 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:31.936913    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:34.072522 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.072491    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"]
Sep 19 10:47:34.076386 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.076366    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.078819 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.078800    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-f91f97-serving-cert\""
Sep 19 10:47:34.088914 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.088891    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"]
Sep 19 10:47:34.179319 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.179290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.179319 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.179320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-metrics-certs\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.179513 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.179376    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfgrx\" (UniqueName: \"kubernetes.io/projected/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-kube-api-access-rfgrx\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.179513 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.179396    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-maas-api-tls\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.280543 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.280513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.280657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.280558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-metrics-certs\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.280657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.280625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfgrx\" (UniqueName: \"kubernetes.io/projected/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-kube-api-access-rfgrx\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.280762 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.280659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-maas-api-tls\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.280827 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:47:34.280806    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-serving-cert: secret "maas-api-e2e-inf-a-f91f97-serving-cert" not found
Sep 19 10:47:34.280905 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:47:34.280892    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-maas-api-tls podName:a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0 nodeName:}" failed. No retries permitted until 2026-09-19 10:47:34.78086967 +0000 UTC m=+777.680059544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-maas-api-tls") pod "maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx" (UID: "a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0") : secret "maas-api-e2e-inf-a-f91f97-serving-cert" not found
Sep 19 10:47:34.281246 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.281223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.283008 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.282986    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-metrics-certs\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.288668 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.288642    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfgrx\" (UniqueName: \"kubernetes.io/projected/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-kube-api-access-rfgrx\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.785618 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.785586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-maas-api-tls\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.788553 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.788515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-maas-api-tls\") pod \"maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.805680 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.805656    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"]
Sep 19 10:47:34.809485 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.809470    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"
Sep 19 10:47:34.811848 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.811827    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-f91f97\""
Sep 19 10:47:34.811848 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.811841    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-f91f97-dockercfg-qxmnc\""
Sep 19 10:47:34.818555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.818531    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"]
Sep 19 10:47:34.886701 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.886670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e52ac44d-fe77-4cdd-8407-012158d55ea9-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47\" (UID: \"e52ac44d-fe77-4cdd-8407-012158d55ea9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"
Sep 19 10:47:34.886885 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.886812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krkfz\" (UniqueName: \"kubernetes.io/projected/e52ac44d-fe77-4cdd-8407-012158d55ea9-kube-api-access-krkfz\") pod \"payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47\" (UID: \"e52ac44d-fe77-4cdd-8407-012158d55ea9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"
Sep 19 10:47:34.987771 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.987702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krkfz\" (UniqueName: \"kubernetes.io/projected/e52ac44d-fe77-4cdd-8407-012158d55ea9-kube-api-access-krkfz\") pod \"payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47\" (UID: \"e52ac44d-fe77-4cdd-8407-012158d55ea9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"
Sep 19 10:47:34.987973 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.987816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e52ac44d-fe77-4cdd-8407-012158d55ea9-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47\" (UID: \"e52ac44d-fe77-4cdd-8407-012158d55ea9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"
Sep 19 10:47:34.988559 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.988540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e52ac44d-fe77-4cdd-8407-012158d55ea9-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47\" (UID: \"e52ac44d-fe77-4cdd-8407-012158d55ea9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"
Sep 19 10:47:34.989527 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.989509    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:34.997658 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:34.997635    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krkfz\" (UniqueName: \"kubernetes.io/projected/e52ac44d-fe77-4cdd-8407-012158d55ea9-kube-api-access-krkfz\") pod \"payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47\" (UID: \"e52ac44d-fe77-4cdd-8407-012158d55ea9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"
Sep 19 10:47:35.056092 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.055432    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"]
Sep 19 10:47:35.062055 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.062036    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.064101 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.064079    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-580e01-serving-cert\""
Sep 19 10:47:35.067333 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.067279    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"]
Sep 19 10:47:35.121790 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.121760    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"
Sep 19 10:47:35.189430 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.189374    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.189574 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.189431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-metrics-certs\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.189574 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.189528    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkx7z\" (UniqueName: \"kubernetes.io/projected/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-kube-api-access-bkx7z\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.189574 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.189558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.261704 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.261679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"]
Sep 19 10:47:35.263460 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:47:35.263435    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1520f8d_b3e1_4f2b_a131_ccdcbc01b1c0.slice/crio-f4755eda21be81382c3d4c3f9cc890368712c28759f5b89fe2960fbee6f7f3e7 WatchSource:0}: Error finding container f4755eda21be81382c3d4c3f9cc890368712c28759f5b89fe2960fbee6f7f3e7: Status 404 returned error can't find the container with id f4755eda21be81382c3d4c3f9cc890368712c28759f5b89fe2960fbee6f7f3e7
Sep 19 10:47:35.290524 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.290465    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.290524 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.290510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-metrics-certs\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.290682 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.290580    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkx7z\" (UniqueName: \"kubernetes.io/projected/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-kube-api-access-bkx7z\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.290682 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.290617    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.290842 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:47:35.290820    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-serving-cert: secret "maas-api-e2e-worker-w3-580e01-serving-cert" not found
Sep 19 10:47:35.290899 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:47:35.290887    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-maas-api-tls podName:8b5bc867-96ea-4009-bdbc-0ac5eebee3cb nodeName:}" failed. No retries permitted until 2026-09-19 10:47:35.790866382 +0000 UTC m=+778.690056256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-maas-api-tls") pod "maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx" (UID: "8b5bc867-96ea-4009-bdbc-0ac5eebee3cb") : secret "maas-api-e2e-worker-w3-580e01-serving-cert" not found
Sep 19 10:47:35.291272 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.291220    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.293639 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.293615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-metrics-certs\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.298257 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.298236    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkx7z\" (UniqueName: \"kubernetes.io/projected/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-kube-api-access-bkx7z\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.395474 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.395446    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"]
Sep 19 10:47:35.397198 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:47:35.397172    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode52ac44d_fe77_4cdd_8407_012158d55ea9.slice/crio-7a8e0194ed6f6892ebd12b66e11a1f234f17294c27f1ae85246d858b574df13d WatchSource:0}: Error finding container 7a8e0194ed6f6892ebd12b66e11a1f234f17294c27f1ae85246d858b574df13d: Status 404 returned error can't find the container with id 7a8e0194ed6f6892ebd12b66e11a1f234f17294c27f1ae85246d858b574df13d
Sep 19 10:47:35.795416 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.795383    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.797702 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.797675    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.964467 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.964383    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47" event={"ID":"e52ac44d-fe77-4cdd-8407-012158d55ea9","Type":"ContainerStarted","Data":"a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d"}
Sep 19 10:47:35.964467 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.964442    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47" event={"ID":"e52ac44d-fe77-4cdd-8407-012158d55ea9","Type":"ContainerStarted","Data":"7a8e0194ed6f6892ebd12b66e11a1f234f17294c27f1ae85246d858b574df13d"}
Sep 19 10:47:35.964696 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.964472    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"
Sep 19 10:47:35.965870 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.965849    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx" event={"ID":"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0","Type":"ContainerStarted","Data":"eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41"}
Sep 19 10:47:35.965973 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.965890    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx" event={"ID":"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0","Type":"ContainerStarted","Data":"f4755eda21be81382c3d4c3f9cc890368712c28759f5b89fe2960fbee6f7f3e7"}
Sep 19 10:47:35.965973 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.965962    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:35.974989 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.974970    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:35.981503 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.981455    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47" podStartSLOduration=1.981437021 podStartE2EDuration="1.981437021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:47:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:47:35.980688097 +0000 UTC m=+778.879877988" watchObservedRunningTime="2026-09-19 10:47:35.981437021 +0000 UTC m=+778.880626915"
Sep 19 10:47:35.997448 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:35.997398    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx" podStartSLOduration=1.6759908220000002 podStartE2EDuration="1.997379977s" totalImagesPullingTime="321.389155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:47:35.996140603 +0000 UTC m=+778.895330700" watchObservedRunningTime="2026-09-19 10:47:35.997379977 +0000 UTC m=+778.896569870"
Sep 19 10:47:36.247566 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.247538    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"]
Sep 19 10:47:36.248489 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:47:36.248462    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5bc867_96ea_4009_bdbc_0ac5eebee3cb.slice/crio-2dabd9c65215ec8e1bb02f4b0bcb936728e676ef8c41e17e9c1b284c6805a84f WatchSource:0}: Error finding container 2dabd9c65215ec8e1bb02f4b0bcb936728e676ef8c41e17e9c1b284c6805a84f: Status 404 returned error can't find the container with id 2dabd9c65215ec8e1bb02f4b0bcb936728e676ef8c41e17e9c1b284c6805a84f
Sep 19 10:47:36.739015 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.738982    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"]
Sep 19 10:47:36.744060 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.744031    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"
Sep 19 10:47:36.748425 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.748389    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-cc1b19\""
Sep 19 10:47:36.753717 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.753692    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"]
Sep 19 10:47:36.780648 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.780621    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"]
Sep 19 10:47:36.785085 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.785057    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"
Sep 19 10:47:36.787702 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.787677    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-cc1b19-dockercfg-fvbxc\""
Sep 19 10:47:36.792522 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.792503    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"]
Sep 19 10:47:36.906774 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.906674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e9574f8-2a5d-434b-bf48-b952d1dbf80a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd\" (UID: \"5e9574f8-2a5d-434b-bf48-b952d1dbf80a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"
Sep 19 10:47:36.906936 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.906808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttg2v\" (UniqueName: \"kubernetes.io/projected/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f-kube-api-access-ttg2v\") pod \"payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq\" (UID: \"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"
Sep 19 10:47:36.906936 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.906839    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv8s7\" (UniqueName: \"kubernetes.io/projected/5e9574f8-2a5d-434b-bf48-b952d1dbf80a-kube-api-access-fv8s7\") pod \"payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd\" (UID: \"5e9574f8-2a5d-434b-bf48-b952d1dbf80a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"
Sep 19 10:47:36.906936 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.906924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq\" (UID: \"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"
Sep 19 10:47:36.973938 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.973898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx" event={"ID":"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb","Type":"ContainerStarted","Data":"283dc0f9a30404a00bc4422010ab5e6848b28daee7cad838469241079950c434"}
Sep 19 10:47:36.974123 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.973971    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx" event={"ID":"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb","Type":"ContainerStarted","Data":"2dabd9c65215ec8e1bb02f4b0bcb936728e676ef8c41e17e9c1b284c6805a84f"}
Sep 19 10:47:36.992824 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:36.992770    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx" podStartSLOduration=1.664404897 podStartE2EDuration="1.992720755s" totalImagesPullingTime="328.315858ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:47:36.990813666 +0000 UTC m=+779.890003558" watchObservedRunningTime="2026-09-19 10:47:36.992720755 +0000 UTC m=+779.891939860"
Sep 19 10:47:37.008365 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.008332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttg2v\" (UniqueName: \"kubernetes.io/projected/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f-kube-api-access-ttg2v\") pod \"payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq\" (UID: \"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"
Sep 19 10:47:37.008528 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.008377    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv8s7\" (UniqueName: \"kubernetes.io/projected/5e9574f8-2a5d-434b-bf48-b952d1dbf80a-kube-api-access-fv8s7\") pod \"payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd\" (UID: \"5e9574f8-2a5d-434b-bf48-b952d1dbf80a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"
Sep 19 10:47:37.008528 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.008453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq\" (UID: \"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"
Sep 19 10:47:37.008653 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.008551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e9574f8-2a5d-434b-bf48-b952d1dbf80a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd\" (UID: \"5e9574f8-2a5d-434b-bf48-b952d1dbf80a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"
Sep 19 10:47:37.009496 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.009467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e9574f8-2a5d-434b-bf48-b952d1dbf80a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd\" (UID: \"5e9574f8-2a5d-434b-bf48-b952d1dbf80a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"
Sep 19 10:47:37.009914 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.009895    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq\" (UID: \"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"
Sep 19 10:47:37.018917 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.018896    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv8s7\" (UniqueName: \"kubernetes.io/projected/5e9574f8-2a5d-434b-bf48-b952d1dbf80a-kube-api-access-fv8s7\") pod \"payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd\" (UID: \"5e9574f8-2a5d-434b-bf48-b952d1dbf80a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"
Sep 19 10:47:37.019020 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.018972    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttg2v\" (UniqueName: \"kubernetes.io/projected/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f-kube-api-access-ttg2v\") pod \"payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq\" (UID: \"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"
Sep 19 10:47:37.058516 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.058492    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"
Sep 19 10:47:37.099308 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.099283    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"
Sep 19 10:47:37.339143 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.339116    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"]
Sep 19 10:47:37.341277 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:47:37.341227    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b51fb9_35d0_4e5e_bd06_15aba8613e2f.slice/crio-24d2e988e50635b23ee8fa8adaf179c5e09b716d494d62060d2cc04f93cba55e WatchSource:0}: Error finding container 24d2e988e50635b23ee8fa8adaf179c5e09b716d494d62060d2cc04f93cba55e: Status 404 returned error can't find the container with id 24d2e988e50635b23ee8fa8adaf179c5e09b716d494d62060d2cc04f93cba55e
Sep 19 10:47:37.390566 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.390540    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"]
Sep 19 10:47:37.395956 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:47:37.395918    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e9574f8_2a5d_434b_bf48_b952d1dbf80a.slice/crio-11a28f4c3b81b0dc315ff09f94a068793a3b841a599a4c1cad6056f288ec4516 WatchSource:0}: Error finding container 11a28f4c3b81b0dc315ff09f94a068793a3b841a599a4c1cad6056f288ec4516: Status 404 returned error can't find the container with id 11a28f4c3b81b0dc315ff09f94a068793a3b841a599a4c1cad6056f288ec4516
Sep 19 10:47:37.981380 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.981340    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq" event={"ID":"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f","Type":"ContainerStarted","Data":"c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e"}
Sep 19 10:47:37.981602 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.981523    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"
Sep 19 10:47:37.981602 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.981559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq" event={"ID":"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f","Type":"ContainerStarted","Data":"24d2e988e50635b23ee8fa8adaf179c5e09b716d494d62060d2cc04f93cba55e"}
Sep 19 10:47:37.982953 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.982924    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd" event={"ID":"5e9574f8-2a5d-434b-bf48-b952d1dbf80a","Type":"ContainerStarted","Data":"5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743"}
Sep 19 10:47:37.983057 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.982972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd" event={"ID":"5e9574f8-2a5d-434b-bf48-b952d1dbf80a","Type":"ContainerStarted","Data":"11a28f4c3b81b0dc315ff09f94a068793a3b841a599a4c1cad6056f288ec4516"}
Sep 19 10:47:37.983265 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.983240    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:37.998479 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:37.998425    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq" podStartSLOduration=1.998410995 podStartE2EDuration="1.998410995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:47:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:47:37.996324492 +0000 UTC m=+780.895514384" watchObservedRunningTime="2026-09-19 10:47:37.998410995 +0000 UTC m=+780.897600886"
Sep 19 10:47:38.015981 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:38.015940    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd" podStartSLOduration=2.015926379 podStartE2EDuration="2.015926379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:47:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:47:38.013748904 +0000 UTC m=+780.912938796" watchObservedRunningTime="2026-09-19 10:47:38.015926379 +0000 UTC m=+780.915116323"
Sep 19 10:47:38.990685 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:38.990653    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"
Sep 19 10:47:41.980121 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:41.980090    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:47:44.003022 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:44.002991    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:47:44.802635 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:44.802593    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"]
Sep 19 10:47:44.807154 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:44.807130    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"
Sep 19 10:47:44.816025 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:44.816002    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b21bfa16-dockercfg-gwrsn\""
Sep 19 10:47:44.816415 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:44.816398    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b21bfa16\""
Sep 19 10:47:44.816969 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:44.816945    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"]
Sep 19 10:47:44.981273 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:44.981237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08f655a2-8a9e-457c-92ac-e4c85df265f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz\" (UID: \"08f655a2-8a9e-457c-92ac-e4c85df265f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"
Sep 19 10:47:44.981459 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:44.981282    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhcxz\" (UniqueName: \"kubernetes.io/projected/08f655a2-8a9e-457c-92ac-e4c85df265f6-kube-api-access-rhcxz\") pod \"payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz\" (UID: \"08f655a2-8a9e-457c-92ac-e4c85df265f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"
Sep 19 10:47:45.082467 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:45.082382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08f655a2-8a9e-457c-92ac-e4c85df265f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz\" (UID: \"08f655a2-8a9e-457c-92ac-e4c85df265f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"
Sep 19 10:47:45.082467 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:45.082432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhcxz\" (UniqueName: \"kubernetes.io/projected/08f655a2-8a9e-457c-92ac-e4c85df265f6-kube-api-access-rhcxz\") pod \"payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz\" (UID: \"08f655a2-8a9e-457c-92ac-e4c85df265f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"
Sep 19 10:47:45.083108 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:45.083078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08f655a2-8a9e-457c-92ac-e4c85df265f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz\" (UID: \"08f655a2-8a9e-457c-92ac-e4c85df265f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"
Sep 19 10:47:45.091294 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:45.091262    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhcxz\" (UniqueName: \"kubernetes.io/projected/08f655a2-8a9e-457c-92ac-e4c85df265f6-kube-api-access-rhcxz\") pod \"payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz\" (UID: \"08f655a2-8a9e-457c-92ac-e4c85df265f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"
Sep 19 10:47:45.125618 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:45.125589    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"
Sep 19 10:47:45.416931 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:45.416679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"]
Sep 19 10:47:46.037986 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:46.037946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz" event={"ID":"08f655a2-8a9e-457c-92ac-e4c85df265f6","Type":"ContainerStarted","Data":"b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15"}
Sep 19 10:47:46.038137 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:46.038011    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz" event={"ID":"08f655a2-8a9e-457c-92ac-e4c85df265f6","Type":"ContainerStarted","Data":"96734c76b64e48eaed1cb1f7b874db36fb747e3a8c66e3aeb940b7f6502a3e0f"}
Sep 19 10:47:46.038137 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:46.038067    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"
Sep 19 10:47:46.055137 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:46.055092    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz" podStartSLOduration=2.05508074 podStartE2EDuration="2.05508074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:47:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:47:46.053844744 +0000 UTC m=+788.953034637" watchObservedRunningTime="2026-09-19 10:47:46.05508074 +0000 UTC m=+788.954270632"
Sep 19 10:47:46.975588 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:46.975560    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"
Sep 19 10:47:48.993149 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:48.993119    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"
Sep 19 10:47:49.998796 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:49.998766    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"
Sep 19 10:47:51.073108 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:51.073069    2579 generic.go:356] "Generic (PLEG): container finished" podID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerID="5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae" exitCode=0
Sep 19 10:47:51.073592 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:51.073108    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" event={"ID":"7348dd3c-1f73-4de6-b771-00a6386e4d53","Type":"ContainerDied","Data":"5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae"}
Sep 19 10:47:51.073667 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:51.073589    2579 scope.go:117] "RemoveContainer" containerID="5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae"
Sep 19 10:47:51.074842 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:51.074818    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:47:51.074908 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:51.074884    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:47:51.074949 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:51.074919    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:47:52.080846 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:52.080767    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" event={"ID":"7348dd3c-1f73-4de6-b771-00a6386e4d53","Type":"ContainerStarted","Data":"d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3"}
Sep 19 10:47:52.360750 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:52.360631    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:52.360910 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:52.360852    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 10:47:52.360956 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:52.360905    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 10:47:53.360559 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:53.360521    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 10:47:53.360957 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:53.360613    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 10:47:54.361316 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.361278    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 10:47:54.361803 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.361338    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 10:47:54.614577 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.614492    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"]
Sep 19 10:47:54.616965 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.616949    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"
Sep 19 10:47:54.619398 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.619378    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-6cf6a0-dockercfg-kt847\""
Sep 19 10:47:54.619515 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.619438    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-6cf6a0\""
Sep 19 10:47:54.625217 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.625193    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"]
Sep 19 10:47:54.651904 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.651882    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"]
Sep 19 10:47:54.654235 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.654217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"
Sep 19 10:47:54.671874 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.671848    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"]
Sep 19 10:47:54.672810 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.672783    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7999w\" (UniqueName: \"kubernetes.io/projected/a242b6ff-c5cc-4376-871b-ce8c3ff52409-kube-api-access-7999w\") pod \"payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr\" (UID: \"a242b6ff-c5cc-4376-871b-ce8c3ff52409\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"
Sep 19 10:47:54.672983 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.672966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a242b6ff-c5cc-4376-871b-ce8c3ff52409-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr\" (UID: \"a242b6ff-c5cc-4376-871b-ce8c3ff52409\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"
Sep 19 10:47:54.673168 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.673152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr6t4\" (UniqueName: \"kubernetes.io/projected/ccb841a1-b27f-40e1-b47d-2033f488af47-kube-api-access-hr6t4\") pod \"payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr\" (UID: \"ccb841a1-b27f-40e1-b47d-2033f488af47\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"
Sep 19 10:47:54.673299 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.673285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccb841a1-b27f-40e1-b47d-2033f488af47-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr\" (UID: \"ccb841a1-b27f-40e1-b47d-2033f488af47\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"
Sep 19 10:47:54.774638 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.774601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7999w\" (UniqueName: \"kubernetes.io/projected/a242b6ff-c5cc-4376-871b-ce8c3ff52409-kube-api-access-7999w\") pod \"payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr\" (UID: \"a242b6ff-c5cc-4376-871b-ce8c3ff52409\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"
Sep 19 10:47:54.774638 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.774645    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a242b6ff-c5cc-4376-871b-ce8c3ff52409-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr\" (UID: \"a242b6ff-c5cc-4376-871b-ce8c3ff52409\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"
Sep 19 10:47:54.774912 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.774687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr6t4\" (UniqueName: \"kubernetes.io/projected/ccb841a1-b27f-40e1-b47d-2033f488af47-kube-api-access-hr6t4\") pod \"payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr\" (UID: \"ccb841a1-b27f-40e1-b47d-2033f488af47\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"
Sep 19 10:47:54.774912 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.774753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccb841a1-b27f-40e1-b47d-2033f488af47-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr\" (UID: \"ccb841a1-b27f-40e1-b47d-2033f488af47\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"
Sep 19 10:47:54.775610 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.775585    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccb841a1-b27f-40e1-b47d-2033f488af47-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr\" (UID: \"ccb841a1-b27f-40e1-b47d-2033f488af47\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"
Sep 19 10:47:54.775673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.775585    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a242b6ff-c5cc-4376-871b-ce8c3ff52409-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr\" (UID: \"a242b6ff-c5cc-4376-871b-ce8c3ff52409\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"
Sep 19 10:47:54.782472 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.782449    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr6t4\" (UniqueName: \"kubernetes.io/projected/ccb841a1-b27f-40e1-b47d-2033f488af47-kube-api-access-hr6t4\") pod \"payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr\" (UID: \"ccb841a1-b27f-40e1-b47d-2033f488af47\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"
Sep 19 10:47:54.782472 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.782462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7999w\" (UniqueName: \"kubernetes.io/projected/a242b6ff-c5cc-4376-871b-ce8c3ff52409-kube-api-access-7999w\") pod \"payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr\" (UID: \"a242b6ff-c5cc-4376-871b-ce8c3ff52409\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"
Sep 19 10:47:54.929902 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.929811    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"
Sep 19 10:47:54.965215 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:54.965181    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"
Sep 19 10:47:55.219611 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:47:55.219581    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda242b6ff_c5cc_4376_871b_ce8c3ff52409.slice/crio-17a5187e79732e15190f0e40db96a44df0c42e90d428a433259efc408a6301d7 WatchSource:0}: Error finding container 17a5187e79732e15190f0e40db96a44df0c42e90d428a433259efc408a6301d7: Status 404 returned error can't find the container with id 17a5187e79732e15190f0e40db96a44df0c42e90d428a433259efc408a6301d7
Sep 19 10:47:55.220092 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:55.220069    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"]
Sep 19 10:47:55.285797 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:55.285773    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"]
Sep 19 10:47:55.360976 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:55.360918    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 10:47:55.361138 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:55.360976    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 10:47:56.127332 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:56.127293    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr" event={"ID":"a242b6ff-c5cc-4376-871b-ce8c3ff52409","Type":"ContainerStarted","Data":"60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1"}
Sep 19 10:47:56.127824 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:56.127388    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"
Sep 19 10:47:56.127824 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:56.127415    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr" event={"ID":"a242b6ff-c5cc-4376-871b-ce8c3ff52409","Type":"ContainerStarted","Data":"17a5187e79732e15190f0e40db96a44df0c42e90d428a433259efc408a6301d7"}
Sep 19 10:47:56.129120 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:56.129095    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr" event={"ID":"ccb841a1-b27f-40e1-b47d-2033f488af47","Type":"ContainerStarted","Data":"068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe"}
Sep 19 10:47:56.129261 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:56.129141    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr" event={"ID":"ccb841a1-b27f-40e1-b47d-2033f488af47","Type":"ContainerStarted","Data":"544f0f3734350c553869f4fb4f45446d84e13f3d8fad5771e4952b1766e71c15"}
Sep 19 10:47:56.129261 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:56.129190    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"
Sep 19 10:47:56.144184 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:56.144139    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr" podStartSLOduration=2.144125067 podStartE2EDuration="2.144125067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:47:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:47:56.141315897 +0000 UTC m=+799.040505790" watchObservedRunningTime="2026-09-19 10:47:56.144125067 +0000 UTC m=+799.043314960"
Sep 19 10:47:56.155481 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:56.155439    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr" podStartSLOduration=2.1554237880000002 podStartE2EDuration="2.155423788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:47:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:47:56.154957168 +0000 UTC m=+799.054147087" watchObservedRunningTime="2026-09-19 10:47:56.155423788 +0000 UTC m=+799.054613681"
Sep 19 10:47:56.361209 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:56.361176    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 10:47:56.361373 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:56.361225    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 10:47:57.047341 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:57.047305    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"
Sep 19 10:47:57.364064 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:57.364037    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:57.364453 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:57.364303    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:47:57.364984 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:47:57.364950    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:48:07.139217 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:07.139186    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"
Sep 19 10:48:07.139653 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:07.139256    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"
Sep 19 10:48:08.295312 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:08.295274    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"]
Sep 19 10:48:08.295792 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:08.295496    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz" podUID="08f655a2-8a9e-457c-92ac-e4c85df265f6" containerName="payload-pre-processing" containerID="cri-o://b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15" gracePeriod=30
Sep 19 10:48:08.561975 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:08.561941    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"
Sep 19 10:48:08.714989 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:08.714959    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhcxz\" (UniqueName: \"kubernetes.io/projected/08f655a2-8a9e-457c-92ac-e4c85df265f6-kube-api-access-rhcxz\") pod \"08f655a2-8a9e-457c-92ac-e4c85df265f6\" (UID: \"08f655a2-8a9e-457c-92ac-e4c85df265f6\") "
Sep 19 10:48:08.715151 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:08.715069    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08f655a2-8a9e-457c-92ac-e4c85df265f6-plugins-config-volume\") pod \"08f655a2-8a9e-457c-92ac-e4c85df265f6\" (UID: \"08f655a2-8a9e-457c-92ac-e4c85df265f6\") "
Sep 19 10:48:08.715445 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:08.715422    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08f655a2-8a9e-457c-92ac-e4c85df265f6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "08f655a2-8a9e-457c-92ac-e4c85df265f6" (UID: "08f655a2-8a9e-457c-92ac-e4c85df265f6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:48:08.716988 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:08.716967    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08f655a2-8a9e-457c-92ac-e4c85df265f6-kube-api-access-rhcxz" (OuterVolumeSpecName: "kube-api-access-rhcxz") pod "08f655a2-8a9e-457c-92ac-e4c85df265f6" (UID: "08f655a2-8a9e-457c-92ac-e4c85df265f6"). InnerVolumeSpecName "kube-api-access-rhcxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:48:08.816838 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:08.816770    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08f655a2-8a9e-457c-92ac-e4c85df265f6-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:48:08.816838 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:08.816794    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhcxz\" (UniqueName: \"kubernetes.io/projected/08f655a2-8a9e-457c-92ac-e4c85df265f6-kube-api-access-rhcxz\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:48:09.206530 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:09.206447    2579 generic.go:356] "Generic (PLEG): container finished" podID="08f655a2-8a9e-457c-92ac-e4c85df265f6" containerID="b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15" exitCode=0
Sep 19 10:48:09.206530 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:09.206491    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"
Sep 19 10:48:09.206785 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:09.206530    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz" event={"ID":"08f655a2-8a9e-457c-92ac-e4c85df265f6","Type":"ContainerDied","Data":"b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15"}
Sep 19 10:48:09.206785 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:09.206577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz" event={"ID":"08f655a2-8a9e-457c-92ac-e4c85df265f6","Type":"ContainerDied","Data":"96734c76b64e48eaed1cb1f7b874db36fb747e3a8c66e3aeb940b7f6502a3e0f"}
Sep 19 10:48:09.206785 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:09.206600    2579 scope.go:117] "RemoveContainer" containerID="b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15"
Sep 19 10:48:09.216790 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:09.216772    2579 scope.go:117] "RemoveContainer" containerID="b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15"
Sep 19 10:48:09.217054 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:48:09.217035    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15\": container with ID starting with b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15 not found: ID does not exist" containerID="b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15"
Sep 19 10:48:09.217127 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:09.217060    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15"} err="failed to get container status \"b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15\": rpc error: code = NotFound desc = could not find container \"b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15\": container with ID starting with b5941e7fe0a2c733942d8d3f4bb2c9aaaa44c37eabdcb813c8613d2412648a15 not found: ID does not exist"
Sep 19 10:48:09.229898 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:09.229870    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"]
Sep 19 10:48:09.233690 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:09.233670    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz"]
Sep 19 10:48:11.203302 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:11.203266    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08f655a2-8a9e-457c-92ac-e4c85df265f6" path="/var/lib/kubelet/pods/08f655a2-8a9e-457c-92ac-e4c85df265f6/volumes"
Sep 19 10:48:12.752868 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.752836    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"]
Sep 19 10:48:12.753285 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.753272    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f655a2-8a9e-457c-92ac-e4c85df265f6" containerName="payload-pre-processing"
Sep 19 10:48:12.753285 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.753286    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f655a2-8a9e-457c-92ac-e4c85df265f6" containerName="payload-pre-processing"
Sep 19 10:48:12.753365 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.753350    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="08f655a2-8a9e-457c-92ac-e4c85df265f6" containerName="payload-pre-processing"
Sep 19 10:48:12.758058 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.758042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"
Sep 19 10:48:12.762351 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.762326    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-fb988ee6-dockercfg-6vlqp\""
Sep 19 10:48:12.762526 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.762363    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-fb988ee6\""
Sep 19 10:48:12.766600 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.766577    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"]
Sep 19 10:48:12.852215 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.852180    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/550329fb-fede-44b0-a3db-bde23bce1f03-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t\" (UID: \"550329fb-fede-44b0-a3db-bde23bce1f03\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"
Sep 19 10:48:12.852369 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.852270    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whj48\" (UniqueName: \"kubernetes.io/projected/550329fb-fede-44b0-a3db-bde23bce1f03-kube-api-access-whj48\") pod \"payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t\" (UID: \"550329fb-fede-44b0-a3db-bde23bce1f03\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"
Sep 19 10:48:12.953355 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.953320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whj48\" (UniqueName: \"kubernetes.io/projected/550329fb-fede-44b0-a3db-bde23bce1f03-kube-api-access-whj48\") pod \"payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t\" (UID: \"550329fb-fede-44b0-a3db-bde23bce1f03\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"
Sep 19 10:48:12.953539 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.953418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/550329fb-fede-44b0-a3db-bde23bce1f03-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t\" (UID: \"550329fb-fede-44b0-a3db-bde23bce1f03\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"
Sep 19 10:48:12.954092 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.954072    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/550329fb-fede-44b0-a3db-bde23bce1f03-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t\" (UID: \"550329fb-fede-44b0-a3db-bde23bce1f03\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"
Sep 19 10:48:12.961352 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:12.961322    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whj48\" (UniqueName: \"kubernetes.io/projected/550329fb-fede-44b0-a3db-bde23bce1f03-kube-api-access-whj48\") pod \"payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t\" (UID: \"550329fb-fede-44b0-a3db-bde23bce1f03\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"
Sep 19 10:48:13.070717 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:13.070692    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"
Sep 19 10:48:13.343141 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:13.343115    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"]
Sep 19 10:48:13.345316 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:48:13.345285    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550329fb_fede_44b0_a3db_bde23bce1f03.slice/crio-62c587a919c66f91983588af8b23d663a48a81dff449fe226ec8be26f7271c98 WatchSource:0}: Error finding container 62c587a919c66f91983588af8b23d663a48a81dff449fe226ec8be26f7271c98: Status 404 returned error can't find the container with id 62c587a919c66f91983588af8b23d663a48a81dff449fe226ec8be26f7271c98
Sep 19 10:48:14.236079 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:14.236038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t" event={"ID":"550329fb-fede-44b0-a3db-bde23bce1f03","Type":"ContainerStarted","Data":"06ca69a8d8cf92c7a2251f35f4d1eb9861f242279e5245a6dc9c71b8a4b25890"}
Sep 19 10:48:14.236468 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:14.236099    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"
Sep 19 10:48:14.236468 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:14.236125    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t" event={"ID":"550329fb-fede-44b0-a3db-bde23bce1f03","Type":"ContainerStarted","Data":"62c587a919c66f91983588af8b23d663a48a81dff449fe226ec8be26f7271c98"}
Sep 19 10:48:14.252068 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:14.252025    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t" podStartSLOduration=2.252010231 podStartE2EDuration="2.252010231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:48:14.251645231 +0000 UTC m=+817.150835123" watchObservedRunningTime="2026-09-19 10:48:14.252010231 +0000 UTC m=+817.151200123"
Sep 19 10:48:25.242649 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:25.242617    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"
Sep 19 10:48:53.270326 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:53.270292    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"]
Sep 19 10:48:53.271225 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:53.271184    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t" podUID="550329fb-fede-44b0-a3db-bde23bce1f03" containerName="payload-pre-processing" containerID="cri-o://06ca69a8d8cf92c7a2251f35f4d1eb9861f242279e5245a6dc9c71b8a4b25890" gracePeriod=30
Sep 19 10:48:53.449796 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:53.449750    2579 generic.go:356] "Generic (PLEG): container finished" podID="550329fb-fede-44b0-a3db-bde23bce1f03" containerID="06ca69a8d8cf92c7a2251f35f4d1eb9861f242279e5245a6dc9c71b8a4b25890" exitCode=0
Sep 19 10:48:53.449796 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:53.449779    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t" event={"ID":"550329fb-fede-44b0-a3db-bde23bce1f03","Type":"ContainerDied","Data":"06ca69a8d8cf92c7a2251f35f4d1eb9861f242279e5245a6dc9c71b8a4b25890"}
Sep 19 10:48:53.540969 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:53.540939    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"
Sep 19 10:48:53.605236 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:53.605212    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/550329fb-fede-44b0-a3db-bde23bce1f03-plugins-config-volume\") pod \"550329fb-fede-44b0-a3db-bde23bce1f03\" (UID: \"550329fb-fede-44b0-a3db-bde23bce1f03\") "
Sep 19 10:48:53.605417 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:53.605304    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whj48\" (UniqueName: \"kubernetes.io/projected/550329fb-fede-44b0-a3db-bde23bce1f03-kube-api-access-whj48\") pod \"550329fb-fede-44b0-a3db-bde23bce1f03\" (UID: \"550329fb-fede-44b0-a3db-bde23bce1f03\") "
Sep 19 10:48:53.605622 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:53.605597    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/550329fb-fede-44b0-a3db-bde23bce1f03-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "550329fb-fede-44b0-a3db-bde23bce1f03" (UID: "550329fb-fede-44b0-a3db-bde23bce1f03"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:48:53.607494 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:53.607467    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550329fb-fede-44b0-a3db-bde23bce1f03-kube-api-access-whj48" (OuterVolumeSpecName: "kube-api-access-whj48") pod "550329fb-fede-44b0-a3db-bde23bce1f03" (UID: "550329fb-fede-44b0-a3db-bde23bce1f03"). InnerVolumeSpecName "kube-api-access-whj48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:48:53.706423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:53.706393    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/550329fb-fede-44b0-a3db-bde23bce1f03-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:48:53.706423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:53.706419    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whj48\" (UniqueName: \"kubernetes.io/projected/550329fb-fede-44b0-a3db-bde23bce1f03-kube-api-access-whj48\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:48:54.457219 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:54.457185    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t" event={"ID":"550329fb-fede-44b0-a3db-bde23bce1f03","Type":"ContainerDied","Data":"62c587a919c66f91983588af8b23d663a48a81dff449fe226ec8be26f7271c98"}
Sep 19 10:48:54.457219 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:54.457217    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"
Sep 19 10:48:54.457837 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:54.457248    2579 scope.go:117] "RemoveContainer" containerID="06ca69a8d8cf92c7a2251f35f4d1eb9861f242279e5245a6dc9c71b8a4b25890"
Sep 19 10:48:54.483412 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:54.483384    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"]
Sep 19 10:48:54.486214 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:54.486190    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t"]
Sep 19 10:48:55.204896 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:48:55.204861    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="550329fb-fede-44b0-a3db-bde23bce1f03" path="/var/lib/kubelet/pods/550329fb-fede-44b0-a3db-bde23bce1f03/volumes"
Sep 19 10:49:35.315630 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.315591    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"]
Sep 19 10:49:35.316367 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.316343    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="550329fb-fede-44b0-a3db-bde23bce1f03" containerName="payload-pre-processing"
Sep 19 10:49:35.316412 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.316372    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="550329fb-fede-44b0-a3db-bde23bce1f03" containerName="payload-pre-processing"
Sep 19 10:49:35.316482 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.316470    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="550329fb-fede-44b0-a3db-bde23bce1f03" containerName="payload-pre-processing"
Sep 19 10:49:35.319902 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.319882    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.326754 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.322963    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-580e01\"/\"openshift-service-ca.crt\""
Sep 19 10:49:35.330865 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.330841    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-580e01\"/\"premium-w3-580e01-kserve-self-signed-certs\""
Sep 19 10:49:35.331000 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.330880    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-580e01\"/\"default-dockercfg-kml78\""
Sep 19 10:49:35.331000 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.330891    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-580e01\"/\"kube-root-ca.crt\""
Sep 19 10:49:35.335110 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.335085    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"]
Sep 19 10:49:35.351699 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.351671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8l8l\" (UniqueName: \"kubernetes.io/projected/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-kube-api-access-w8l8l\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.351831 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.351811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-tls-certs\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.351876 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.351861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-model-cache\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.351946 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.351931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-tmp-dir\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.351982 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.351968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-home\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.352019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.352002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-dshm\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.453432 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.453401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-tls-certs\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.453538 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.453450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-model-cache\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.453538 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.453495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-tmp-dir\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.453538 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.453533    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-home\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.453887 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.453840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-dshm\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.454016 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.453917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-model-cache\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.454016 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.453925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8l8l\" (UniqueName: \"kubernetes.io/projected/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-kube-api-access-w8l8l\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.454157 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.454137    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-tmp-dir\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.454236 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.454143    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-home\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.456019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.455999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-dshm\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.456403 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.456376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-tls-certs\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.461159 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.461140    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8l8l\" (UniqueName: \"kubernetes.io/projected/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-kube-api-access-w8l8l\") pod \"premium-w3-580e01-kserve-76d599bc46-z596w\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") " pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.638454 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.638373    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:35.912968 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:35.912887    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"]
Sep 19 10:49:35.916118 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:49:35.916085    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fb8fb7f_df3e_4b67_9ed4_261d35f3d50e.slice/crio-6580e0b8879d3c26a0c0edcee43b178bd7ec11b080603d3ff8b9861701159f32 WatchSource:0}: Error finding container 6580e0b8879d3c26a0c0edcee43b178bd7ec11b080603d3ff8b9861701159f32: Status 404 returned error can't find the container with id 6580e0b8879d3c26a0c0edcee43b178bd7ec11b080603d3ff8b9861701159f32
Sep 19 10:49:36.691394 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:36.691359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w" event={"ID":"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e","Type":"ContainerStarted","Data":"9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560"}
Sep 19 10:49:36.691880 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:36.691402    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w" event={"ID":"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e","Type":"ContainerStarted","Data":"6580e0b8879d3c26a0c0edcee43b178bd7ec11b080603d3ff8b9861701159f32"}
Sep 19 10:49:36.708450 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:36.708407    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w" podStartSLOduration=1.708393004 podStartE2EDuration="1.708393004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:49:36.705894962 +0000 UTC m=+899.605084855" watchObservedRunningTime="2026-09-19 10:49:36.708393004 +0000 UTC m=+899.607582895"
Sep 19 10:49:39.195891 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:39.195866    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:49:39.196338 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:39.195964    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:49:45.639487 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:45.639451    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:45.639982 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:45.639508    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:45.652235 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:45.652207    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:49:45.758545 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:49:45.758515    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:51:56.238687 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.238656    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"]
Sep 19 10:51:56.242635 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.242614    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.244754 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.244707    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c3f23ba4-serving-cert\""
Sep 19 10:51:56.254817 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.254793    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"]
Sep 19 10:51:56.335092 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.335064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-maas-api-tls\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.335223 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.335122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-openshift-service-ca\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.335223 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.335165    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpzrw\" (UniqueName: \"kubernetes.io/projected/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-kube-api-access-kpzrw\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.335299 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.335246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-metrics-certs\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.436420 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.436387    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-openshift-service-ca\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.436565 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.436438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpzrw\" (UniqueName: \"kubernetes.io/projected/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-kube-api-access-kpzrw\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.436565 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.436519    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-metrics-certs\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.436565 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.436551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-maas-api-tls\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.436751 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:51:56.436675    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-serving-cert: secret "maas-api-e2e-mt-c3f23ba4-serving-cert" not found
Sep 19 10:51:56.436824 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:51:56.436776    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-maas-api-tls podName:7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a nodeName:}" failed. No retries permitted until 2026-09-19 10:51:56.936754037 +0000 UTC m=+1039.835943921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-maas-api-tls") pod "maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98" (UID: "7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a") : secret "maas-api-e2e-mt-c3f23ba4-serving-cert" not found
Sep 19 10:51:56.437164 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.437142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-openshift-service-ca\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.438860 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.438841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-metrics-certs\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.445967 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.445939    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpzrw\" (UniqueName: \"kubernetes.io/projected/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-kube-api-access-kpzrw\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.941079 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.941044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-maas-api-tls\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:56.943466 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:56.943441    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-maas-api-tls\") pod \"maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:57.156125 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:57.156095    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:57.429319 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:57.429294    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"]
Sep 19 10:51:57.430704 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:51:57.430681    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b60d45a_d27b_4ff2_8945_f4dd3d9c5b3a.slice/crio-8cfcb8d13a538adbe9e5099bd06246c725fc9fa9f7303017b7748e7dd37234cd WatchSource:0}: Error finding container 8cfcb8d13a538adbe9e5099bd06246c725fc9fa9f7303017b7748e7dd37234cd: Status 404 returned error can't find the container with id 8cfcb8d13a538adbe9e5099bd06246c725fc9fa9f7303017b7748e7dd37234cd
Sep 19 10:51:57.432000 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:57.431983    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 10:51:57.474524 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:57.474460    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98" event={"ID":"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a","Type":"ContainerStarted","Data":"8cfcb8d13a538adbe9e5099bd06246c725fc9fa9f7303017b7748e7dd37234cd"}
Sep 19 10:51:58.481393 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:58.481357    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98" event={"ID":"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a","Type":"ContainerStarted","Data":"fbe9b24194677d2939ea8343df4109786de6aeff76895dd5229778876967afa0"}
Sep 19 10:51:58.481785 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:58.481491    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:51:58.497445 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:51:58.497405    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98" podStartSLOduration=2.020313254 podStartE2EDuration="2.497390997s" totalImagesPullingTime="477.077743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:51:58.496830384 +0000 UTC m=+1041.396020277" watchObservedRunningTime="2026-09-19 10:51:58.497390997 +0000 UTC m=+1041.396580888"
Sep 19 10:52:04.493206 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:04.493177    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:52:41.518692 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.518659    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"]
Sep 19 10:52:41.519283 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.518909    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98" podUID="7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a" containerName="maas-api" containerID="cri-o://fbe9b24194677d2939ea8343df4109786de6aeff76895dd5229778876967afa0" gracePeriod=30
Sep 19 10:52:41.723408 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.723373    2579 generic.go:356] "Generic (PLEG): container finished" podID="7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a" containerID="fbe9b24194677d2939ea8343df4109786de6aeff76895dd5229778876967afa0" exitCode=0
Sep 19 10:52:41.723580 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.723445    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98" event={"ID":"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a","Type":"ContainerDied","Data":"fbe9b24194677d2939ea8343df4109786de6aeff76895dd5229778876967afa0"}
Sep 19 10:52:41.779702 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.779636    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:52:41.919056 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.919020    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-openshift-service-ca\") pod \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") "
Sep 19 10:52:41.919249 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.919067    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpzrw\" (UniqueName: \"kubernetes.io/projected/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-kube-api-access-kpzrw\") pod \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") "
Sep 19 10:52:41.919249 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.919152    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-maas-api-tls\") pod \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") "
Sep 19 10:52:41.919249 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.919234    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-metrics-certs\") pod \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\" (UID: \"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a\") "
Sep 19 10:52:41.919423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.919393    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a" (UID: "7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:52:41.919631 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.919610    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-openshift-service-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:52:41.921452 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.921425    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a" (UID: "7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:52:41.921538 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.921494    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-kube-api-access-kpzrw" (OuterVolumeSpecName: "kube-api-access-kpzrw") pod "7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a" (UID: "7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a"). InnerVolumeSpecName "kube-api-access-kpzrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:52:41.921627 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:41.921604    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a" (UID: "7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:52:42.020482 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:42.020454    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpzrw\" (UniqueName: \"kubernetes.io/projected/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-kube-api-access-kpzrw\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:52:42.020482 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:42.020478    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-maas-api-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:52:42.020651 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:42.020489    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a-metrics-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:52:42.730214 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:42.730184    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"
Sep 19 10:52:42.730214 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:42.730199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98" event={"ID":"7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a","Type":"ContainerDied","Data":"8cfcb8d13a538adbe9e5099bd06246c725fc9fa9f7303017b7748e7dd37234cd"}
Sep 19 10:52:42.730789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:42.730256    2579 scope.go:117] "RemoveContainer" containerID="fbe9b24194677d2939ea8343df4109786de6aeff76895dd5229778876967afa0"
Sep 19 10:52:42.751652 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:42.751623    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"]
Sep 19 10:52:42.757574 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:42.757551    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c3f23ba4-7664b96fbf-68c98"]
Sep 19 10:52:43.206229 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:43.206189    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a" path="/var/lib/kubelet/pods/7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a/volumes"
Sep 19 10:52:45.367352 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.367321    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"]
Sep 19 10:52:45.367849 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.367521    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx" podUID="a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0" containerName="maas-api" containerID="cri-o://eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41" gracePeriod=30
Sep 19 10:52:45.426575 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.426544    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"]
Sep 19 10:52:45.426812 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.426785    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47" podUID="e52ac44d-fe77-4cdd-8407-012158d55ea9" containerName="payload-processing" containerID="cri-o://a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d" gracePeriod=30
Sep 19 10:52:45.687255 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.687224    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:52:45.720309 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.720287    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"
Sep 19 10:52:45.748742 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.748702    2579 generic.go:356] "Generic (PLEG): container finished" podID="e52ac44d-fe77-4cdd-8407-012158d55ea9" containerID="a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d" exitCode=0
Sep 19 10:52:45.748879 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.748757    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"
Sep 19 10:52:45.748879 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.748762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47" event={"ID":"e52ac44d-fe77-4cdd-8407-012158d55ea9","Type":"ContainerDied","Data":"a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d"}
Sep 19 10:52:45.748879 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.748812    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47" event={"ID":"e52ac44d-fe77-4cdd-8407-012158d55ea9","Type":"ContainerDied","Data":"7a8e0194ed6f6892ebd12b66e11a1f234f17294c27f1ae85246d858b574df13d"}
Sep 19 10:52:45.748879 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.748842    2579 scope.go:117] "RemoveContainer" containerID="a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d"
Sep 19 10:52:45.750526 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.750502    2579 generic.go:356] "Generic (PLEG): container finished" podID="a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0" containerID="eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41" exitCode=0
Sep 19 10:52:45.750648 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.750545    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"
Sep 19 10:52:45.750648 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.750591    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx" event={"ID":"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0","Type":"ContainerDied","Data":"eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41"}
Sep 19 10:52:45.750648 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.750643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx" event={"ID":"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0","Type":"ContainerDied","Data":"f4755eda21be81382c3d4c3f9cc890368712c28759f5b89fe2960fbee6f7f3e7"}
Sep 19 10:52:45.753014 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.752979    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-metrics-certs\") pod \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") "
Sep 19 10:52:45.753133 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.753044    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-maas-api-tls\") pod \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") "
Sep 19 10:52:45.753133 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.753087    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-openshift-service-ca\") pod \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") "
Sep 19 10:52:45.753253 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.753156    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfgrx\" (UniqueName: \"kubernetes.io/projected/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-kube-api-access-rfgrx\") pod \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\" (UID: \"a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0\") "
Sep 19 10:52:45.763569 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.754391    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0" (UID: "a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:52:45.763569 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.762800    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0" (UID: "a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:52:45.764767 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.762497    2579 scope.go:117] "RemoveContainer" containerID="a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d"
Sep 19 10:52:45.766362 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:52:45.766331    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d\": container with ID starting with a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d not found: ID does not exist" containerID="a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d"
Sep 19 10:52:45.766474 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.766344    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0" (UID: "a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:52:45.766474 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.766387    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d"} err="failed to get container status \"a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d\": rpc error: code = NotFound desc = could not find container \"a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d\": container with ID starting with a234a3f7bc938145040f9b6377b34a69375598b6dfddbcd2d53d108089dad57d not found: ID does not exist"
Sep 19 10:52:45.766604 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.766458    2579 scope.go:117] "RemoveContainer" containerID="eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41"
Sep 19 10:52:45.766918 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.766883    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-kube-api-access-rfgrx" (OuterVolumeSpecName: "kube-api-access-rfgrx") pod "a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0" (UID: "a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0"). InnerVolumeSpecName "kube-api-access-rfgrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:52:45.778934 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.778914    2579 scope.go:117] "RemoveContainer" containerID="eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41"
Sep 19 10:52:45.779173 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:52:45.779153    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41\": container with ID starting with eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41 not found: ID does not exist" containerID="eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41"
Sep 19 10:52:45.779238 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.779182    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41"} err="failed to get container status \"eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41\": rpc error: code = NotFound desc = could not find container \"eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41\": container with ID starting with eb8876980e6444a941b5cbb4d8b317cd1d3a685ab1a1f69bf522862d1bdf2c41 not found: ID does not exist"
Sep 19 10:52:45.854314 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.854287    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e52ac44d-fe77-4cdd-8407-012158d55ea9-plugins-config-volume\") pod \"e52ac44d-fe77-4cdd-8407-012158d55ea9\" (UID: \"e52ac44d-fe77-4cdd-8407-012158d55ea9\") "
Sep 19 10:52:45.854452 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.854366    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krkfz\" (UniqueName: \"kubernetes.io/projected/e52ac44d-fe77-4cdd-8407-012158d55ea9-kube-api-access-krkfz\") pod \"e52ac44d-fe77-4cdd-8407-012158d55ea9\" (UID: \"e52ac44d-fe77-4cdd-8407-012158d55ea9\") "
Sep 19 10:52:45.854633 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.854618    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfgrx\" (UniqueName: \"kubernetes.io/projected/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-kube-api-access-rfgrx\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:52:45.854712 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.854634    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-metrics-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:52:45.854712 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.854645    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-maas-api-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:52:45.854712 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.854653    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0-openshift-service-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:52:45.854712 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.854630    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e52ac44d-fe77-4cdd-8407-012158d55ea9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e52ac44d-fe77-4cdd-8407-012158d55ea9" (UID: "e52ac44d-fe77-4cdd-8407-012158d55ea9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:52:45.856308 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.856286    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e52ac44d-fe77-4cdd-8407-012158d55ea9-kube-api-access-krkfz" (OuterVolumeSpecName: "kube-api-access-krkfz") pod "e52ac44d-fe77-4cdd-8407-012158d55ea9" (UID: "e52ac44d-fe77-4cdd-8407-012158d55ea9"). InnerVolumeSpecName "kube-api-access-krkfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:52:45.955938 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.955882    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krkfz\" (UniqueName: \"kubernetes.io/projected/e52ac44d-fe77-4cdd-8407-012158d55ea9-kube-api-access-krkfz\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:52:45.955938 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:45.955905    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e52ac44d-fe77-4cdd-8407-012158d55ea9-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:52:46.072460 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:46.072436    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"]
Sep 19 10:52:46.077111 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:46.077087    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47"]
Sep 19 10:52:46.085806 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:46.085783    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"]
Sep 19 10:52:46.089863 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:46.089840    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f91f97-6c9dd7789f-vhjxx"]
Sep 19 10:52:47.202865 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:47.202835    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0" path="/var/lib/kubelet/pods/a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0/volumes"
Sep 19 10:52:47.203308 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:52:47.203201    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e52ac44d-fe77-4cdd-8407-012158d55ea9" path="/var/lib/kubelet/pods/e52ac44d-fe77-4cdd-8407-012158d55ea9/volumes"
Sep 19 10:53:02.831201 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:02.831167    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"]
Sep 19 10:53:02.833857 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:02.831488    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr" podUID="ccb841a1-b27f-40e1-b47d-2033f488af47" containerName="payload-processing" containerID="cri-o://068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe" gracePeriod=30
Sep 19 10:53:02.834316 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:02.834218    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"]
Sep 19 10:53:02.834432 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:02.834398    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr" podUID="a242b6ff-c5cc-4376-871b-ce8c3ff52409" containerName="payload-pre-processing" containerID="cri-o://60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1" gracePeriod=30
Sep 19 10:53:03.126328 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.126297    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"
Sep 19 10:53:03.130472 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.130439    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"
Sep 19 10:53:03.208060 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.208037    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7999w\" (UniqueName: \"kubernetes.io/projected/a242b6ff-c5cc-4376-871b-ce8c3ff52409-kube-api-access-7999w\") pod \"a242b6ff-c5cc-4376-871b-ce8c3ff52409\" (UID: \"a242b6ff-c5cc-4376-871b-ce8c3ff52409\") "
Sep 19 10:53:03.208235 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.208079    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccb841a1-b27f-40e1-b47d-2033f488af47-plugins-config-volume\") pod \"ccb841a1-b27f-40e1-b47d-2033f488af47\" (UID: \"ccb841a1-b27f-40e1-b47d-2033f488af47\") "
Sep 19 10:53:03.208235 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.208105    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a242b6ff-c5cc-4376-871b-ce8c3ff52409-plugins-config-volume\") pod \"a242b6ff-c5cc-4376-871b-ce8c3ff52409\" (UID: \"a242b6ff-c5cc-4376-871b-ce8c3ff52409\") "
Sep 19 10:53:03.208235 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.208226    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr6t4\" (UniqueName: \"kubernetes.io/projected/ccb841a1-b27f-40e1-b47d-2033f488af47-kube-api-access-hr6t4\") pod \"ccb841a1-b27f-40e1-b47d-2033f488af47\" (UID: \"ccb841a1-b27f-40e1-b47d-2033f488af47\") "
Sep 19 10:53:03.208496 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.208472    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a242b6ff-c5cc-4376-871b-ce8c3ff52409-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a242b6ff-c5cc-4376-871b-ce8c3ff52409" (UID: "a242b6ff-c5cc-4376-871b-ce8c3ff52409"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:53:03.208584 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.208497    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccb841a1-b27f-40e1-b47d-2033f488af47-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ccb841a1-b27f-40e1-b47d-2033f488af47" (UID: "ccb841a1-b27f-40e1-b47d-2033f488af47"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:53:03.208658 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.208639    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccb841a1-b27f-40e1-b47d-2033f488af47-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:53:03.208716 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.208664    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a242b6ff-c5cc-4376-871b-ce8c3ff52409-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:53:03.210493 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.210466    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccb841a1-b27f-40e1-b47d-2033f488af47-kube-api-access-hr6t4" (OuterVolumeSpecName: "kube-api-access-hr6t4") pod "ccb841a1-b27f-40e1-b47d-2033f488af47" (UID: "ccb841a1-b27f-40e1-b47d-2033f488af47"). InnerVolumeSpecName "kube-api-access-hr6t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:53:03.210638 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.210551    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a242b6ff-c5cc-4376-871b-ce8c3ff52409-kube-api-access-7999w" (OuterVolumeSpecName: "kube-api-access-7999w") pod "a242b6ff-c5cc-4376-871b-ce8c3ff52409" (UID: "a242b6ff-c5cc-4376-871b-ce8c3ff52409"). InnerVolumeSpecName "kube-api-access-7999w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:53:03.309084 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.309051    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7999w\" (UniqueName: \"kubernetes.io/projected/a242b6ff-c5cc-4376-871b-ce8c3ff52409-kube-api-access-7999w\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:53:03.309084 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.309078    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr6t4\" (UniqueName: \"kubernetes.io/projected/ccb841a1-b27f-40e1-b47d-2033f488af47-kube-api-access-hr6t4\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:53:03.856222 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.856187    2579 generic.go:356] "Generic (PLEG): container finished" podID="ccb841a1-b27f-40e1-b47d-2033f488af47" containerID="068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe" exitCode=0
Sep 19 10:53:03.856656 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.856244    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"
Sep 19 10:53:03.856656 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.856266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr" event={"ID":"ccb841a1-b27f-40e1-b47d-2033f488af47","Type":"ContainerDied","Data":"068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe"}
Sep 19 10:53:03.856656 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.856351    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr" event={"ID":"ccb841a1-b27f-40e1-b47d-2033f488af47","Type":"ContainerDied","Data":"544f0f3734350c553869f4fb4f45446d84e13f3d8fad5771e4952b1766e71c15"}
Sep 19 10:53:03.856656 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.856379    2579 scope.go:117] "RemoveContainer" containerID="068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe"
Sep 19 10:53:03.858036 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.858013    2579 generic.go:356] "Generic (PLEG): container finished" podID="a242b6ff-c5cc-4376-871b-ce8c3ff52409" containerID="60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1" exitCode=0
Sep 19 10:53:03.858143 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.858066    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"
Sep 19 10:53:03.858143 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.858081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr" event={"ID":"a242b6ff-c5cc-4376-871b-ce8c3ff52409","Type":"ContainerDied","Data":"60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1"}
Sep 19 10:53:03.858250 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.858141    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr" event={"ID":"a242b6ff-c5cc-4376-871b-ce8c3ff52409","Type":"ContainerDied","Data":"17a5187e79732e15190f0e40db96a44df0c42e90d428a433259efc408a6301d7"}
Sep 19 10:53:03.868268 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.868251    2579 scope.go:117] "RemoveContainer" containerID="068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe"
Sep 19 10:53:03.868568 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:53:03.868544    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe\": container with ID starting with 068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe not found: ID does not exist" containerID="068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe"
Sep 19 10:53:03.868663 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.868589    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe"} err="failed to get container status \"068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe\": rpc error: code = NotFound desc = could not find container \"068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe\": container with ID starting with 068b9ae50b393978d899a3a784caba83ac986e812e61b70c4cbd2b17dd07f2fe not found: ID does not exist"
Sep 19 10:53:03.868663 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.868614    2579 scope.go:117] "RemoveContainer" containerID="60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1"
Sep 19 10:53:03.877615 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.877598    2579 scope.go:117] "RemoveContainer" containerID="60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1"
Sep 19 10:53:03.877931 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:53:03.877913    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1\": container with ID starting with 60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1 not found: ID does not exist" containerID="60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1"
Sep 19 10:53:03.878004 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.877938    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1"} err="failed to get container status \"60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1\": rpc error: code = NotFound desc = could not find container \"60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1\": container with ID starting with 60d7fc18e4e199376e322294bd4d8510d8492a2763270e0c7cd20dfb5845b4c1 not found: ID does not exist"
Sep 19 10:53:03.881910 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.881889    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"]
Sep 19 10:53:03.885452 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.885430    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr"]
Sep 19 10:53:03.894174 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.894154    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"]
Sep 19 10:53:03.897829 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:03.897810    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr"]
Sep 19 10:53:05.203106 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:05.203072    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a242b6ff-c5cc-4376-871b-ce8c3ff52409" path="/var/lib/kubelet/pods/a242b6ff-c5cc-4376-871b-ce8c3ff52409/volumes"
Sep 19 10:53:05.203467 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:05.203425    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccb841a1-b27f-40e1-b47d-2033f488af47" path="/var/lib/kubelet/pods/ccb841a1-b27f-40e1-b47d-2033f488af47/volumes"
Sep 19 10:53:07.657515 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.657485    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"]
Sep 19 10:53:07.658019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.657932    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a242b6ff-c5cc-4376-871b-ce8c3ff52409" containerName="payload-pre-processing"
Sep 19 10:53:07.658019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.657945    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a242b6ff-c5cc-4376-871b-ce8c3ff52409" containerName="payload-pre-processing"
Sep 19 10:53:07.658019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.657960    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e52ac44d-fe77-4cdd-8407-012158d55ea9" containerName="payload-processing"
Sep 19 10:53:07.658019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.657967    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e52ac44d-fe77-4cdd-8407-012158d55ea9" containerName="payload-processing"
Sep 19 10:53:07.658019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.657975    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a" containerName="maas-api"
Sep 19 10:53:07.658019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.657981    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a" containerName="maas-api"
Sep 19 10:53:07.658019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.657991    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccb841a1-b27f-40e1-b47d-2033f488af47" containerName="payload-processing"
Sep 19 10:53:07.658019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.657997    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccb841a1-b27f-40e1-b47d-2033f488af47" containerName="payload-processing"
Sep 19 10:53:07.658019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.658014    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0" containerName="maas-api"
Sep 19 10:53:07.658019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.658019    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0" containerName="maas-api"
Sep 19 10:53:07.658652 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.658105    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a242b6ff-c5cc-4376-871b-ce8c3ff52409" containerName="payload-pre-processing"
Sep 19 10:53:07.658652 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.658113    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccb841a1-b27f-40e1-b47d-2033f488af47" containerName="payload-processing"
Sep 19 10:53:07.658652 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.658121    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1520f8d-b3e1-4f2b-a131-ccdcbc01b1c0" containerName="maas-api"
Sep 19 10:53:07.658652 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.658127    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b60d45a-d27b-4ff2-8945-f4dd3d9c5b3a" containerName="maas-api"
Sep 19 10:53:07.658652 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.658133    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e52ac44d-fe77-4cdd-8407-012158d55ea9" containerName="payload-processing"
Sep 19 10:53:07.663398 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.663370    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:07.665497 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.665470    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w1-9ac6b3-serving-cert\""
Sep 19 10:53:07.669495 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.669474    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"]
Sep 19 10:53:07.751860 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.751835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:07.752052 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.751929    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:07.752052 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.751955    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c674\" (UniqueName: \"kubernetes.io/projected/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-kube-api-access-5c674\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:07.752052 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.751993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:07.852602 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.852576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:07.852755 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.852612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c674\" (UniqueName: \"kubernetes.io/projected/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-kube-api-access-5c674\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:07.852755 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.852671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:07.852755 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.852719    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:07.852947 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:53:07.852929    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-serving-cert: secret "maas-api-e2e-shared-a-w1-9ac6b3-serving-cert" not found
Sep 19 10:53:07.853012 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:53:07.853002    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-maas-api-tls podName:cc1d06f6-3de0-4bbb-9656-aedab1dd61ab nodeName:}" failed. No retries permitted until 2026-09-19 10:53:08.352985037 +0000 UTC m=+1111.252174913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-maas-api-tls") pod "maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj" (UID: "cc1d06f6-3de0-4bbb-9656-aedab1dd61ab") : secret "maas-api-e2e-shared-a-w1-9ac6b3-serving-cert" not found
Sep 19 10:53:07.853410 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.853381    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:07.855239 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.855218    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:07.860570 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:07.860549    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c674\" (UniqueName: \"kubernetes.io/projected/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-kube-api-access-5c674\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:08.227741 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.227697    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"]
Sep 19 10:53:08.231511 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.231492    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"
Sep 19 10:53:08.233772 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.233751    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w1-9ac6b3\""
Sep 19 10:53:08.234045 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.234028    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w1-9ac6b3-dockercfg-vpgrp\""
Sep 19 10:53:08.244349 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.244323    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"]
Sep 19 10:53:08.256761 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.256699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d63cb64b-0099-435d-be84-16f09aaa9799-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695\" (UID: \"d63cb64b-0099-435d-be84-16f09aaa9799\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"
Sep 19 10:53:08.256884 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.256863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxrjt\" (UniqueName: \"kubernetes.io/projected/d63cb64b-0099-435d-be84-16f09aaa9799-kube-api-access-jxrjt\") pod \"payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695\" (UID: \"d63cb64b-0099-435d-be84-16f09aaa9799\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"
Sep 19 10:53:08.266700 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.266674    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"]
Sep 19 10:53:08.270154 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.270140    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"
Sep 19 10:53:08.280639 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.280614    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"]
Sep 19 10:53:08.357430 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.357402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgr2w\" (UniqueName: \"kubernetes.io/projected/3d669c10-a611-425a-ab8f-82668cdefee1-kube-api-access-dgr2w\") pod \"payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz\" (UID: \"3d669c10-a611-425a-ab8f-82668cdefee1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"
Sep 19 10:53:08.357589 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.357440    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d63cb64b-0099-435d-be84-16f09aaa9799-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695\" (UID: \"d63cb64b-0099-435d-be84-16f09aaa9799\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"
Sep 19 10:53:08.357589 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.357491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrjt\" (UniqueName: \"kubernetes.io/projected/d63cb64b-0099-435d-be84-16f09aaa9799-kube-api-access-jxrjt\") pod \"payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695\" (UID: \"d63cb64b-0099-435d-be84-16f09aaa9799\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"
Sep 19 10:53:08.357589 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.357551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d669c10-a611-425a-ab8f-82668cdefee1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz\" (UID: \"3d669c10-a611-425a-ab8f-82668cdefee1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"
Sep 19 10:53:08.357589 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.357572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:08.358243 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.358218    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d63cb64b-0099-435d-be84-16f09aaa9799-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695\" (UID: \"d63cb64b-0099-435d-be84-16f09aaa9799\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"
Sep 19 10:53:08.359889 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.359872    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:08.365110 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.365084    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxrjt\" (UniqueName: \"kubernetes.io/projected/d63cb64b-0099-435d-be84-16f09aaa9799-kube-api-access-jxrjt\") pod \"payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695\" (UID: \"d63cb64b-0099-435d-be84-16f09aaa9799\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"
Sep 19 10:53:08.458938 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.458914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgr2w\" (UniqueName: \"kubernetes.io/projected/3d669c10-a611-425a-ab8f-82668cdefee1-kube-api-access-dgr2w\") pod \"payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz\" (UID: \"3d669c10-a611-425a-ab8f-82668cdefee1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"
Sep 19 10:53:08.459071 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.459058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d669c10-a611-425a-ab8f-82668cdefee1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz\" (UID: \"3d669c10-a611-425a-ab8f-82668cdefee1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"
Sep 19 10:53:08.459673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.459655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d669c10-a611-425a-ab8f-82668cdefee1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz\" (UID: \"3d669c10-a611-425a-ab8f-82668cdefee1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"
Sep 19 10:53:08.467223 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.467199    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgr2w\" (UniqueName: \"kubernetes.io/projected/3d669c10-a611-425a-ab8f-82668cdefee1-kube-api-access-dgr2w\") pod \"payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz\" (UID: \"3d669c10-a611-425a-ab8f-82668cdefee1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"
Sep 19 10:53:08.548185 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.548128    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"
Sep 19 10:53:08.576517 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.576456    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:08.581613 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.581586    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"
Sep 19 10:53:08.828054 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.828027    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"]
Sep 19 10:53:08.830339 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:53:08.830312    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63cb64b_0099_435d_be84_16f09aaa9799.slice/crio-f96074653466bdfa3b4f74b6e1d7fdcfccba81cef72f00a5d67f84825b2f0063 WatchSource:0}: Error finding container f96074653466bdfa3b4f74b6e1d7fdcfccba81cef72f00a5d67f84825b2f0063: Status 404 returned error can't find the container with id f96074653466bdfa3b4f74b6e1d7fdcfccba81cef72f00a5d67f84825b2f0063
Sep 19 10:53:08.859289 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.859265    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"]
Sep 19 10:53:08.865810 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:53:08.865784    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1d06f6_3de0_4bbb_9656_aedab1dd61ab.slice/crio-96183b9d02366f2ea64656904f45cf7d46c57eca110c83005de2074dd8e69624 WatchSource:0}: Error finding container 96183b9d02366f2ea64656904f45cf7d46c57eca110c83005de2074dd8e69624: Status 404 returned error can't find the container with id 96183b9d02366f2ea64656904f45cf7d46c57eca110c83005de2074dd8e69624
Sep 19 10:53:08.876788 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:53:08.876762    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d669c10_a611_425a_ab8f_82668cdefee1.slice/crio-a69d01aa09119cba4b433772958ae3771c3561e06ad8a37733953c329874e3fd WatchSource:0}: Error finding container a69d01aa09119cba4b433772958ae3771c3561e06ad8a37733953c329874e3fd: Status 404 returned error can't find the container with id a69d01aa09119cba4b433772958ae3771c3561e06ad8a37733953c329874e3fd
Sep 19 10:53:08.877020 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.876996    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"]
Sep 19 10:53:08.891777 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.891753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695" event={"ID":"d63cb64b-0099-435d-be84-16f09aaa9799","Type":"ContainerStarted","Data":"f96074653466bdfa3b4f74b6e1d7fdcfccba81cef72f00a5d67f84825b2f0063"}
Sep 19 10:53:08.893334 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.893308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz" event={"ID":"3d669c10-a611-425a-ab8f-82668cdefee1","Type":"ContainerStarted","Data":"a69d01aa09119cba4b433772958ae3771c3561e06ad8a37733953c329874e3fd"}
Sep 19 10:53:08.894829 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:08.894798    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj" event={"ID":"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab","Type":"ContainerStarted","Data":"96183b9d02366f2ea64656904f45cf7d46c57eca110c83005de2074dd8e69624"}
Sep 19 10:53:09.902363 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:09.902325    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695" event={"ID":"d63cb64b-0099-435d-be84-16f09aaa9799","Type":"ContainerStarted","Data":"0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34"}
Sep 19 10:53:09.902869 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:09.902668    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"
Sep 19 10:53:09.904130 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:09.904104    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz" event={"ID":"3d669c10-a611-425a-ab8f-82668cdefee1","Type":"ContainerStarted","Data":"4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96"}
Sep 19 10:53:09.904270 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:09.904157    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"
Sep 19 10:53:09.905930 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:09.905900    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj" event={"ID":"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab","Type":"ContainerStarted","Data":"1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855"}
Sep 19 10:53:09.906046 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:09.905950    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:09.918254 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:09.918210    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695" podStartSLOduration=1.9181981179999998 podStartE2EDuration="1.918198118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:53:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:53:09.917124371 +0000 UTC m=+1112.816314274" watchObservedRunningTime="2026-09-19 10:53:09.918198118 +0000 UTC m=+1112.817388054"
Sep 19 10:53:09.933783 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:09.933742    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz" podStartSLOduration=1.9337113989999999 podStartE2EDuration="1.933711399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:53:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:53:09.930884997 +0000 UTC m=+1112.830074892" watchObservedRunningTime="2026-09-19 10:53:09.933711399 +0000 UTC m=+1112.832901289"
Sep 19 10:53:09.947175 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:09.947135    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj" podStartSLOduration=2.474047018 podStartE2EDuration="2.947127328s" totalImagesPullingTime="473.08031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:53:09.945717375 +0000 UTC m=+1112.844907267" watchObservedRunningTime="2026-09-19 10:53:09.947127328 +0000 UTC m=+1112.846317220"
Sep 19 10:53:15.919301 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:15.919272    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 10:53:20.915603 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:20.915571    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"
Sep 19 10:53:20.916186 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:20.915648    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"
Sep 19 10:53:33.431009 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.430965    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"]
Sep 19 10:53:33.434137 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.434110    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.436394 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.436373    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-99b43e-openshift-default-dockercfg-2mjx5\""
Sep 19 10:53:33.445912 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.445888    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"]
Sep 19 10:53:33.593382 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.593338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-envoy\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.593587 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.593404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-podinfo\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.593587 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.593432    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-data\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.593587 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.593461    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-workload-certs\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.593587 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.593515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq9sd\" (UniqueName: \"kubernetes.io/projected/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-kube-api-access-fq9sd\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.593883 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.593588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-credential-socket\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.593883 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.593652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-workload-socket\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.593883 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.593681    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istiod-ca-cert\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.593883 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.593736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-token\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.694639 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.694566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-workload-socket\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.694639 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.694613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istiod-ca-cert\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.694849 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.694658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-token\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.694849 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.694708    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-envoy\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.695018 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.694992    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-podinfo\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.695170 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.695135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-data\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.695285 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.695019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-workload-socket\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.695285 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.695176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-workload-certs\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.695285 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.695252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9sd\" (UniqueName: \"kubernetes.io/projected/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-kube-api-access-fq9sd\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.695460 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.695321    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-credential-socket\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.695460 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.695424    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istiod-ca-cert\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.695460 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.695447    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-workload-certs\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.695657 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.695604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-data\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.695866 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.695646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-credential-socket\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.697167 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.697143    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-envoy\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.697536 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.697516    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-podinfo\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.701460 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.701437    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-token\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.702177 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.702153    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq9sd\" (UniqueName: \"kubernetes.io/projected/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-kube-api-access-fq9sd\") pod \"e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") " pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:33.747542 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:33.747521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:34.023546 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:34.023522    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"]
Sep 19 10:53:34.025116 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:53:34.025081    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdcdc08b_f7fa_4f54_a163_0aad2c830c3f.slice/crio-f5cb7d6a48070956bf5f6b6f1a1220cef0ef282bd33b8e9b697499c3188c40b5 WatchSource:0}: Error finding container f5cb7d6a48070956bf5f6b6f1a1220cef0ef282bd33b8e9b697499c3188c40b5: Status 404 returned error can't find the container with id f5cb7d6a48070956bf5f6b6f1a1220cef0ef282bd33b8e9b697499c3188c40b5
Sep 19 10:53:34.027621 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:34.027578    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:53:34.027698 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:34.027671    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:53:34.027767 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:34.027713    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:53:34.057400 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:34.057370    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" event={"ID":"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f","Type":"ContainerStarted","Data":"f5cb7d6a48070956bf5f6b6f1a1220cef0ef282bd33b8e9b697499c3188c40b5"}
Sep 19 10:53:35.065710 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:35.065675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" event={"ID":"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f","Type":"ContainerStarted","Data":"554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b"}
Sep 19 10:53:35.084338 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:35.084279    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" podStartSLOduration=2.084264294 podStartE2EDuration="2.084264294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:53:35.082822022 +0000 UTC m=+1137.982011915" watchObservedRunningTime="2026-09-19 10:53:35.084264294 +0000 UTC m=+1137.983454186"
Sep 19 10:53:35.747776 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:35.747716    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:35.752972 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:35.752947    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:36.071363 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:36.071341    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:36.072147 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:36.072128    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:53:38.152125 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.152084    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"]
Sep 19 10:53:38.157447 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.157424    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.159835 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.159811    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w1-266c89-serving-cert\""
Sep 19 10:53:38.165668 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.165640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"]
Sep 19 10:53:38.239583 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.239556    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.239751 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.239599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fdsc\" (UniqueName: \"kubernetes.io/projected/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-kube-api-access-9fdsc\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.239751 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.239642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.239837 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.239763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.340836 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.340804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fdsc\" (UniqueName: \"kubernetes.io/projected/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-kube-api-access-9fdsc\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.341003 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.340865    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.341223 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.341185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.341382 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.341362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.341665 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:53:38.341607    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-serving-cert: secret "maas-api-e2e-shared-b-w1-266c89-serving-cert" not found
Sep 19 10:53:38.341799 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:53:38.341718    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-maas-api-tls podName:ecbdbfee-0aeb-4f39-b904-45cc8ffa4155 nodeName:}" failed. No retries permitted until 2026-09-19 10:53:38.841695584 +0000 UTC m=+1141.740885472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-maas-api-tls") pod "maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2" (UID: "ecbdbfee-0aeb-4f39-b904-45cc8ffa4155") : secret "maas-api-e2e-shared-b-w1-266c89-serving-cert" not found
Sep 19 10:53:38.341956 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.341931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.343412 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.343393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.348387 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.348368    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fdsc\" (UniqueName: \"kubernetes.io/projected/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-kube-api-access-9fdsc\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.837440 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.837403    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"]
Sep 19 10:53:38.842156 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.842133    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"
Sep 19 10:53:38.844453 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.844427    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w1-266c89\""
Sep 19 10:53:38.844559 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.844431    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w1-266c89-dockercfg-jf5b6\""
Sep 19 10:53:38.845906 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.845886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.848988 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.848966    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:38.851026 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.851006    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"]
Sep 19 10:53:38.946660 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.946622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq45n\" (UniqueName: \"kubernetes.io/projected/52985b46-3303-4acb-9341-ce24da2f4c28-kube-api-access-gq45n\") pod \"payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk\" (UID: \"52985b46-3303-4acb-9341-ce24da2f4c28\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"
Sep 19 10:53:38.946936 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:38.946673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52985b46-3303-4acb-9341-ce24da2f4c28-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk\" (UID: \"52985b46-3303-4acb-9341-ce24da2f4c28\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"
Sep 19 10:53:39.047409 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:39.047382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq45n\" (UniqueName: \"kubernetes.io/projected/52985b46-3303-4acb-9341-ce24da2f4c28-kube-api-access-gq45n\") pod \"payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk\" (UID: \"52985b46-3303-4acb-9341-ce24da2f4c28\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"
Sep 19 10:53:39.047568 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:39.047425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52985b46-3303-4acb-9341-ce24da2f4c28-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk\" (UID: \"52985b46-3303-4acb-9341-ce24da2f4c28\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"
Sep 19 10:53:39.048139 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:39.048118    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52985b46-3303-4acb-9341-ce24da2f4c28-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk\" (UID: \"52985b46-3303-4acb-9341-ce24da2f4c28\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"
Sep 19 10:53:39.068467 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:39.068443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq45n\" (UniqueName: \"kubernetes.io/projected/52985b46-3303-4acb-9341-ce24da2f4c28-kube-api-access-gq45n\") pod \"payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk\" (UID: \"52985b46-3303-4acb-9341-ce24da2f4c28\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"
Sep 19 10:53:39.073385 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:39.073357    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:39.168458 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:39.168394    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w1-266c89-dockercfg-jf5b6\""
Sep 19 10:53:39.176365 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:39.176342    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"
Sep 19 10:53:39.348784 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:39.348759    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"]
Sep 19 10:53:39.350581 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:53:39.350545    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbdbfee_0aeb_4f39_b904_45cc8ffa4155.slice/crio-554f597b077f4693336ef0ab301837b0586bc94095003466b1555b255628b85b WatchSource:0}: Error finding container 554f597b077f4693336ef0ab301837b0586bc94095003466b1555b255628b85b: Status 404 returned error can't find the container with id 554f597b077f4693336ef0ab301837b0586bc94095003466b1555b255628b85b
Sep 19 10:53:39.454523 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:39.454499    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"]
Sep 19 10:53:39.456837 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:53:39.456810    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52985b46_3303_4acb_9341_ce24da2f4c28.slice/crio-d12df5da1956df9fceca314be2c9b468d339c6313a1fc7ff455c97a357f46fff WatchSource:0}: Error finding container d12df5da1956df9fceca314be2c9b468d339c6313a1fc7ff455c97a357f46fff: Status 404 returned error can't find the container with id d12df5da1956df9fceca314be2c9b468d339c6313a1fc7ff455c97a357f46fff
Sep 19 10:53:40.102231 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:40.102181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk" event={"ID":"52985b46-3303-4acb-9341-ce24da2f4c28","Type":"ContainerStarted","Data":"c88dfd00183116780d8c5985ce149266b2745de32873d98d59754ddbfd558ae3"}
Sep 19 10:53:40.102422 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:40.102399    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"
Sep 19 10:53:40.102515 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:40.102435    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk" event={"ID":"52985b46-3303-4acb-9341-ce24da2f4c28","Type":"ContainerStarted","Data":"d12df5da1956df9fceca314be2c9b468d339c6313a1fc7ff455c97a357f46fff"}
Sep 19 10:53:40.104205 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:40.104176    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2" event={"ID":"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155","Type":"ContainerStarted","Data":"ad0894b643b6ab58f9f927456473a19c644c8d4c66e956a86907b4d17339e2f0"}
Sep 19 10:53:40.104336 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:40.104237    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2" event={"ID":"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155","Type":"ContainerStarted","Data":"554f597b077f4693336ef0ab301837b0586bc94095003466b1555b255628b85b"}
Sep 19 10:53:40.104336 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:40.104267    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:40.117021 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:40.116976    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk" podStartSLOduration=2.116958758 podStartE2EDuration="2.116958758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:53:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:53:40.116853726 +0000 UTC m=+1143.016043618" watchObservedRunningTime="2026-09-19 10:53:40.116958758 +0000 UTC m=+1143.016148651"
Sep 19 10:53:40.133014 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:40.132977    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2" podStartSLOduration=1.756862498 podStartE2EDuration="2.132964956s" totalImagesPullingTime="376.102458ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:53:40.131172539 +0000 UTC m=+1143.030362431" watchObservedRunningTime="2026-09-19 10:53:40.132964956 +0000 UTC m=+1143.032154864"
Sep 19 10:53:46.113938 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:46.113908    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 10:53:51.110777 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:53:51.110744    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"
Sep 19 10:54:04.256029 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:04.255994    2579 generic.go:356] "Generic (PLEG): container finished" podID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerID="554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b" exitCode=0
Sep 19 10:54:04.256029 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:04.256032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" event={"ID":"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f","Type":"ContainerDied","Data":"554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b"}
Sep 19 10:54:04.256496 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:04.256394    2579 scope.go:117] "RemoveContainer" containerID="554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b"
Sep 19 10:54:04.257584 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:04.257552    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:54:04.257699 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:04.257626    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:54:04.257699 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:04.257656    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:54:05.263439 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:05.263402    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" event={"ID":"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f","Type":"ContainerStarted","Data":"f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656"}
Sep 19 10:54:05.747786 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:05.747714    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:54:05.749169 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:05.749137    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 19 10:54:05.749310 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:05.749207    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 19 10:54:06.071575 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:06.071550    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:54:06.748280 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:06.748244    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 19 10:54:06.748680 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:06.748306    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 19 10:54:07.748849 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:07.748811    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 19 10:54:07.749234 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:07.748872    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 19 10:54:08.748471 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:08.748435    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 19 10:54:08.748747 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:08.748490    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 19 10:54:09.748405 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:09.748368    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 19 10:54:09.748784 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:09.748424    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 19 10:54:10.752017 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:10.751989    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:54:10.753040 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:10.753015    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 10:54:22.319591 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.319554    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"]
Sep 19 10:54:22.324651 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.324631    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"
Sep 19 10:54:22.327014 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.326991    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e6f44882-dockercfg-mc85c\""
Sep 19 10:54:22.327100 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.327018    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e6f44882\""
Sep 19 10:54:22.332098 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.332072    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"]
Sep 19 10:54:22.354997 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.354976    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"]
Sep 19 10:54:22.358601 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.358579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"
Sep 19 10:54:22.367369 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.367347    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"]
Sep 19 10:54:22.461718 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.461675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/803b8754-c653-4d4c-aca7-3e43d2dd420f-plugins-config-volume\") pod \"payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl\" (UID: \"803b8754-c653-4d4c-aca7-3e43d2dd420f\") " pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"
Sep 19 10:54:22.461902 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.461801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62761aec-318e-469e-a9af-4f7a955b6ea8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz\" (UID: \"62761aec-318e-469e-a9af-4f7a955b6ea8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"
Sep 19 10:54:22.461960 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.461948    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tz2g\" (UniqueName: \"kubernetes.io/projected/62761aec-318e-469e-a9af-4f7a955b6ea8-kube-api-access-5tz2g\") pod \"payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz\" (UID: \"62761aec-318e-469e-a9af-4f7a955b6ea8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"
Sep 19 10:54:22.462007 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.461996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f42lh\" (UniqueName: \"kubernetes.io/projected/803b8754-c653-4d4c-aca7-3e43d2dd420f-kube-api-access-f42lh\") pod \"payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl\" (UID: \"803b8754-c653-4d4c-aca7-3e43d2dd420f\") " pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"
Sep 19 10:54:22.562597 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.562564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tz2g\" (UniqueName: \"kubernetes.io/projected/62761aec-318e-469e-a9af-4f7a955b6ea8-kube-api-access-5tz2g\") pod \"payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz\" (UID: \"62761aec-318e-469e-a9af-4f7a955b6ea8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"
Sep 19 10:54:22.562793 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.562603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f42lh\" (UniqueName: \"kubernetes.io/projected/803b8754-c653-4d4c-aca7-3e43d2dd420f-kube-api-access-f42lh\") pod \"payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl\" (UID: \"803b8754-c653-4d4c-aca7-3e43d2dd420f\") " pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"
Sep 19 10:54:22.562793 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.562646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/803b8754-c653-4d4c-aca7-3e43d2dd420f-plugins-config-volume\") pod \"payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl\" (UID: \"803b8754-c653-4d4c-aca7-3e43d2dd420f\") " pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"
Sep 19 10:54:22.562793 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.562669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62761aec-318e-469e-a9af-4f7a955b6ea8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz\" (UID: \"62761aec-318e-469e-a9af-4f7a955b6ea8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"
Sep 19 10:54:22.563471 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.563444    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/803b8754-c653-4d4c-aca7-3e43d2dd420f-plugins-config-volume\") pod \"payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl\" (UID: \"803b8754-c653-4d4c-aca7-3e43d2dd420f\") " pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"
Sep 19 10:54:22.563579 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.563491    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62761aec-318e-469e-a9af-4f7a955b6ea8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz\" (UID: \"62761aec-318e-469e-a9af-4f7a955b6ea8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"
Sep 19 10:54:22.570308 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.570251    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f42lh\" (UniqueName: \"kubernetes.io/projected/803b8754-c653-4d4c-aca7-3e43d2dd420f-kube-api-access-f42lh\") pod \"payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl\" (UID: \"803b8754-c653-4d4c-aca7-3e43d2dd420f\") " pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"
Sep 19 10:54:22.570447 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.570424    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tz2g\" (UniqueName: \"kubernetes.io/projected/62761aec-318e-469e-a9af-4f7a955b6ea8-kube-api-access-5tz2g\") pod \"payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz\" (UID: \"62761aec-318e-469e-a9af-4f7a955b6ea8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"
Sep 19 10:54:22.636534 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.636507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"
Sep 19 10:54:22.670856 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.670830    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"
Sep 19 10:54:22.911153 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.910991    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"]
Sep 19 10:54:22.913538 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:54:22.913510    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62761aec_318e_469e_a9af_4f7a955b6ea8.slice/crio-ecb6c4ba987d61694c2517eef475e217f017aeee2869f0819f34cef30e15ec0c WatchSource:0}: Error finding container ecb6c4ba987d61694c2517eef475e217f017aeee2869f0819f34cef30e15ec0c: Status 404 returned error can't find the container with id ecb6c4ba987d61694c2517eef475e217f017aeee2869f0819f34cef30e15ec0c
Sep 19 10:54:22.954626 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:54:22.954594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803b8754_c653_4d4c_aca7_3e43d2dd420f.slice/crio-4a6ce64b68cf0a4d40834ba3f5b27f1b947eeb1e42294f68f4f908fb395bef30 WatchSource:0}: Error finding container 4a6ce64b68cf0a4d40834ba3f5b27f1b947eeb1e42294f68f4f908fb395bef30: Status 404 returned error can't find the container with id 4a6ce64b68cf0a4d40834ba3f5b27f1b947eeb1e42294f68f4f908fb395bef30
Sep 19 10:54:22.954830 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:22.954813    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"]
Sep 19 10:54:23.369796 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:23.369766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl" event={"ID":"803b8754-c653-4d4c-aca7-3e43d2dd420f","Type":"ContainerStarted","Data":"0442d5b5f95b4ff995aa59ec95cbf798a86831fa02de5fb0e710338f78523639"}
Sep 19 10:54:23.370217 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:23.369933    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"
Sep 19 10:54:23.370217 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:23.369968    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl" event={"ID":"803b8754-c653-4d4c-aca7-3e43d2dd420f","Type":"ContainerStarted","Data":"4a6ce64b68cf0a4d40834ba3f5b27f1b947eeb1e42294f68f4f908fb395bef30"}
Sep 19 10:54:23.371467 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:23.371441    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz" event={"ID":"62761aec-318e-469e-a9af-4f7a955b6ea8","Type":"ContainerStarted","Data":"eecb3ede07906db8e9cd3ecd2486cae7523df75d8ccf491b2ce16c8fb08a6da8"}
Sep 19 10:54:23.371604 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:23.371488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz" event={"ID":"62761aec-318e-469e-a9af-4f7a955b6ea8","Type":"ContainerStarted","Data":"ecb6c4ba987d61694c2517eef475e217f017aeee2869f0819f34cef30e15ec0c"}
Sep 19 10:54:23.371604 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:23.371517    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"
Sep 19 10:54:23.388299 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:23.388247    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl" podStartSLOduration=1.38822924 podStartE2EDuration="1.38822924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:54:23.385031118 +0000 UTC m=+1186.284221029" watchObservedRunningTime="2026-09-19 10:54:23.38822924 +0000 UTC m=+1186.287419137"
Sep 19 10:54:23.400303 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:23.400266    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz" podStartSLOduration=1.400253558 podStartE2EDuration="1.400253558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:54:23.398365475 +0000 UTC m=+1186.297555371" watchObservedRunningTime="2026-09-19 10:54:23.400253558 +0000 UTC m=+1186.299443450"
Sep 19 10:54:34.381125 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:34.381092    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"
Sep 19 10:54:34.381490 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:34.381216    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"
Sep 19 10:54:39.243179 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:39.243151    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:54:39.244182 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:54:39.244160    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:55:20.043466 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.043436    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"]
Sep 19 10:55:20.047210 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.047189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.050574 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.050493    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e6f44882\"/\"kube-root-ca.crt\""
Sep 19 10:55:20.050682 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.050610    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e6f44882\"/\"default-dockercfg-d8zzn\""
Sep 19 10:55:20.050682 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.050625    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e6f44882\"/\"openshift-service-ca.crt\""
Sep 19 10:55:20.050844 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.050755    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e6f44882\"/\"e2e-lifecycle-model-e6f44882-kserve-self-signed-certs\""
Sep 19 10:55:20.055524 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.055505    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"]
Sep 19 10:55:20.160382 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.160351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f76cc11-3c98-4a33-8bc8-6333331cd787-tls-certs\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.160554 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.160391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-model-cache\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.160554 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.160435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-dshm\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.160554 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.160504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-tmp-dir\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.160554 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.160543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-home\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.160744 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.160629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpt4f\" (UniqueName: \"kubernetes.io/projected/9f76cc11-3c98-4a33-8bc8-6333331cd787-kube-api-access-rpt4f\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.261555 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.261518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f76cc11-3c98-4a33-8bc8-6333331cd787-tls-certs\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.261757 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.261586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-model-cache\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.261757 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.261661    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-dshm\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.261757 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.261700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-tmp-dir\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.261960 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.261766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-home\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.261960 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.261827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpt4f\" (UniqueName: \"kubernetes.io/projected/9f76cc11-3c98-4a33-8bc8-6333331cd787-kube-api-access-rpt4f\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.262075 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.262061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-model-cache\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.262325 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.262295    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-tmp-dir\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.262558 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.262536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-home\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.264929 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.264902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f76cc11-3c98-4a33-8bc8-6333331cd787-tls-certs\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.265939 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.265913    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-dshm\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.270569 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.270538    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpt4f\" (UniqueName: \"kubernetes.io/projected/9f76cc11-3c98-4a33-8bc8-6333331cd787-kube-api-access-rpt4f\") pod \"e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") " pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.360228 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.360200    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:20.634012 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.633988    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"]
Sep 19 10:55:20.635003 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:55:20.634972    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f76cc11_3c98_4a33_8bc8_6333331cd787.slice/crio-aef07a69262012e7a965b9214795753dddee37640a38b668825e6f41c8de7dd9 WatchSource:0}: Error finding container aef07a69262012e7a965b9214795753dddee37640a38b668825e6f41c8de7dd9: Status 404 returned error can't find the container with id aef07a69262012e7a965b9214795753dddee37640a38b668825e6f41c8de7dd9
Sep 19 10:55:20.698991 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:20.698962    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs" event={"ID":"9f76cc11-3c98-4a33-8bc8-6333331cd787","Type":"ContainerStarted","Data":"aef07a69262012e7a965b9214795753dddee37640a38b668825e6f41c8de7dd9"}
Sep 19 10:55:21.706504 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:21.706465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs" event={"ID":"9f76cc11-3c98-4a33-8bc8-6333331cd787","Type":"ContainerStarted","Data":"e2954b7f2e0c1808e9fef247ff783c5f799cf572200e7c6bb9c246960e00b6be"}
Sep 19 10:55:21.723737 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:21.723684    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs" podStartSLOduration=1.723669413 podStartE2EDuration="1.723669413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:55:21.720872421 +0000 UTC m=+1244.620062309" watchObservedRunningTime="2026-09-19 10:55:21.723669413 +0000 UTC m=+1244.622859305"
Sep 19 10:55:22.736663 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:22.736633    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"]
Sep 19 10:55:30.360743 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:30.360697    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:30.361140 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:30.360773    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:30.373269 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:30.373238    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:30.766491 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:30.766419    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:55:33.423386 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.423352    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"]
Sep 19 10:55:33.423972 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.423881    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx" podUID="8b5bc867-96ea-4009-bdbc-0ac5eebee3cb" containerName="maas-api" containerID="cri-o://283dc0f9a30404a00bc4422010ab5e6848b28daee7cad838469241079950c434" gracePeriod=30
Sep 19 10:55:33.777046 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.777010    2579 generic.go:356] "Generic (PLEG): container finished" podID="8b5bc867-96ea-4009-bdbc-0ac5eebee3cb" containerID="283dc0f9a30404a00bc4422010ab5e6848b28daee7cad838469241079950c434" exitCode=0
Sep 19 10:55:33.777191 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.777080    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx" event={"ID":"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb","Type":"ContainerDied","Data":"283dc0f9a30404a00bc4422010ab5e6848b28daee7cad838469241079950c434"}
Sep 19 10:55:33.882162 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.882132    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:55:33.974430 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.974364    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-openshift-service-ca\") pod \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") "
Sep 19 10:55:33.974568 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.974437    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-maas-api-tls\") pod \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") "
Sep 19 10:55:33.974612 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.974588    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkx7z\" (UniqueName: \"kubernetes.io/projected/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-kube-api-access-bkx7z\") pod \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") "
Sep 19 10:55:33.974670 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.974652    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-metrics-certs\") pod \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\" (UID: \"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb\") "
Sep 19 10:55:33.974820 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.974792    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8b5bc867-96ea-4009-bdbc-0ac5eebee3cb" (UID: "8b5bc867-96ea-4009-bdbc-0ac5eebee3cb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:55:33.975082 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.975064    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-openshift-service-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:55:33.976652 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.976626    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-kube-api-access-bkx7z" (OuterVolumeSpecName: "kube-api-access-bkx7z") pod "8b5bc867-96ea-4009-bdbc-0ac5eebee3cb" (UID: "8b5bc867-96ea-4009-bdbc-0ac5eebee3cb"). InnerVolumeSpecName "kube-api-access-bkx7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:55:33.976745 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.976655    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8b5bc867-96ea-4009-bdbc-0ac5eebee3cb" (UID: "8b5bc867-96ea-4009-bdbc-0ac5eebee3cb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:55:33.976745 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:33.976676    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8b5bc867-96ea-4009-bdbc-0ac5eebee3cb" (UID: "8b5bc867-96ea-4009-bdbc-0ac5eebee3cb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:55:34.076475 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:34.076450    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-maas-api-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:55:34.076475 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:34.076471    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkx7z\" (UniqueName: \"kubernetes.io/projected/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-kube-api-access-bkx7z\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:55:34.076475 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:34.076482    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb-metrics-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:55:34.784475 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:34.784444    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"
Sep 19 10:55:34.784905 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:34.784443    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx" event={"ID":"8b5bc867-96ea-4009-bdbc-0ac5eebee3cb","Type":"ContainerDied","Data":"2dabd9c65215ec8e1bb02f4b0bcb936728e676ef8c41e17e9c1b284c6805a84f"}
Sep 19 10:55:34.784905 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:34.784578    2579 scope.go:117] "RemoveContainer" containerID="283dc0f9a30404a00bc4422010ab5e6848b28daee7cad838469241079950c434"
Sep 19 10:55:34.806807 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:34.806780    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"]
Sep 19 10:55:34.810893 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:34.810871    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-580e01-756bcbcc84-2qgxx"]
Sep 19 10:55:35.203919 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.203878    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b5bc867-96ea-4009-bdbc-0ac5eebee3cb" path="/var/lib/kubelet/pods/8b5bc867-96ea-4009-bdbc-0ac5eebee3cb/volumes"
Sep 19 10:55:35.331688 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.331658    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"]
Sep 19 10:55:35.332391 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.332370    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5bc867-96ea-4009-bdbc-0ac5eebee3cb" containerName="maas-api"
Sep 19 10:55:35.332444 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.332397    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5bc867-96ea-4009-bdbc-0ac5eebee3cb" containerName="maas-api"
Sep 19 10:55:35.332544 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.332533    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b5bc867-96ea-4009-bdbc-0ac5eebee3cb" containerName="maas-api"
Sep 19 10:55:35.337177 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.337160    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.339209 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.339188    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-99b43e\"/\"default-dockercfg-q2qqw\""
Sep 19 10:55:35.340267 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.340248    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-99b43e\"/\"auth-test-model-99b43e-kserve-self-signed-certs\""
Sep 19 10:55:35.340423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.340268    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-99b43e\"/\"kube-root-ca.crt\""
Sep 19 10:55:35.340423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.340252    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-99b43e\"/\"openshift-service-ca.crt\""
Sep 19 10:55:35.344590 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.344559    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"]
Sep 19 10:55:35.390269 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.390245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-tmp-dir\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.390400 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.390306    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-dshm\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.390400 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.390341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-model-cache\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.390400 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.390369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-home\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.390594 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.390483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951f0843-47cb-4947-b194-30502eabe99d-tls-certs\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.390594 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.390523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8tm7\" (UniqueName: \"kubernetes.io/projected/951f0843-47cb-4947-b194-30502eabe99d-kube-api-access-v8tm7\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.490997 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.490934    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-tmp-dir\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.490997 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.490989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-dshm\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.491199 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.491009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-model-cache\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.491199 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.491031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-home\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.491199 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.491083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951f0843-47cb-4947-b194-30502eabe99d-tls-certs\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.491199 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.491119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8tm7\" (UniqueName: \"kubernetes.io/projected/951f0843-47cb-4947-b194-30502eabe99d-kube-api-access-v8tm7\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.491601 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.491434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-model-cache\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.491601 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.491560    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-tmp-dir\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.491601 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.491580    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-home\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.493630 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.493608    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-dshm\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.493850 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.493832    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951f0843-47cb-4947-b194-30502eabe99d-tls-certs\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.499670 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.499643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8tm7\" (UniqueName: \"kubernetes.io/projected/951f0843-47cb-4947-b194-30502eabe99d-kube-api-access-v8tm7\") pod \"auth-test-model-99b43e-kserve-7cbc689947-pddk7\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") " pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.647449 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.647417    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:35.920578 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:35.920552    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"]
Sep 19 10:55:35.922021 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:55:35.921996    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod951f0843_47cb_4947_b194_30502eabe99d.slice/crio-bd5ed3c31dd3437ab0d49f671fa469a4139b3a06e3fd8eb16a152d6de4505651 WatchSource:0}: Error finding container bd5ed3c31dd3437ab0d49f671fa469a4139b3a06e3fd8eb16a152d6de4505651: Status 404 returned error can't find the container with id bd5ed3c31dd3437ab0d49f671fa469a4139b3a06e3fd8eb16a152d6de4505651
Sep 19 10:55:36.799104 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:36.799068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7" event={"ID":"951f0843-47cb-4947-b194-30502eabe99d","Type":"ContainerStarted","Data":"6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e"}
Sep 19 10:55:36.799104 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:36.799114    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7" event={"ID":"951f0843-47cb-4947-b194-30502eabe99d","Type":"ContainerStarted","Data":"bd5ed3c31dd3437ab0d49f671fa469a4139b3a06e3fd8eb16a152d6de4505651"}
Sep 19 10:55:36.815214 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:36.815169    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7" podStartSLOduration=1.815154578 podStartE2EDuration="1.815154578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:55:36.814047826 +0000 UTC m=+1259.713237721" watchObservedRunningTime="2026-09-19 10:55:36.815154578 +0000 UTC m=+1259.714344506"
Sep 19 10:55:37.756741 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:37.756694    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w" podUID="3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e" containerName="main" containerID="cri-o://9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560" gracePeriod=45
Sep 19 10:55:38.017560 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.017495    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:55:38.117397 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.117351    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-model-cache\") pod \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") "
Sep 19 10:55:38.117397 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.117394    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-home\") pod \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") "
Sep 19 10:55:38.117673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.117468    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-tmp-dir\") pod \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") "
Sep 19 10:55:38.117673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.117508    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-tls-certs\") pod \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") "
Sep 19 10:55:38.117673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.117558    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8l8l\" (UniqueName: \"kubernetes.io/projected/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-kube-api-access-w8l8l\") pod \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") "
Sep 19 10:55:38.117673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.117603    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-dshm\") pod \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\" (UID: \"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e\") "
Sep 19 10:55:38.117673 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.117622    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-model-cache" (OuterVolumeSpecName: "model-cache") pod "3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e" (UID: "3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:55:38.117935 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.117683    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-home" (OuterVolumeSpecName: "home") pod "3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e" (UID: "3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:55:38.117935 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.117806    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e" (UID: "3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:55:38.118048 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.118015    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-tmp-dir\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:55:38.118048 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.118030    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-model-cache\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:55:38.118048 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.118041    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-home\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:55:38.119832 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.119794    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e" (UID: "3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:55:38.119832 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.119813    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-kube-api-access-w8l8l" (OuterVolumeSpecName: "kube-api-access-w8l8l") pod "3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e" (UID: "3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e"). InnerVolumeSpecName "kube-api-access-w8l8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:55:38.120007 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.119847    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-dshm" (OuterVolumeSpecName: "dshm") pod "3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e" (UID: "3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:55:38.219383 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.219358    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-tls-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:55:38.219383 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.219380    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8l8l\" (UniqueName: \"kubernetes.io/projected/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-kube-api-access-w8l8l\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:55:38.219522 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.219390    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e-dshm\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:55:38.814776 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.814719    2579 generic.go:356] "Generic (PLEG): container finished" podID="3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e" containerID="9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560" exitCode=0
Sep 19 10:55:38.815304 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.814779    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"
Sep 19 10:55:38.815304 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.814796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w" event={"ID":"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e","Type":"ContainerDied","Data":"9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560"}
Sep 19 10:55:38.815304 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.814829    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w" event={"ID":"3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e","Type":"ContainerDied","Data":"6580e0b8879d3c26a0c0edcee43b178bd7ec11b080603d3ff8b9861701159f32"}
Sep 19 10:55:38.815304 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.814846    2579 scope.go:117] "RemoveContainer" containerID="9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560"
Sep 19 10:55:38.825021 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.824995    2579 scope.go:117] "RemoveContainer" containerID="9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560"
Sep 19 10:55:38.825370 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:55:38.825344    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560\": container with ID starting with 9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560 not found: ID does not exist" containerID="9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560"
Sep 19 10:55:38.825482 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.825381    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560"} err="failed to get container status \"9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560\": rpc error: code = NotFound desc = could not find container \"9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560\": container with ID starting with 9cd0955d77d04464324240e2f87fc981e3e3bc6efa56b49bc9f77c63c411e560 not found: ID does not exist"
Sep 19 10:55:38.836646 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.836623    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"]
Sep 19 10:55:38.843883 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:38.843862    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-580e01/premium-w3-580e01-kserve-76d599bc46-z596w"]
Sep 19 10:55:39.216320 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:39.216239    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e" path="/var/lib/kubelet/pods/3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e/volumes"
Sep 19 10:55:45.648228 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:45.648188    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:45.648625 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:45.648240    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:45.661029 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:45.661003    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:55:45.865808 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:55:45.865780    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:56:28.888838 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:28.888804    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"]
Sep 19 10:56:28.889697 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:28.889665    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl" podUID="803b8754-c653-4d4c-aca7-3e43d2dd420f" containerName="payload-processing" containerID="cri-o://0442d5b5f95b4ff995aa59ec95cbf798a86831fa02de5fb0e710338f78523639" gracePeriod=30
Sep 19 10:56:28.893975 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:28.893936    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"]
Sep 19 10:56:28.894204 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:28.894161    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz" podUID="62761aec-318e-469e-a9af-4f7a955b6ea8" containerName="payload-pre-processing" containerID="cri-o://eecb3ede07906db8e9cd3ecd2486cae7523df75d8ccf491b2ce16c8fb08a6da8" gracePeriod=30
Sep 19 10:56:29.105827 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.105777    2579 generic.go:356] "Generic (PLEG): container finished" podID="62761aec-318e-469e-a9af-4f7a955b6ea8" containerID="eecb3ede07906db8e9cd3ecd2486cae7523df75d8ccf491b2ce16c8fb08a6da8" exitCode=0
Sep 19 10:56:29.106259 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.106172    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz" event={"ID":"62761aec-318e-469e-a9af-4f7a955b6ea8","Type":"ContainerDied","Data":"eecb3ede07906db8e9cd3ecd2486cae7523df75d8ccf491b2ce16c8fb08a6da8"}
Sep 19 10:56:29.108444 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.108417    2579 generic.go:356] "Generic (PLEG): container finished" podID="803b8754-c653-4d4c-aca7-3e43d2dd420f" containerID="0442d5b5f95b4ff995aa59ec95cbf798a86831fa02de5fb0e710338f78523639" exitCode=0
Sep 19 10:56:29.108566 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.108509    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl" event={"ID":"803b8754-c653-4d4c-aca7-3e43d2dd420f","Type":"ContainerDied","Data":"0442d5b5f95b4ff995aa59ec95cbf798a86831fa02de5fb0e710338f78523639"}
Sep 19 10:56:29.194087 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.194060    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"
Sep 19 10:56:29.197470 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.197436    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"
Sep 19 10:56:29.269615 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.269585    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tz2g\" (UniqueName: \"kubernetes.io/projected/62761aec-318e-469e-a9af-4f7a955b6ea8-kube-api-access-5tz2g\") pod \"62761aec-318e-469e-a9af-4f7a955b6ea8\" (UID: \"62761aec-318e-469e-a9af-4f7a955b6ea8\") "
Sep 19 10:56:29.269857 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.269640    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f42lh\" (UniqueName: \"kubernetes.io/projected/803b8754-c653-4d4c-aca7-3e43d2dd420f-kube-api-access-f42lh\") pod \"803b8754-c653-4d4c-aca7-3e43d2dd420f\" (UID: \"803b8754-c653-4d4c-aca7-3e43d2dd420f\") "
Sep 19 10:56:29.269857 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.269702    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/803b8754-c653-4d4c-aca7-3e43d2dd420f-plugins-config-volume\") pod \"803b8754-c653-4d4c-aca7-3e43d2dd420f\" (UID: \"803b8754-c653-4d4c-aca7-3e43d2dd420f\") "
Sep 19 10:56:29.269857 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.269790    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62761aec-318e-469e-a9af-4f7a955b6ea8-plugins-config-volume\") pod \"62761aec-318e-469e-a9af-4f7a955b6ea8\" (UID: \"62761aec-318e-469e-a9af-4f7a955b6ea8\") "
Sep 19 10:56:29.270171 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.270143    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/803b8754-c653-4d4c-aca7-3e43d2dd420f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "803b8754-c653-4d4c-aca7-3e43d2dd420f" (UID: "803b8754-c653-4d4c-aca7-3e43d2dd420f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:56:29.270283 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.270215    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62761aec-318e-469e-a9af-4f7a955b6ea8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62761aec-318e-469e-a9af-4f7a955b6ea8" (UID: "62761aec-318e-469e-a9af-4f7a955b6ea8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:56:29.270374 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.270354    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62761aec-318e-469e-a9af-4f7a955b6ea8-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:29.270433 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.270383    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/803b8754-c653-4d4c-aca7-3e43d2dd420f-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:29.271977 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.271957    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62761aec-318e-469e-a9af-4f7a955b6ea8-kube-api-access-5tz2g" (OuterVolumeSpecName: "kube-api-access-5tz2g") pod "62761aec-318e-469e-a9af-4f7a955b6ea8" (UID: "62761aec-318e-469e-a9af-4f7a955b6ea8"). InnerVolumeSpecName "kube-api-access-5tz2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:56:29.272081 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.271981    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803b8754-c653-4d4c-aca7-3e43d2dd420f-kube-api-access-f42lh" (OuterVolumeSpecName: "kube-api-access-f42lh") pod "803b8754-c653-4d4c-aca7-3e43d2dd420f" (UID: "803b8754-c653-4d4c-aca7-3e43d2dd420f"). InnerVolumeSpecName "kube-api-access-f42lh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:56:29.371128 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.371103    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tz2g\" (UniqueName: \"kubernetes.io/projected/62761aec-318e-469e-a9af-4f7a955b6ea8-kube-api-access-5tz2g\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:29.371128 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:29.371128    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f42lh\" (UniqueName: \"kubernetes.io/projected/803b8754-c653-4d4c-aca7-3e43d2dd420f-kube-api-access-f42lh\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:30.115897 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:30.115867    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"
Sep 19 10:56:30.115897 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:30.115894    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz" event={"ID":"62761aec-318e-469e-a9af-4f7a955b6ea8","Type":"ContainerDied","Data":"ecb6c4ba987d61694c2517eef475e217f017aeee2869f0819f34cef30e15ec0c"}
Sep 19 10:56:30.116406 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:30.115972    2579 scope.go:117] "RemoveContainer" containerID="eecb3ede07906db8e9cd3ecd2486cae7523df75d8ccf491b2ce16c8fb08a6da8"
Sep 19 10:56:30.117528 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:30.117508    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"
Sep 19 10:56:30.117528 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:30.117521    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl" event={"ID":"803b8754-c653-4d4c-aca7-3e43d2dd420f","Type":"ContainerDied","Data":"4a6ce64b68cf0a4d40834ba3f5b27f1b947eeb1e42294f68f4f908fb395bef30"}
Sep 19 10:56:30.125295 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:30.125260    2579 scope.go:117] "RemoveContainer" containerID="0442d5b5f95b4ff995aa59ec95cbf798a86831fa02de5fb0e710338f78523639"
Sep 19 10:56:30.144385 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:30.144361    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"]
Sep 19 10:56:30.147645 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:30.147624    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl"]
Sep 19 10:56:30.156526 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:30.156476    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"]
Sep 19 10:56:30.162996 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:30.162975    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz"]
Sep 19 10:56:31.203017 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:31.202988    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62761aec-318e-469e-a9af-4f7a955b6ea8" path="/var/lib/kubelet/pods/62761aec-318e-469e-a9af-4f7a955b6ea8/volumes"
Sep 19 10:56:31.203385 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:31.203339    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="803b8754-c653-4d4c-aca7-3e43d2dd420f" path="/var/lib/kubelet/pods/803b8754-c653-4d4c-aca7-3e43d2dd420f/volumes"
Sep 19 10:56:36.984173 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:36.984142    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"]
Sep 19 10:56:42.460283 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.460247    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"]
Sep 19 10:56:42.460910 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.460462    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd" podUID="5e9574f8-2a5d-434b-bf48-b952d1dbf80a" containerName="payload-processing" containerID="cri-o://5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743" gracePeriod=30
Sep 19 10:56:42.466147 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.464791    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"]
Sep 19 10:56:42.466147 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.465002    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq" podUID="d6b51fb9-35d0-4e5e-bd06-15aba8613e2f" containerName="payload-pre-processing" containerID="cri-o://c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e" gracePeriod=30
Sep 19 10:56:42.733551 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.733474    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"
Sep 19 10:56:42.778800 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.778772    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"
Sep 19 10:56:42.780738 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.780704    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e9574f8-2a5d-434b-bf48-b952d1dbf80a-plugins-config-volume\") pod \"5e9574f8-2a5d-434b-bf48-b952d1dbf80a\" (UID: \"5e9574f8-2a5d-434b-bf48-b952d1dbf80a\") "
Sep 19 10:56:42.780858 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.780838    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv8s7\" (UniqueName: \"kubernetes.io/projected/5e9574f8-2a5d-434b-bf48-b952d1dbf80a-kube-api-access-fv8s7\") pod \"5e9574f8-2a5d-434b-bf48-b952d1dbf80a\" (UID: \"5e9574f8-2a5d-434b-bf48-b952d1dbf80a\") "
Sep 19 10:56:42.781046 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.781018    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e9574f8-2a5d-434b-bf48-b952d1dbf80a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5e9574f8-2a5d-434b-bf48-b952d1dbf80a" (UID: "5e9574f8-2a5d-434b-bf48-b952d1dbf80a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:56:42.781228 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.781212    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e9574f8-2a5d-434b-bf48-b952d1dbf80a-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:42.782824 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.782797    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e9574f8-2a5d-434b-bf48-b952d1dbf80a-kube-api-access-fv8s7" (OuterVolumeSpecName: "kube-api-access-fv8s7") pod "5e9574f8-2a5d-434b-bf48-b952d1dbf80a" (UID: "5e9574f8-2a5d-434b-bf48-b952d1dbf80a"). InnerVolumeSpecName "kube-api-access-fv8s7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:56:42.881895 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.881868    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f-plugins-config-volume\") pod \"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f\" (UID: \"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f\") "
Sep 19 10:56:42.882052 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.881991    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttg2v\" (UniqueName: \"kubernetes.io/projected/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f-kube-api-access-ttg2v\") pod \"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f\" (UID: \"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f\") "
Sep 19 10:56:42.882297 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.882272    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6b51fb9-35d0-4e5e-bd06-15aba8613e2f" (UID: "d6b51fb9-35d0-4e5e-bd06-15aba8613e2f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:56:42.882378 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.882341    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:42.882378 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.882357    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv8s7\" (UniqueName: \"kubernetes.io/projected/5e9574f8-2a5d-434b-bf48-b952d1dbf80a-kube-api-access-fv8s7\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:42.883970 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.883946    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f-kube-api-access-ttg2v" (OuterVolumeSpecName: "kube-api-access-ttg2v") pod "d6b51fb9-35d0-4e5e-bd06-15aba8613e2f" (UID: "d6b51fb9-35d0-4e5e-bd06-15aba8613e2f"). InnerVolumeSpecName "kube-api-access-ttg2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:56:42.983501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:42.983466    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttg2v\" (UniqueName: \"kubernetes.io/projected/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f-kube-api-access-ttg2v\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:43.204655 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.204621    2579 generic.go:356] "Generic (PLEG): container finished" podID="5e9574f8-2a5d-434b-bf48-b952d1dbf80a" containerID="5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743" exitCode=0
Sep 19 10:56:43.204854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.204669    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"
Sep 19 10:56:43.204854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.204706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd" event={"ID":"5e9574f8-2a5d-434b-bf48-b952d1dbf80a","Type":"ContainerDied","Data":"5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743"}
Sep 19 10:56:43.204854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.204792    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd" event={"ID":"5e9574f8-2a5d-434b-bf48-b952d1dbf80a","Type":"ContainerDied","Data":"11a28f4c3b81b0dc315ff09f94a068793a3b841a599a4c1cad6056f288ec4516"}
Sep 19 10:56:43.204854 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.204829    2579 scope.go:117] "RemoveContainer" containerID="5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743"
Sep 19 10:56:43.206340 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.206317    2579 generic.go:356] "Generic (PLEG): container finished" podID="d6b51fb9-35d0-4e5e-bd06-15aba8613e2f" containerID="c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e" exitCode=0
Sep 19 10:56:43.209991 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.206518    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq" event={"ID":"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f","Type":"ContainerDied","Data":"c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e"}
Sep 19 10:56:43.209991 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.206916    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq" event={"ID":"d6b51fb9-35d0-4e5e-bd06-15aba8613e2f","Type":"ContainerDied","Data":"24d2e988e50635b23ee8fa8adaf179c5e09b716d494d62060d2cc04f93cba55e"}
Sep 19 10:56:43.209991 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.206960    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"
Sep 19 10:56:43.225290 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.225268    2579 scope.go:117] "RemoveContainer" containerID="5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743"
Sep 19 10:56:43.225567 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:56:43.225549    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743\": container with ID starting with 5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743 not found: ID does not exist" containerID="5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743"
Sep 19 10:56:43.225623 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.225573    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743"} err="failed to get container status \"5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743\": rpc error: code = NotFound desc = could not find container \"5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743\": container with ID starting with 5c4dce065e25f0982784f2de63fa3a574fa973c37ed3e11543902fe70a782743 not found: ID does not exist"
Sep 19 10:56:43.225623 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.225588    2579 scope.go:117] "RemoveContainer" containerID="c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e"
Sep 19 10:56:43.233275 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.233257    2579 scope.go:117] "RemoveContainer" containerID="c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e"
Sep 19 10:56:43.233543 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:56:43.233525    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e\": container with ID starting with c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e not found: ID does not exist" containerID="c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e"
Sep 19 10:56:43.233591 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.233550    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e"} err="failed to get container status \"c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e\": rpc error: code = NotFound desc = could not find container \"c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e\": container with ID starting with c426f8f4b6a71b4b86ea7188551e07d1f36c725f82dadbd6f717055d2c69bb9e not found: ID does not exist"
Sep 19 10:56:43.237176 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.237154    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"]
Sep 19 10:56:43.239278 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.239259    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq"]
Sep 19 10:56:43.247379 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.247358    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"]
Sep 19 10:56:43.250773 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:43.250753    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd"]
Sep 19 10:56:45.202948 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:45.202907    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e9574f8-2a5d-434b-bf48-b952d1dbf80a" path="/var/lib/kubelet/pods/5e9574f8-2a5d-434b-bf48-b952d1dbf80a/volumes"
Sep 19 10:56:45.203423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:45.203320    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6b51fb9-35d0-4e5e-bd06-15aba8613e2f" path="/var/lib/kubelet/pods/d6b51fb9-35d0-4e5e-bd06-15aba8613e2f/volumes"
Sep 19 10:56:48.897892 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:48.897857    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"]
Sep 19 10:56:48.898360 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:48.898107    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerName="istio-proxy" containerID="cri-o://d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3" gracePeriod=30
Sep 19 10:56:52.003953 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.003854    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs" podUID="9f76cc11-3c98-4a33-8bc8-6333331cd787" containerName="main" containerID="cri-o://e2954b7f2e0c1808e9fef247ff783c5f799cf572200e7c6bb9c246960e00b6be" gracePeriod=45
Sep 19 10:56:52.255781 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.255688    2579 generic.go:356] "Generic (PLEG): container finished" podID="9f76cc11-3c98-4a33-8bc8-6333331cd787" containerID="e2954b7f2e0c1808e9fef247ff783c5f799cf572200e7c6bb9c246960e00b6be" exitCode=0
Sep 19 10:56:52.255781 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.255761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs" event={"ID":"9f76cc11-3c98-4a33-8bc8-6333331cd787","Type":"ContainerDied","Data":"e2954b7f2e0c1808e9fef247ff783c5f799cf572200e7c6bb9c246960e00b6be"}
Sep 19 10:56:52.255959 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.255817    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs" event={"ID":"9f76cc11-3c98-4a33-8bc8-6333331cd787","Type":"ContainerDied","Data":"aef07a69262012e7a965b9214795753dddee37640a38b668825e6f41c8de7dd9"}
Sep 19 10:56:52.255959 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.255833    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aef07a69262012e7a965b9214795753dddee37640a38b668825e6f41c8de7dd9"
Sep 19 10:56:52.265383 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.265357    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:56:52.369702 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.369668    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-dshm\") pod \"9f76cc11-3c98-4a33-8bc8-6333331cd787\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") "
Sep 19 10:56:52.369907 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.369716    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-model-cache\") pod \"9f76cc11-3c98-4a33-8bc8-6333331cd787\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") "
Sep 19 10:56:52.369907 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.369804    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f76cc11-3c98-4a33-8bc8-6333331cd787-tls-certs\") pod \"9f76cc11-3c98-4a33-8bc8-6333331cd787\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") "
Sep 19 10:56:52.369907 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.369842    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-home\") pod \"9f76cc11-3c98-4a33-8bc8-6333331cd787\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") "
Sep 19 10:56:52.369907 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.369896    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpt4f\" (UniqueName: \"kubernetes.io/projected/9f76cc11-3c98-4a33-8bc8-6333331cd787-kube-api-access-rpt4f\") pod \"9f76cc11-3c98-4a33-8bc8-6333331cd787\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") "
Sep 19 10:56:52.370115 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.369923    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-model-cache" (OuterVolumeSpecName: "model-cache") pod "9f76cc11-3c98-4a33-8bc8-6333331cd787" (UID: "9f76cc11-3c98-4a33-8bc8-6333331cd787"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:56:52.370115 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.369959    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-tmp-dir\") pod \"9f76cc11-3c98-4a33-8bc8-6333331cd787\" (UID: \"9f76cc11-3c98-4a33-8bc8-6333331cd787\") "
Sep 19 10:56:52.370229 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.370162    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-home" (OuterVolumeSpecName: "home") pod "9f76cc11-3c98-4a33-8bc8-6333331cd787" (UID: "9f76cc11-3c98-4a33-8bc8-6333331cd787"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:56:52.370229 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.370204    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9f76cc11-3c98-4a33-8bc8-6333331cd787" (UID: "9f76cc11-3c98-4a33-8bc8-6333331cd787"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:56:52.370373 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.370355    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-model-cache\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:52.370434 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.370376    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-home\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:52.370434 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.370389    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-tmp-dir\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:52.372029 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.371996    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-dshm" (OuterVolumeSpecName: "dshm") pod "9f76cc11-3c98-4a33-8bc8-6333331cd787" (UID: "9f76cc11-3c98-4a33-8bc8-6333331cd787"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:56:52.372152 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.372070    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f76cc11-3c98-4a33-8bc8-6333331cd787-kube-api-access-rpt4f" (OuterVolumeSpecName: "kube-api-access-rpt4f") pod "9f76cc11-3c98-4a33-8bc8-6333331cd787" (UID: "9f76cc11-3c98-4a33-8bc8-6333331cd787"). InnerVolumeSpecName "kube-api-access-rpt4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:56:52.372152 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.372103    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f76cc11-3c98-4a33-8bc8-6333331cd787-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9f76cc11-3c98-4a33-8bc8-6333331cd787" (UID: "9f76cc11-3c98-4a33-8bc8-6333331cd787"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:56:52.471071 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.471047    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f76cc11-3c98-4a33-8bc8-6333331cd787-tls-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:52.471071 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.471068    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpt4f\" (UniqueName: \"kubernetes.io/projected/9f76cc11-3c98-4a33-8bc8-6333331cd787-kube-api-access-rpt4f\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:52.471223 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:52.471078    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f76cc11-3c98-4a33-8bc8-6333331cd787-dshm\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:53.260844 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:53.260816    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"
Sep 19 10:56:53.283997 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:53.283961    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"]
Sep 19 10:56:53.286624 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:53.286604    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e6f44882/e2e-lifecycle-model-e6f44882-kserve-f875dd8d7-h4hxs"]
Sep 19 10:56:54.146941 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.146919    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:56:54.268070 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.267998    2579 generic.go:356] "Generic (PLEG): container finished" podID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerID="d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3" exitCode=0
Sep 19 10:56:54.268070 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.268051    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"
Sep 19 10:56:54.268501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.268086    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" event={"ID":"7348dd3c-1f73-4de6-b771-00a6386e4d53","Type":"ContainerDied","Data":"d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3"}
Sep 19 10:56:54.268501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.268137    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb" event={"ID":"7348dd3c-1f73-4de6-b771-00a6386e4d53","Type":"ContainerDied","Data":"2d3accbecad88a356a5c707d7e5b583fed5012caf8c73a02fbcbf6804c773b01"}
Sep 19 10:56:54.268501 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.268162    2579 scope.go:117] "RemoveContainer" containerID="d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3"
Sep 19 10:56:54.279062 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.278814    2579 scope.go:117] "RemoveContainer" containerID="5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae"
Sep 19 10:56:54.286337 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.286317    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-workload-socket\") pod \"7348dd3c-1f73-4de6-b771-00a6386e4d53\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") "
Sep 19 10:56:54.286435 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.286367    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-token\") pod \"7348dd3c-1f73-4de6-b771-00a6386e4d53\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") "
Sep 19 10:56:54.286435 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.286388    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7348dd3c-1f73-4de6-b771-00a6386e4d53-istiod-ca-cert\") pod \"7348dd3c-1f73-4de6-b771-00a6386e4d53\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") "
Sep 19 10:56:54.286435 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.286410    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-workload-certs\") pod \"7348dd3c-1f73-4de6-b771-00a6386e4d53\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") "
Sep 19 10:56:54.286604 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.286489    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-podinfo\") pod \"7348dd3c-1f73-4de6-b771-00a6386e4d53\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") "
Sep 19 10:56:54.286604 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.286511    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k97b\" (UniqueName: \"kubernetes.io/projected/7348dd3c-1f73-4de6-b771-00a6386e4d53-kube-api-access-6k97b\") pod \"7348dd3c-1f73-4de6-b771-00a6386e4d53\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") "
Sep 19 10:56:54.286604 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.286547    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-envoy\") pod \"7348dd3c-1f73-4de6-b771-00a6386e4d53\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") "
Sep 19 10:56:54.286604 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.286575    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-data\") pod \"7348dd3c-1f73-4de6-b771-00a6386e4d53\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") "
Sep 19 10:56:54.286835 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.286625    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-credential-socket\") pod \"7348dd3c-1f73-4de6-b771-00a6386e4d53\" (UID: \"7348dd3c-1f73-4de6-b771-00a6386e4d53\") "
Sep 19 10:56:54.286985 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.286623    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7348dd3c-1f73-4de6-b771-00a6386e4d53" (UID: "7348dd3c-1f73-4de6-b771-00a6386e4d53"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:56:54.287033 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.286877    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7348dd3c-1f73-4de6-b771-00a6386e4d53" (UID: "7348dd3c-1f73-4de6-b771-00a6386e4d53"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:56:54.287224 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.287197    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-data" (OuterVolumeSpecName: "istio-data") pod "7348dd3c-1f73-4de6-b771-00a6386e4d53" (UID: "7348dd3c-1f73-4de6-b771-00a6386e4d53"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:56:54.287376 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.287352    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7348dd3c-1f73-4de6-b771-00a6386e4d53" (UID: "7348dd3c-1f73-4de6-b771-00a6386e4d53"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:56:54.289091 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.289062    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7348dd3c-1f73-4de6-b771-00a6386e4d53" (UID: "7348dd3c-1f73-4de6-b771-00a6386e4d53"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:56:54.289184 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.289099    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7348dd3c-1f73-4de6-b771-00a6386e4d53-kube-api-access-6k97b" (OuterVolumeSpecName: "kube-api-access-6k97b") pod "7348dd3c-1f73-4de6-b771-00a6386e4d53" (UID: "7348dd3c-1f73-4de6-b771-00a6386e4d53"). InnerVolumeSpecName "kube-api-access-6k97b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:56:54.289184 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.289124    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-token" (OuterVolumeSpecName: "istio-token") pod "7348dd3c-1f73-4de6-b771-00a6386e4d53" (UID: "7348dd3c-1f73-4de6-b771-00a6386e4d53"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:56:54.289329 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.289310    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7348dd3c-1f73-4de6-b771-00a6386e4d53" (UID: "7348dd3c-1f73-4de6-b771-00a6386e4d53"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 10:56:54.293878 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.293856    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7348dd3c-1f73-4de6-b771-00a6386e4d53-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7348dd3c-1f73-4de6-b771-00a6386e4d53" (UID: "7348dd3c-1f73-4de6-b771-00a6386e4d53"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:56:54.294423 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.294403    2579 scope.go:117] "RemoveContainer" containerID="d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3"
Sep 19 10:56:54.294784 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:56:54.294757    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3\": container with ID starting with d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3 not found: ID does not exist" containerID="d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3"
Sep 19 10:56:54.294885 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.294793    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3"} err="failed to get container status \"d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3\": rpc error: code = NotFound desc = could not find container \"d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3\": container with ID starting with d53c2c5e5429e095cb878022e63fc47b476765bd62f18a511cf1de22c41114c3 not found: ID does not exist"
Sep 19 10:56:54.294885 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.294815    2579 scope.go:117] "RemoveContainer" containerID="5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae"
Sep 19 10:56:54.295084 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:56:54.295063    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae\": container with ID starting with 5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae not found: ID does not exist" containerID="5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae"
Sep 19 10:56:54.295144 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.295092    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae"} err="failed to get container status \"5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae\": rpc error: code = NotFound desc = could not find container \"5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae\": container with ID starting with 5ae3f786a14b37cfa1ac073dad7758b329d8d283c623afeb24903681f5d78aae not found: ID does not exist"
Sep 19 10:56:54.387690 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.387667    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-podinfo\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:54.387690 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.387696    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k97b\" (UniqueName: \"kubernetes.io/projected/7348dd3c-1f73-4de6-b771-00a6386e4d53-kube-api-access-6k97b\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:54.387839 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.387709    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-envoy\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:54.387839 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.387720    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:54.387839 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.387745    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-credential-socket\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:54.387839 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.387756    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-workload-socket\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:54.387839 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.387767    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7348dd3c-1f73-4de6-b771-00a6386e4d53-istio-token\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:54.387839 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.387779    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7348dd3c-1f73-4de6-b771-00a6386e4d53-istiod-ca-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:54.387839 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.387793    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7348dd3c-1f73-4de6-b771-00a6386e4d53-workload-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:56:54.593004 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.592978    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"]
Sep 19 10:56:54.596872 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:54.596845    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb"]
Sep 19 10:56:55.203764 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:55.203711    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" path="/var/lib/kubelet/pods/7348dd3c-1f73-4de6-b771-00a6386e4d53/volumes"
Sep 19 10:56:55.204139 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:56:55.204124    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f76cc11-3c98-4a33-8bc8-6333331cd787" path="/var/lib/kubelet/pods/9f76cc11-3c98-4a33-8bc8-6333331cd787/volumes"
Sep 19 10:58:13.394007 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.393977    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"]
Sep 19 10:58:13.394483 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394408    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b51fb9-35d0-4e5e-bd06-15aba8613e2f" containerName="payload-pre-processing"
Sep 19 10:58:13.394483 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394421    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b51fb9-35d0-4e5e-bd06-15aba8613e2f" containerName="payload-pre-processing"
Sep 19 10:58:13.394483 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394435    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e9574f8-2a5d-434b-bf48-b952d1dbf80a" containerName="payload-processing"
Sep 19 10:58:13.394483 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394441    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e9574f8-2a5d-434b-bf48-b952d1dbf80a" containerName="payload-processing"
Sep 19 10:58:13.394483 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394449    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803b8754-c653-4d4c-aca7-3e43d2dd420f" containerName="payload-processing"
Sep 19 10:58:13.394483 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394462    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="803b8754-c653-4d4c-aca7-3e43d2dd420f" containerName="payload-processing"
Sep 19 10:58:13.394483 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394475    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerName="istio-proxy"
Sep 19 10:58:13.394483 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394480    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerName="istio-proxy"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394495    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f76cc11-3c98-4a33-8bc8-6333331cd787" containerName="main"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394504    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f76cc11-3c98-4a33-8bc8-6333331cd787" containerName="main"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394517    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e" containerName="main"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394522    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e" containerName="main"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394530    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62761aec-318e-469e-a9af-4f7a955b6ea8" containerName="payload-pre-processing"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394535    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62761aec-318e-469e-a9af-4f7a955b6ea8" containerName="payload-pre-processing"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394605    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerName="istio-proxy"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394613    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="803b8754-c653-4d4c-aca7-3e43d2dd420f" containerName="payload-processing"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394622    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b51fb9-35d0-4e5e-bd06-15aba8613e2f" containerName="payload-pre-processing"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394628    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62761aec-318e-469e-a9af-4f7a955b6ea8" containerName="payload-pre-processing"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394636    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb8fb7f-df3e-4b67-9ed4-261d35f3d50e" containerName="main"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394641    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f76cc11-3c98-4a33-8bc8-6333331cd787" containerName="main"
Sep 19 10:58:13.394789 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.394647    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e9574f8-2a5d-434b-bf48-b952d1dbf80a" containerName="payload-processing"
Sep 19 10:58:13.397976 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.397956    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.400344 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.400325    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-45f425-openshift-default-dockercfg-fmzdh\""
Sep 19 10:58:13.417090 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.417057    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"]
Sep 19 10:58:13.432369 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.432341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-envoy\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.432472 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.432392    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-data\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.432472 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.432461    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-token\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.432565 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.432519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbhzc\" (UniqueName: \"kubernetes.io/projected/b0ca0aec-1576-4c32-8628-46dddac676e3-kube-api-access-pbhzc\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.432565 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.432550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-workload-socket\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.432650 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.432567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-workload-certs\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.432650 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.432589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ca0aec-1576-4c32-8628-46dddac676e3-istiod-ca-cert\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.432650 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.432610    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-credential-socket\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.432777 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.432684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-podinfo\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.534099 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-envoy\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.534271 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-data\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.534271 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-token\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.534271 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbhzc\" (UniqueName: \"kubernetes.io/projected/b0ca0aec-1576-4c32-8628-46dddac676e3-kube-api-access-pbhzc\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.534439 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-workload-socket\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.534439 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-workload-certs\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.534439 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534391    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ca0aec-1576-4c32-8628-46dddac676e3-istiod-ca-cert\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.534439 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-credential-socket\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.534656 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-podinfo\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.534656 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-data\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.534795 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534712    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-workload-socket\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.534901 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534879    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-credential-socket\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.535019 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.534997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-workload-certs\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.535160 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.535145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ca0aec-1576-4c32-8628-46dddac676e3-istiod-ca-cert\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.536836 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.536814    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-podinfo\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.536932 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.536883    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-envoy\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.541418 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.541388    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-token\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.541706 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.541689    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbhzc\" (UniqueName: \"kubernetes.io/projected/b0ca0aec-1576-4c32-8628-46dddac676e3-kube-api-access-pbhzc\") pod \"e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") " pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.712554 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.712486    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:13.990466 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.990435    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"]
Sep 19 10:58:13.992859 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:58:13.992832    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ca0aec_1576_4c32_8628_46dddac676e3.slice/crio-2baa80c0c9af761454b706dbfeae7e5986c9d742f413ba5bf1df8dc472259af9 WatchSource:0}: Error finding container 2baa80c0c9af761454b706dbfeae7e5986c9d742f413ba5bf1df8dc472259af9: Status 404 returned error can't find the container with id 2baa80c0c9af761454b706dbfeae7e5986c9d742f413ba5bf1df8dc472259af9
Sep 19 10:58:13.995271 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.995235    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:58:13.995396 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.995301    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:58:13.995396 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:13.995327    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:58:14.720353 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:14.720312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" event={"ID":"b0ca0aec-1576-4c32-8628-46dddac676e3","Type":"ContainerStarted","Data":"6533646bdddd4bf2ae55b4a4f6f75b5456f7b3eccc014ca73b5089cabf16c3dc"}
Sep 19 10:58:14.720812 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:14.720380    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" event={"ID":"b0ca0aec-1576-4c32-8628-46dddac676e3","Type":"ContainerStarted","Data":"2baa80c0c9af761454b706dbfeae7e5986c9d742f413ba5bf1df8dc472259af9"}
Sep 19 10:58:14.739523 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:14.739460    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" podStartSLOduration=1.739438254 podStartE2EDuration="1.739438254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:58:14.738575976 +0000 UTC m=+1417.637765868" watchObservedRunningTime="2026-09-19 10:58:14.739438254 +0000 UTC m=+1417.638628148"
Sep 19 10:58:15.713660 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:15.713624    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:15.718827 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:15.718800    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:15.726866 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:15.726841    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:15.727611 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:15.727592    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:20.203218 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.203184    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"]
Sep 19 10:58:20.203668 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.203654    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerName="istio-proxy"
Sep 19 10:58:20.203668 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.203668    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerName="istio-proxy"
Sep 19 10:58:20.203776 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.203758    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7348dd3c-1f73-4de6-b771-00a6386e4d53" containerName="istio-proxy"
Sep 19 10:58:20.207049 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.207033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"
Sep 19 10:58:20.209617 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.209595    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-45f425-dockercfg-89flh\""
Sep 19 10:58:20.209762 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.209630    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-45f425\""
Sep 19 10:58:20.217557 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.217528    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"]
Sep 19 10:58:20.296004 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.295963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdk7r\" (UniqueName: \"kubernetes.io/projected/beb9099c-9ca1-4f0a-bd98-9580a1da141e-kube-api-access-hdk7r\") pod \"payload-processing-e2e-api-a-45f425-685cfff579-szmt4\" (UID: \"beb9099c-9ca1-4f0a-bd98-9580a1da141e\") " pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"
Sep 19 10:58:20.296259 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.296035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beb9099c-9ca1-4f0a-bd98-9580a1da141e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-45f425-685cfff579-szmt4\" (UID: \"beb9099c-9ca1-4f0a-bd98-9580a1da141e\") " pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"
Sep 19 10:58:20.396974 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.396939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdk7r\" (UniqueName: \"kubernetes.io/projected/beb9099c-9ca1-4f0a-bd98-9580a1da141e-kube-api-access-hdk7r\") pod \"payload-processing-e2e-api-a-45f425-685cfff579-szmt4\" (UID: \"beb9099c-9ca1-4f0a-bd98-9580a1da141e\") " pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"
Sep 19 10:58:20.397119 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.396994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beb9099c-9ca1-4f0a-bd98-9580a1da141e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-45f425-685cfff579-szmt4\" (UID: \"beb9099c-9ca1-4f0a-bd98-9580a1da141e\") " pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"
Sep 19 10:58:20.397596 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.397574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beb9099c-9ca1-4f0a-bd98-9580a1da141e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-45f425-685cfff579-szmt4\" (UID: \"beb9099c-9ca1-4f0a-bd98-9580a1da141e\") " pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"
Sep 19 10:58:20.405509 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.405481    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdk7r\" (UniqueName: \"kubernetes.io/projected/beb9099c-9ca1-4f0a-bd98-9580a1da141e-kube-api-access-hdk7r\") pod \"payload-processing-e2e-api-a-45f425-685cfff579-szmt4\" (UID: \"beb9099c-9ca1-4f0a-bd98-9580a1da141e\") " pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"
Sep 19 10:58:20.518868 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.518817    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"
Sep 19 10:58:20.788537 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:20.788514    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"]
Sep 19 10:58:20.791324 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:58:20.791279    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb9099c_9ca1_4f0a_bd98_9580a1da141e.slice/crio-726c8d61e023a14be740683589ae15647a6176c56f5e6df98be165bb26903ad3 WatchSource:0}: Error finding container 726c8d61e023a14be740683589ae15647a6176c56f5e6df98be165bb26903ad3: Status 404 returned error can't find the container with id 726c8d61e023a14be740683589ae15647a6176c56f5e6df98be165bb26903ad3
Sep 19 10:58:21.763407 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:21.763372    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4" event={"ID":"beb9099c-9ca1-4f0a-bd98-9580a1da141e","Type":"ContainerStarted","Data":"8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6"}
Sep 19 10:58:21.763811 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:21.763433    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"
Sep 19 10:58:21.763811 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:21.763458    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4" event={"ID":"beb9099c-9ca1-4f0a-bd98-9580a1da141e","Type":"ContainerStarted","Data":"726c8d61e023a14be740683589ae15647a6176c56f5e6df98be165bb26903ad3"}
Sep 19 10:58:21.780604 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:21.780561    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4" podStartSLOduration=1.780546365 podStartE2EDuration="1.780546365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:58:21.780364399 +0000 UTC m=+1424.679554316" watchObservedRunningTime="2026-09-19 10:58:21.780546365 +0000 UTC m=+1424.679736286"
Sep 19 10:58:22.945917 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:22.945881    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"]
Sep 19 10:58:32.772094 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:32.772064    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"
Sep 19 10:58:36.867799 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:36.867766    2579 generic.go:356] "Generic (PLEG): container finished" podID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerID="6533646bdddd4bf2ae55b4a4f6f75b5456f7b3eccc014ca73b5089cabf16c3dc" exitCode=0
Sep 19 10:58:36.868282 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:36.867844    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" event={"ID":"b0ca0aec-1576-4c32-8628-46dddac676e3","Type":"ContainerDied","Data":"6533646bdddd4bf2ae55b4a4f6f75b5456f7b3eccc014ca73b5089cabf16c3dc"}
Sep 19 10:58:36.868354 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:36.868342    2579 scope.go:117] "RemoveContainer" containerID="6533646bdddd4bf2ae55b4a4f6f75b5456f7b3eccc014ca73b5089cabf16c3dc"
Sep 19 10:58:36.869508 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:36.869483    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:58:36.869574 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:36.869558    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:58:36.869614 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:36.869591    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 10:58:37.875572 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:37.875540    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" event={"ID":"b0ca0aec-1576-4c32-8628-46dddac676e3","Type":"ContainerStarted","Data":"c21df9974f753b5d37515313fd3d63d24b080f8921d0fb728b8ce1f294010dab"}
Sep 19 10:58:37.965218 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:37.965181    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7" podUID="951f0843-47cb-4947-b194-30502eabe99d" containerName="main" containerID="cri-o://6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e" gracePeriod=45
Sep 19 10:58:38.273949 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.273925    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:58:38.368252 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.368222    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-dshm\") pod \"951f0843-47cb-4947-b194-30502eabe99d\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") "
Sep 19 10:58:38.368441 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.368281    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-tmp-dir\") pod \"951f0843-47cb-4947-b194-30502eabe99d\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") "
Sep 19 10:58:38.368441 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.368309    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-model-cache\") pod \"951f0843-47cb-4947-b194-30502eabe99d\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") "
Sep 19 10:58:38.368441 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.368347    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951f0843-47cb-4947-b194-30502eabe99d-tls-certs\") pod \"951f0843-47cb-4947-b194-30502eabe99d\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") "
Sep 19 10:58:38.368441 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.368365    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8tm7\" (UniqueName: \"kubernetes.io/projected/951f0843-47cb-4947-b194-30502eabe99d-kube-api-access-v8tm7\") pod \"951f0843-47cb-4947-b194-30502eabe99d\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") "
Sep 19 10:58:38.368441 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.368383    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-home\") pod \"951f0843-47cb-4947-b194-30502eabe99d\" (UID: \"951f0843-47cb-4947-b194-30502eabe99d\") "
Sep 19 10:58:38.368705 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.368541    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "951f0843-47cb-4947-b194-30502eabe99d" (UID: "951f0843-47cb-4947-b194-30502eabe99d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:58:38.368705 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.368594    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-model-cache" (OuterVolumeSpecName: "model-cache") pod "951f0843-47cb-4947-b194-30502eabe99d" (UID: "951f0843-47cb-4947-b194-30502eabe99d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:58:38.368705 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.368690    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-home" (OuterVolumeSpecName: "home") pod "951f0843-47cb-4947-b194-30502eabe99d" (UID: "951f0843-47cb-4947-b194-30502eabe99d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:58:38.368893 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.368801    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-tmp-dir\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:58:38.368893 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.368815    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-model-cache\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:58:38.368893 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.368823    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-home\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:58:38.370533 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.370514    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951f0843-47cb-4947-b194-30502eabe99d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "951f0843-47cb-4947-b194-30502eabe99d" (UID: "951f0843-47cb-4947-b194-30502eabe99d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 10:58:38.370597 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.370536    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-dshm" (OuterVolumeSpecName: "dshm") pod "951f0843-47cb-4947-b194-30502eabe99d" (UID: "951f0843-47cb-4947-b194-30502eabe99d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:58:38.370637 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.370617    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951f0843-47cb-4947-b194-30502eabe99d-kube-api-access-v8tm7" (OuterVolumeSpecName: "kube-api-access-v8tm7") pod "951f0843-47cb-4947-b194-30502eabe99d" (UID: "951f0843-47cb-4947-b194-30502eabe99d"). InnerVolumeSpecName "kube-api-access-v8tm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:58:38.470111 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.470042    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951f0843-47cb-4947-b194-30502eabe99d-tls-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:58:38.470111 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.470067    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8tm7\" (UniqueName: \"kubernetes.io/projected/951f0843-47cb-4947-b194-30502eabe99d-kube-api-access-v8tm7\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:58:38.470111 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.470077    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951f0843-47cb-4947-b194-30502eabe99d-dshm\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:58:38.712860 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.712821    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:38.713076 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.713057    2579 patch_prober.go:28] interesting pod/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 19 10:58:38.713145 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.713100    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 19 10:58:38.882563 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.882531    2579 generic.go:356] "Generic (PLEG): container finished" podID="951f0843-47cb-4947-b194-30502eabe99d" containerID="6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e" exitCode=0
Sep 19 10:58:38.882944 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.882578    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"
Sep 19 10:58:38.882944 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.882618    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7" event={"ID":"951f0843-47cb-4947-b194-30502eabe99d","Type":"ContainerDied","Data":"6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e"}
Sep 19 10:58:38.882944 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.882659    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7" event={"ID":"951f0843-47cb-4947-b194-30502eabe99d","Type":"ContainerDied","Data":"bd5ed3c31dd3437ab0d49f671fa469a4139b3a06e3fd8eb16a152d6de4505651"}
Sep 19 10:58:38.882944 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.882680    2579 scope.go:117] "RemoveContainer" containerID="6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e"
Sep 19 10:58:38.897206 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.897185    2579 scope.go:117] "RemoveContainer" containerID="6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e"
Sep 19 10:58:38.897548 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:58:38.897518    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e\": container with ID starting with 6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e not found: ID does not exist" containerID="6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e"
Sep 19 10:58:38.897644 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.897560    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e"} err="failed to get container status \"6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e\": rpc error: code = NotFound desc = could not find container \"6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e\": container with ID starting with 6ec2d44690095de29e40258ae2d3e36265b9ae8503abe1bcee1bc7d355b26f6e not found: ID does not exist"
Sep 19 10:58:38.912120 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.912097    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"]
Sep 19 10:58:38.916588 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:38.916570    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w2-99b43e/auth-test-model-99b43e-kserve-7cbc689947-pddk7"]
Sep 19 10:58:39.222313 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:39.222227    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="951f0843-47cb-4947-b194-30502eabe99d" path="/var/lib/kubelet/pods/951f0843-47cb-4947-b194-30502eabe99d/volumes"
Sep 19 10:58:39.713702 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:39.713666    2579 patch_prober.go:28] interesting pod/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 19 10:58:39.713892 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:39.713738    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 19 10:58:40.713702 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:40.713670    2579 patch_prober.go:28] interesting pod/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 19 10:58:40.714183 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:40.713751    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 19 10:58:41.713874 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:41.713836    2579 patch_prober.go:28] interesting pod/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 19 10:58:41.714433 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:41.714401    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 19 10:58:42.713597 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:42.713556    2579 patch_prober.go:28] interesting pod/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 19 10:58:42.713815 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:42.713640    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 19 10:58:43.717338 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:43.717310    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:43.717823 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:43.717597    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:43.718302 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:43.718282    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:58:54.019532 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.019495    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"]
Sep 19 10:58:54.020376 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.019996    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951f0843-47cb-4947-b194-30502eabe99d" containerName="main"
Sep 19 10:58:54.020376 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.020010    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="951f0843-47cb-4947-b194-30502eabe99d" containerName="main"
Sep 19 10:58:54.020376 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.020084    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="951f0843-47cb-4947-b194-30502eabe99d" containerName="main"
Sep 19 10:58:54.024714 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.024691    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"
Sep 19 10:58:54.027353 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.027329    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-a1c584-dockercfg-s4mls\""
Sep 19 10:58:54.027468 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.027357    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-a1c584\""
Sep 19 10:58:54.037582 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.037557    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"]
Sep 19 10:58:54.057989 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.057963    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"]
Sep 19 10:58:54.061463 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.061445    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"
Sep 19 10:58:54.071927 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.071905    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"]
Sep 19 10:58:54.218809 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.218767    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e30635-b80c-4d33-bc75-050aa4672cdd-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp\" (UID: \"d8e30635-b80c-4d33-bc75-050aa4672cdd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"
Sep 19 10:58:54.218809 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.218813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/067230f9-63b5-4078-8819-b7b1af98374f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5\" (UID: \"067230f9-63b5-4078-8819-b7b1af98374f\") " pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"
Sep 19 10:58:54.219062 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.218893    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwphg\" (UniqueName: \"kubernetes.io/projected/d8e30635-b80c-4d33-bc75-050aa4672cdd-kube-api-access-pwphg\") pod \"payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp\" (UID: \"d8e30635-b80c-4d33-bc75-050aa4672cdd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"
Sep 19 10:58:54.219062 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.219024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4fw4\" (UniqueName: \"kubernetes.io/projected/067230f9-63b5-4078-8819-b7b1af98374f-kube-api-access-q4fw4\") pod \"payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5\" (UID: \"067230f9-63b5-4078-8819-b7b1af98374f\") " pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"
Sep 19 10:58:54.319974 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.319945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e30635-b80c-4d33-bc75-050aa4672cdd-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp\" (UID: \"d8e30635-b80c-4d33-bc75-050aa4672cdd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"
Sep 19 10:58:54.320151 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.319984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/067230f9-63b5-4078-8819-b7b1af98374f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5\" (UID: \"067230f9-63b5-4078-8819-b7b1af98374f\") " pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"
Sep 19 10:58:54.320151 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.320016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwphg\" (UniqueName: \"kubernetes.io/projected/d8e30635-b80c-4d33-bc75-050aa4672cdd-kube-api-access-pwphg\") pod \"payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp\" (UID: \"d8e30635-b80c-4d33-bc75-050aa4672cdd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"
Sep 19 10:58:54.320151 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.320100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4fw4\" (UniqueName: \"kubernetes.io/projected/067230f9-63b5-4078-8819-b7b1af98374f-kube-api-access-q4fw4\") pod \"payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5\" (UID: \"067230f9-63b5-4078-8819-b7b1af98374f\") " pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"
Sep 19 10:58:54.320662 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.320641    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e30635-b80c-4d33-bc75-050aa4672cdd-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp\" (UID: \"d8e30635-b80c-4d33-bc75-050aa4672cdd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"
Sep 19 10:58:54.320738 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.320709    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/067230f9-63b5-4078-8819-b7b1af98374f-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5\" (UID: \"067230f9-63b5-4078-8819-b7b1af98374f\") " pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"
Sep 19 10:58:54.327794 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.327769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4fw4\" (UniqueName: \"kubernetes.io/projected/067230f9-63b5-4078-8819-b7b1af98374f-kube-api-access-q4fw4\") pod \"payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5\" (UID: \"067230f9-63b5-4078-8819-b7b1af98374f\") " pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"
Sep 19 10:58:54.327913 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.327797    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwphg\" (UniqueName: \"kubernetes.io/projected/d8e30635-b80c-4d33-bc75-050aa4672cdd-kube-api-access-pwphg\") pod \"payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp\" (UID: \"d8e30635-b80c-4d33-bc75-050aa4672cdd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"
Sep 19 10:58:54.335598 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.335579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"
Sep 19 10:58:54.375190 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.373887    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"
Sep 19 10:58:54.607782 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.607756    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"]
Sep 19 10:58:54.609983 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:58:54.609958    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e30635_b80c_4d33_bc75_050aa4672cdd.slice/crio-604d8a12e4f16130866b940bb2770cda04da2720d29134eedeece2b09a9693f2 WatchSource:0}: Error finding container 604d8a12e4f16130866b940bb2770cda04da2720d29134eedeece2b09a9693f2: Status 404 returned error can't find the container with id 604d8a12e4f16130866b940bb2770cda04da2720d29134eedeece2b09a9693f2
Sep 19 10:58:54.650358 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.650333    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"]
Sep 19 10:58:54.657861 ip-10-0-143-186 kubenswrapper[2579]: W0919 10:58:54.657831    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067230f9_63b5_4078_8819_b7b1af98374f.slice/crio-b96a007e007701ea44783817b6b3f0ee08398af7afc27c5c0085d8c2d092e2a1 WatchSource:0}: Error finding container b96a007e007701ea44783817b6b3f0ee08398af7afc27c5c0085d8c2d092e2a1: Status 404 returned error can't find the container with id b96a007e007701ea44783817b6b3f0ee08398af7afc27c5c0085d8c2d092e2a1
Sep 19 10:58:54.985445 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.985359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5" event={"ID":"067230f9-63b5-4078-8819-b7b1af98374f","Type":"ContainerStarted","Data":"80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681"}
Sep 19 10:58:54.985445 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.985417    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5" event={"ID":"067230f9-63b5-4078-8819-b7b1af98374f","Type":"ContainerStarted","Data":"b96a007e007701ea44783817b6b3f0ee08398af7afc27c5c0085d8c2d092e2a1"}
Sep 19 10:58:54.985672 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.985499    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"
Sep 19 10:58:54.987047 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.987002    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp" event={"ID":"d8e30635-b80c-4d33-bc75-050aa4672cdd","Type":"ContainerStarted","Data":"40e9e1015d284dfc4e339e7c259a79c047df11ff1d6fe3075adec607f4f187bf"}
Sep 19 10:58:54.987047 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.987046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp" event={"ID":"d8e30635-b80c-4d33-bc75-050aa4672cdd","Type":"ContainerStarted","Data":"604d8a12e4f16130866b940bb2770cda04da2720d29134eedeece2b09a9693f2"}
Sep 19 10:58:54.987245 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:54.987158    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"
Sep 19 10:58:55.001074 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:55.001026    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5" podStartSLOduration=1.001008206 podStartE2EDuration="1.001008206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:58:55.000544239 +0000 UTC m=+1457.899734160" watchObservedRunningTime="2026-09-19 10:58:55.001008206 +0000 UTC m=+1457.900198101"
Sep 19 10:58:55.019939 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:58:55.019889    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp" podStartSLOduration=1.019872755 podStartE2EDuration="1.019872755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:58:55.018987234 +0000 UTC m=+1457.918177127" watchObservedRunningTime="2026-09-19 10:58:55.019872755 +0000 UTC m=+1457.919062648"
Sep 19 10:59:05.994495 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:05.994465    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"
Sep 19 10:59:05.994991 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:05.994545    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"
Sep 19 10:59:38.572546 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:38.572508    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"]
Sep 19 10:59:38.573160 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:38.572747    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4" podUID="beb9099c-9ca1-4f0a-bd98-9580a1da141e" containerName="payload-processing" containerID="cri-o://8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6" gracePeriod=30
Sep 19 10:59:38.839719 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:38.839695    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"
Sep 19 10:59:39.003428 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.003387    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beb9099c-9ca1-4f0a-bd98-9580a1da141e-plugins-config-volume\") pod \"beb9099c-9ca1-4f0a-bd98-9580a1da141e\" (UID: \"beb9099c-9ca1-4f0a-bd98-9580a1da141e\") "
Sep 19 10:59:39.003599 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.003559    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdk7r\" (UniqueName: \"kubernetes.io/projected/beb9099c-9ca1-4f0a-bd98-9580a1da141e-kube-api-access-hdk7r\") pod \"beb9099c-9ca1-4f0a-bd98-9580a1da141e\" (UID: \"beb9099c-9ca1-4f0a-bd98-9580a1da141e\") "
Sep 19 10:59:39.003873 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.003833    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beb9099c-9ca1-4f0a-bd98-9580a1da141e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "beb9099c-9ca1-4f0a-bd98-9580a1da141e" (UID: "beb9099c-9ca1-4f0a-bd98-9580a1da141e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:59:39.003993 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.003980    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beb9099c-9ca1-4f0a-bd98-9580a1da141e-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:59:39.005767 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.005738    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beb9099c-9ca1-4f0a-bd98-9580a1da141e-kube-api-access-hdk7r" (OuterVolumeSpecName: "kube-api-access-hdk7r") pod "beb9099c-9ca1-4f0a-bd98-9580a1da141e" (UID: "beb9099c-9ca1-4f0a-bd98-9580a1da141e"). InnerVolumeSpecName "kube-api-access-hdk7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:59:39.105215 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.105154    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdk7r\" (UniqueName: \"kubernetes.io/projected/beb9099c-9ca1-4f0a-bd98-9580a1da141e-kube-api-access-hdk7r\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:59:39.247263 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.247235    2579 generic.go:356] "Generic (PLEG): container finished" podID="beb9099c-9ca1-4f0a-bd98-9580a1da141e" containerID="8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6" exitCode=0
Sep 19 10:59:39.247412 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.247277    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"
Sep 19 10:59:39.247412 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.247318    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4" event={"ID":"beb9099c-9ca1-4f0a-bd98-9580a1da141e","Type":"ContainerDied","Data":"8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6"}
Sep 19 10:59:39.247412 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.247384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4" event={"ID":"beb9099c-9ca1-4f0a-bd98-9580a1da141e","Type":"ContainerDied","Data":"726c8d61e023a14be740683589ae15647a6176c56f5e6df98be165bb26903ad3"}
Sep 19 10:59:39.247587 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.247417    2579 scope.go:117] "RemoveContainer" containerID="8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6"
Sep 19 10:59:39.256989 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.256968    2579 scope.go:117] "RemoveContainer" containerID="8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6"
Sep 19 10:59:39.257254 ip-10-0-143-186 kubenswrapper[2579]: E0919 10:59:39.257227    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6\": container with ID starting with 8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6 not found: ID does not exist" containerID="8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6"
Sep 19 10:59:39.257314 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.257260    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6"} err="failed to get container status \"8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6\": rpc error: code = NotFound desc = could not find container \"8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6\": container with ID starting with 8755afedf75d401501c436cca1d89ab9fb5b373c82502b31799903f3509b0fc6 not found: ID does not exist"
Sep 19 10:59:39.271984 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.271964    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"]
Sep 19 10:59:39.274772 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.274748    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4"]
Sep 19 10:59:39.286373 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.286357    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:59:39.296263 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:39.296247    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 10:59:41.203381 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:41.203345    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beb9099c-9ca1-4f0a-bd98-9580a1da141e" path="/var/lib/kubelet/pods/beb9099c-9ca1-4f0a-bd98-9580a1da141e/volumes"
Sep 19 10:59:45.175473 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:45.175441    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"]
Sep 19 10:59:45.175951 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:45.175658    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerName="istio-proxy" containerID="cri-o://c21df9974f753b5d37515313fd3d63d24b080f8921d0fb728b8ce1f294010dab" gracePeriod=30
Sep 19 10:59:50.308719 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.308686    2579 generic.go:356] "Generic (PLEG): container finished" podID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerID="c21df9974f753b5d37515313fd3d63d24b080f8921d0fb728b8ce1f294010dab" exitCode=0
Sep 19 10:59:50.309137 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.308766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" event={"ID":"b0ca0aec-1576-4c32-8628-46dddac676e3","Type":"ContainerDied","Data":"c21df9974f753b5d37515313fd3d63d24b080f8921d0fb728b8ce1f294010dab"}
Sep 19 10:59:50.309137 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.308848    2579 scope.go:117] "RemoveContainer" containerID="6533646bdddd4bf2ae55b4a4f6f75b5456f7b3eccc014ca73b5089cabf16c3dc"
Sep 19 10:59:50.438793 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.438735    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:59:50.600196 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600168    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ca0aec-1576-4c32-8628-46dddac676e3-istiod-ca-cert\") pod \"b0ca0aec-1576-4c32-8628-46dddac676e3\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") "
Sep 19 10:59:50.600339 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600208    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-workload-socket\") pod \"b0ca0aec-1576-4c32-8628-46dddac676e3\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") "
Sep 19 10:59:50.600339 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600242    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-credential-socket\") pod \"b0ca0aec-1576-4c32-8628-46dddac676e3\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") "
Sep 19 10:59:50.600339 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600261    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-envoy\") pod \"b0ca0aec-1576-4c32-8628-46dddac676e3\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") "
Sep 19 10:59:50.600339 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600292    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-data\") pod \"b0ca0aec-1576-4c32-8628-46dddac676e3\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") "
Sep 19 10:59:50.600339 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600316    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbhzc\" (UniqueName: \"kubernetes.io/projected/b0ca0aec-1576-4c32-8628-46dddac676e3-kube-api-access-pbhzc\") pod \"b0ca0aec-1576-4c32-8628-46dddac676e3\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") "
Sep 19 10:59:50.600590 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600347    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-podinfo\") pod \"b0ca0aec-1576-4c32-8628-46dddac676e3\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") "
Sep 19 10:59:50.600590 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600426    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-token\") pod \"b0ca0aec-1576-4c32-8628-46dddac676e3\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") "
Sep 19 10:59:50.600590 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600467    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-workload-certs\") pod \"b0ca0aec-1576-4c32-8628-46dddac676e3\" (UID: \"b0ca0aec-1576-4c32-8628-46dddac676e3\") "
Sep 19 10:59:50.600590 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600534    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b0ca0aec-1576-4c32-8628-46dddac676e3" (UID: "b0ca0aec-1576-4c32-8628-46dddac676e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:59:50.600590 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600566    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ca0aec-1576-4c32-8628-46dddac676e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b0ca0aec-1576-4c32-8628-46dddac676e3" (UID: "b0ca0aec-1576-4c32-8628-46dddac676e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 10:59:50.600856 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600627    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b0ca0aec-1576-4c32-8628-46dddac676e3" (UID: "b0ca0aec-1576-4c32-8628-46dddac676e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:59:50.600856 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600696    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "b0ca0aec-1576-4c32-8628-46dddac676e3" (UID: "b0ca0aec-1576-4c32-8628-46dddac676e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:59:50.600856 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600843    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b0ca0aec-1576-4c32-8628-46dddac676e3" (UID: "b0ca0aec-1576-4c32-8628-46dddac676e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:59:50.601009 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600948    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:59:50.601009 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600964    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-workload-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:59:50.601009 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600982    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ca0aec-1576-4c32-8628-46dddac676e3-istiod-ca-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:59:50.601009 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.600999    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-workload-socket\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:59:50.601153 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.601013    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-credential-socket\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:59:50.602719 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.602693    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b0ca0aec-1576-4c32-8628-46dddac676e3" (UID: "b0ca0aec-1576-4c32-8628-46dddac676e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 10:59:50.602844 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.602776    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "b0ca0aec-1576-4c32-8628-46dddac676e3" (UID: "b0ca0aec-1576-4c32-8628-46dddac676e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:59:50.602949 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.602928    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b0ca0aec-1576-4c32-8628-46dddac676e3" (UID: "b0ca0aec-1576-4c32-8628-46dddac676e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 10:59:50.603002 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.602948    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ca0aec-1576-4c32-8628-46dddac676e3-kube-api-access-pbhzc" (OuterVolumeSpecName: "kube-api-access-pbhzc") pod "b0ca0aec-1576-4c32-8628-46dddac676e3" (UID: "b0ca0aec-1576-4c32-8628-46dddac676e3"). InnerVolumeSpecName "kube-api-access-pbhzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 10:59:50.702206 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.702149    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-envoy\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:59:50.702206 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.702171    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbhzc\" (UniqueName: \"kubernetes.io/projected/b0ca0aec-1576-4c32-8628-46dddac676e3-kube-api-access-pbhzc\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:59:50.702206 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.702183    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-podinfo\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:59:50.702206 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:50.702196    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ca0aec-1576-4c32-8628-46dddac676e3-istio-token\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 10:59:51.315824 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:51.315790    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"
Sep 19 10:59:51.316148 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:51.315827    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz" event={"ID":"b0ca0aec-1576-4c32-8628-46dddac676e3","Type":"ContainerDied","Data":"2baa80c0c9af761454b706dbfeae7e5986c9d742f413ba5bf1df8dc472259af9"}
Sep 19 10:59:51.316148 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:51.315892    2579 scope.go:117] "RemoveContainer" containerID="c21df9974f753b5d37515313fd3d63d24b080f8921d0fb728b8ce1f294010dab"
Sep 19 10:59:51.332987 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:51.332962    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"]
Sep 19 10:59:51.336689 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:51.336664    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz"]
Sep 19 10:59:53.203474 ip-10-0-143-186 kubenswrapper[2579]: I0919 10:59:53.203383    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" path="/var/lib/kubelet/pods/b0ca0aec-1576-4c32-8628-46dddac676e3/volumes"
Sep 19 11:00:00.151202 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.151161    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b"]
Sep 19 11:00:00.151610 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.151590    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerName="istio-proxy"
Sep 19 11:00:00.151610 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.151601    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerName="istio-proxy"
Sep 19 11:00:00.151685 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.151618    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb9099c-9ca1-4f0a-bd98-9580a1da141e" containerName="payload-processing"
Sep 19 11:00:00.151685 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.151624    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb9099c-9ca1-4f0a-bd98-9580a1da141e" containerName="payload-processing"
Sep 19 11:00:00.151786 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.151701    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="beb9099c-9ca1-4f0a-bd98-9580a1da141e" containerName="payload-processing"
Sep 19 11:00:00.151786 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.151709    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerName="istio-proxy"
Sep 19 11:00:00.151786 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.151716    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerName="istio-proxy"
Sep 19 11:00:00.156403 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.156383    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b"
Sep 19 11:00:00.158881 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.158855    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mckfb\""
Sep 19 11:00:00.161620 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.161594    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b"]
Sep 19 11:00:00.169973 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.169954    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b"
Sep 19 11:00:00.447134 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.447098    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b"]
Sep 19 11:00:00.451537 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:00:00.451506    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6680deb5_2a03_4c8a_a28e_0a2da21e0d7b.slice/crio-94ef7ea172d1d1ff067bfa10d7f7d310e9cb7e9bde4af5185355ee9b5ef274c7 WatchSource:0}: Error finding container 94ef7ea172d1d1ff067bfa10d7f7d310e9cb7e9bde4af5185355ee9b5ef274c7: Status 404 returned error can't find the container with id 94ef7ea172d1d1ff067bfa10d7f7d310e9cb7e9bde4af5185355ee9b5ef274c7
Sep 19 11:00:00.453854 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:00.453831    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 11:00:01.057242 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.057211    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b"]
Sep 19 11:00:01.092764 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.087192    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"]
Sep 19 11:00:01.092764 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.087427    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5" podUID="067230f9-63b5-4078-8819-b7b1af98374f" containerName="payload-processing" containerID="cri-o://80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681" gracePeriod=30
Sep 19 11:00:01.095583 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.095543    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"]
Sep 19 11:00:01.096027 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.095770    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp" podUID="d8e30635-b80c-4d33-bc75-050aa4672cdd" containerName="payload-pre-processing" containerID="cri-o://40e9e1015d284dfc4e339e7c259a79c047df11ff1d6fe3075adec607f4f187bf" gracePeriod=30
Sep 19 11:00:01.368796 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.368771    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"
Sep 19 11:00:01.381274 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.381250    2579 generic.go:356] "Generic (PLEG): container finished" podID="d8e30635-b80c-4d33-bc75-050aa4672cdd" containerID="40e9e1015d284dfc4e339e7c259a79c047df11ff1d6fe3075adec607f4f187bf" exitCode=0
Sep 19 11:00:01.381375 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.381323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp" event={"ID":"d8e30635-b80c-4d33-bc75-050aa4672cdd","Type":"ContainerDied","Data":"40e9e1015d284dfc4e339e7c259a79c047df11ff1d6fe3075adec607f4f187bf"}
Sep 19 11:00:01.381425 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.381385    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp" event={"ID":"d8e30635-b80c-4d33-bc75-050aa4672cdd","Type":"ContainerDied","Data":"604d8a12e4f16130866b940bb2770cda04da2720d29134eedeece2b09a9693f2"}
Sep 19 11:00:01.381425 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.381411    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="604d8a12e4f16130866b940bb2770cda04da2720d29134eedeece2b09a9693f2"
Sep 19 11:00:01.382672 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.382639    2579 generic.go:356] "Generic (PLEG): container finished" podID="067230f9-63b5-4078-8819-b7b1af98374f" containerID="80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681" exitCode=0
Sep 19 11:00:01.382836 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.382698    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"
Sep 19 11:00:01.382836 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.382716    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5" event={"ID":"067230f9-63b5-4078-8819-b7b1af98374f","Type":"ContainerDied","Data":"80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681"}
Sep 19 11:00:01.383071 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.382786    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5" event={"ID":"067230f9-63b5-4078-8819-b7b1af98374f","Type":"ContainerDied","Data":"b96a007e007701ea44783817b6b3f0ee08398af7afc27c5c0085d8c2d092e2a1"}
Sep 19 11:00:01.383244 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.383163    2579 scope.go:117] "RemoveContainer" containerID="80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681"
Sep 19 11:00:01.384902 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.384849    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b" event={"ID":"6680deb5-2a03-4c8a-a28e-0a2da21e0d7b","Type":"ContainerStarted","Data":"94ef7ea172d1d1ff067bfa10d7f7d310e9cb7e9bde4af5185355ee9b5ef274c7"}
Sep 19 11:00:01.389093 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.389075    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"
Sep 19 11:00:01.390353 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.390331    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/067230f9-63b5-4078-8819-b7b1af98374f-plugins-config-volume\") pod \"067230f9-63b5-4078-8819-b7b1af98374f\" (UID: \"067230f9-63b5-4078-8819-b7b1af98374f\") "
Sep 19 11:00:01.390791 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.390466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4fw4\" (UniqueName: \"kubernetes.io/projected/067230f9-63b5-4078-8819-b7b1af98374f-kube-api-access-q4fw4\") pod \"067230f9-63b5-4078-8819-b7b1af98374f\" (UID: \"067230f9-63b5-4078-8819-b7b1af98374f\") "
Sep 19 11:00:01.390791 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.390758    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/067230f9-63b5-4078-8819-b7b1af98374f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "067230f9-63b5-4078-8819-b7b1af98374f" (UID: "067230f9-63b5-4078-8819-b7b1af98374f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:00:01.390954 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.390887    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/067230f9-63b5-4078-8819-b7b1af98374f-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:01.392689 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.392664    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/067230f9-63b5-4078-8819-b7b1af98374f-kube-api-access-q4fw4" (OuterVolumeSpecName: "kube-api-access-q4fw4") pod "067230f9-63b5-4078-8819-b7b1af98374f" (UID: "067230f9-63b5-4078-8819-b7b1af98374f"). InnerVolumeSpecName "kube-api-access-q4fw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:00:01.395959 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.395935    2579 scope.go:117] "RemoveContainer" containerID="80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681"
Sep 19 11:00:01.396290 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:00:01.396261    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681\": container with ID starting with 80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681 not found: ID does not exist" containerID="80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681"
Sep 19 11:00:01.396383 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.396303    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681"} err="failed to get container status \"80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681\": rpc error: code = NotFound desc = could not find container \"80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681\": container with ID starting with 80ad9ef14f613aa9443be5538b48310646046a30ca38b2af047923d205d84681 not found: ID does not exist"
Sep 19 11:00:01.492153 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.492114    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e30635-b80c-4d33-bc75-050aa4672cdd-plugins-config-volume\") pod \"d8e30635-b80c-4d33-bc75-050aa4672cdd\" (UID: \"d8e30635-b80c-4d33-bc75-050aa4672cdd\") "
Sep 19 11:00:01.492368 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.492246    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwphg\" (UniqueName: \"kubernetes.io/projected/d8e30635-b80c-4d33-bc75-050aa4672cdd-kube-api-access-pwphg\") pod \"d8e30635-b80c-4d33-bc75-050aa4672cdd\" (UID: \"d8e30635-b80c-4d33-bc75-050aa4672cdd\") "
Sep 19 11:00:01.492572 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.492544    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4fw4\" (UniqueName: \"kubernetes.io/projected/067230f9-63b5-4078-8819-b7b1af98374f-kube-api-access-q4fw4\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:01.493023 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.492992    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8e30635-b80c-4d33-bc75-050aa4672cdd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8e30635-b80c-4d33-bc75-050aa4672cdd" (UID: "d8e30635-b80c-4d33-bc75-050aa4672cdd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:00:01.494394 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.494362    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8e30635-b80c-4d33-bc75-050aa4672cdd-kube-api-access-pwphg" (OuterVolumeSpecName: "kube-api-access-pwphg") pod "d8e30635-b80c-4d33-bc75-050aa4672cdd" (UID: "d8e30635-b80c-4d33-bc75-050aa4672cdd"). InnerVolumeSpecName "kube-api-access-pwphg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:00:01.593890 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.593821    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwphg\" (UniqueName: \"kubernetes.io/projected/d8e30635-b80c-4d33-bc75-050aa4672cdd-kube-api-access-pwphg\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:01.593890 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.593850    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e30635-b80c-4d33-bc75-050aa4672cdd-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:01.709009 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.708978    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"]
Sep 19 11:00:01.710974 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:01.710944    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5"]
Sep 19 11:00:02.393683 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:02.393653    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"
Sep 19 11:00:02.417038 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:02.417013    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"]
Sep 19 11:00:02.421767 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:02.421743    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp"]
Sep 19 11:00:03.204221 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:03.204189    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="067230f9-63b5-4078-8819-b7b1af98374f" path="/var/lib/kubelet/pods/067230f9-63b5-4078-8819-b7b1af98374f/volumes"
Sep 19 11:00:03.204679 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:03.204657    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8e30635-b80c-4d33-bc75-050aa4672cdd" path="/var/lib/kubelet/pods/d8e30635-b80c-4d33-bc75-050aa4672cdd/volumes"
Sep 19 11:00:04.407405 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:04.407380    2579 generic.go:356] "Generic (PLEG): container finished" podID="6680deb5-2a03-4c8a-a28e-0a2da21e0d7b" containerID="b3b8c13603f49f0aa109e8faeb52e491ec971d0a7458c805a17e5593fcfa03c9" exitCode=6
Sep 19 11:00:04.407803 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:04.407471    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b" event={"ID":"6680deb5-2a03-4c8a-a28e-0a2da21e0d7b","Type":"ContainerDied","Data":"b3b8c13603f49f0aa109e8faeb52e491ec971d0a7458c805a17e5593fcfa03c9"}
Sep 19 11:00:04.533912 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:04.533887    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b"
Sep 19 11:00:05.414108 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:05.414079    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b"
Sep 19 11:00:05.414499 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:05.414116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b" event={"ID":"6680deb5-2a03-4c8a-a28e-0a2da21e0d7b","Type":"ContainerDied","Data":"94ef7ea172d1d1ff067bfa10d7f7d310e9cb7e9bde4af5185355ee9b5ef274c7"}
Sep 19 11:00:05.414499 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:05.414172    2579 scope.go:117] "RemoveContainer" containerID="b3b8c13603f49f0aa109e8faeb52e491ec971d0a7458c805a17e5593fcfa03c9"
Sep 19 11:00:05.428387 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:05.428364    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b"]
Sep 19 11:00:05.432205 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:05.432183    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-a1c584-29830260-nqf2b"]
Sep 19 11:00:07.202999 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:07.202965    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6680deb5-2a03-4c8a-a28e-0a2da21e0d7b" path="/var/lib/kubelet/pods/6680deb5-2a03-4c8a-a28e-0a2da21e0d7b/volumes"
Sep 19 11:00:18.402795 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.402754    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"]
Sep 19 11:00:18.403829 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.403767    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj" podUID="cc1d06f6-3de0-4bbb-9656-aedab1dd61ab" containerName="maas-api" containerID="cri-o://1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855" gracePeriod=30
Sep 19 11:00:18.446254 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.446227    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"]
Sep 19 11:00:18.446693 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.446429    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz" podUID="3d669c10-a611-425a-ab8f-82668cdefee1" containerName="payload-processing" containerID="cri-o://4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96" gracePeriod=30
Sep 19 11:00:18.452381 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.452355    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"]
Sep 19 11:00:18.452665 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.452598    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695" podUID="d63cb64b-0099-435d-be84-16f09aaa9799" containerName="payload-pre-processing" containerID="cri-o://0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34" gracePeriod=30
Sep 19 11:00:18.757104 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.757079    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 11:00:18.760062 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.760029    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"
Sep 19 11:00:18.763460 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.763441    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"
Sep 19 11:00:18.841647 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.841618    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c674\" (UniqueName: \"kubernetes.io/projected/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-kube-api-access-5c674\") pod \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") "
Sep 19 11:00:18.841820 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.841677    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-maas-api-tls\") pod \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") "
Sep 19 11:00:18.841820 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.841697    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgr2w\" (UniqueName: \"kubernetes.io/projected/3d669c10-a611-425a-ab8f-82668cdefee1-kube-api-access-dgr2w\") pod \"3d669c10-a611-425a-ab8f-82668cdefee1\" (UID: \"3d669c10-a611-425a-ab8f-82668cdefee1\") "
Sep 19 11:00:18.841908 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.841870    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d669c10-a611-425a-ab8f-82668cdefee1-plugins-config-volume\") pod \"3d669c10-a611-425a-ab8f-82668cdefee1\" (UID: \"3d669c10-a611-425a-ab8f-82668cdefee1\") "
Sep 19 11:00:18.841951 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.841904    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-metrics-certs\") pod \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") "
Sep 19 11:00:18.842013 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.841986    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d63cb64b-0099-435d-be84-16f09aaa9799-plugins-config-volume\") pod \"d63cb64b-0099-435d-be84-16f09aaa9799\" (UID: \"d63cb64b-0099-435d-be84-16f09aaa9799\") "
Sep 19 11:00:18.842070 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.842032    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxrjt\" (UniqueName: \"kubernetes.io/projected/d63cb64b-0099-435d-be84-16f09aaa9799-kube-api-access-jxrjt\") pod \"d63cb64b-0099-435d-be84-16f09aaa9799\" (UID: \"d63cb64b-0099-435d-be84-16f09aaa9799\") "
Sep 19 11:00:18.842129 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.842066    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-openshift-service-ca\") pod \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\" (UID: \"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab\") "
Sep 19 11:00:18.842309 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.842265    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d669c10-a611-425a-ab8f-82668cdefee1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3d669c10-a611-425a-ab8f-82668cdefee1" (UID: "3d669c10-a611-425a-ab8f-82668cdefee1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:00:18.842442 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.842408    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d63cb64b-0099-435d-be84-16f09aaa9799-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d63cb64b-0099-435d-be84-16f09aaa9799" (UID: "d63cb64b-0099-435d-be84-16f09aaa9799"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:00:18.842442 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.842434    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d669c10-a611-425a-ab8f-82668cdefee1-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:18.842640 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.842611    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc1d06f6-3de0-4bbb-9656-aedab1dd61ab" (UID: "cc1d06f6-3de0-4bbb-9656-aedab1dd61ab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:00:18.844086 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.844061    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-kube-api-access-5c674" (OuterVolumeSpecName: "kube-api-access-5c674") pod "cc1d06f6-3de0-4bbb-9656-aedab1dd61ab" (UID: "cc1d06f6-3de0-4bbb-9656-aedab1dd61ab"). InnerVolumeSpecName "kube-api-access-5c674". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:00:18.844188 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.844138    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cc1d06f6-3de0-4bbb-9656-aedab1dd61ab" (UID: "cc1d06f6-3de0-4bbb-9656-aedab1dd61ab"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:00:18.844188 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.844148    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d63cb64b-0099-435d-be84-16f09aaa9799-kube-api-access-jxrjt" (OuterVolumeSpecName: "kube-api-access-jxrjt") pod "d63cb64b-0099-435d-be84-16f09aaa9799" (UID: "d63cb64b-0099-435d-be84-16f09aaa9799"). InnerVolumeSpecName "kube-api-access-jxrjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:00:18.844315 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.844297    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc1d06f6-3de0-4bbb-9656-aedab1dd61ab" (UID: "cc1d06f6-3de0-4bbb-9656-aedab1dd61ab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:00:18.844452 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.844437    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d669c10-a611-425a-ab8f-82668cdefee1-kube-api-access-dgr2w" (OuterVolumeSpecName: "kube-api-access-dgr2w") pod "3d669c10-a611-425a-ab8f-82668cdefee1" (UID: "3d669c10-a611-425a-ab8f-82668cdefee1"). InnerVolumeSpecName "kube-api-access-dgr2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:00:18.943556 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.943498    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxrjt\" (UniqueName: \"kubernetes.io/projected/d63cb64b-0099-435d-be84-16f09aaa9799-kube-api-access-jxrjt\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:18.943556 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.943521    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-openshift-service-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:18.943556 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.943530    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c674\" (UniqueName: \"kubernetes.io/projected/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-kube-api-access-5c674\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:18.943556 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.943541    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-maas-api-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:18.943556 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.943550    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgr2w\" (UniqueName: \"kubernetes.io/projected/3d669c10-a611-425a-ab8f-82668cdefee1-kube-api-access-dgr2w\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:18.943556 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.943558    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab-metrics-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:18.943850 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:18.943567    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d63cb64b-0099-435d-be84-16f09aaa9799-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:19.498557 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.498483    2579 generic.go:356] "Generic (PLEG): container finished" podID="d63cb64b-0099-435d-be84-16f09aaa9799" containerID="0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34" exitCode=0
Sep 19 11:00:19.498557 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.498526    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"
Sep 19 11:00:19.499015 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.498568    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695" event={"ID":"d63cb64b-0099-435d-be84-16f09aaa9799","Type":"ContainerDied","Data":"0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34"}
Sep 19 11:00:19.499015 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.498618    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695" event={"ID":"d63cb64b-0099-435d-be84-16f09aaa9799","Type":"ContainerDied","Data":"f96074653466bdfa3b4f74b6e1d7fdcfccba81cef72f00a5d67f84825b2f0063"}
Sep 19 11:00:19.499015 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.498647    2579 scope.go:117] "RemoveContainer" containerID="0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34"
Sep 19 11:00:19.500109 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.500084    2579 generic.go:356] "Generic (PLEG): container finished" podID="3d669c10-a611-425a-ab8f-82668cdefee1" containerID="4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96" exitCode=0
Sep 19 11:00:19.500178 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.500130    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"
Sep 19 11:00:19.500239 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.500173    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz" event={"ID":"3d669c10-a611-425a-ab8f-82668cdefee1","Type":"ContainerDied","Data":"4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96"}
Sep 19 11:00:19.500239 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.500229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz" event={"ID":"3d669c10-a611-425a-ab8f-82668cdefee1","Type":"ContainerDied","Data":"a69d01aa09119cba4b433772958ae3771c3561e06ad8a37733953c329874e3fd"}
Sep 19 11:00:19.501950 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.501928    2579 generic.go:356] "Generic (PLEG): container finished" podID="cc1d06f6-3de0-4bbb-9656-aedab1dd61ab" containerID="1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855" exitCode=0
Sep 19 11:00:19.502063 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.501957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj" event={"ID":"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab","Type":"ContainerDied","Data":"1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855"}
Sep 19 11:00:19.502063 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.501979    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"
Sep 19 11:00:19.502063 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.501993    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj" event={"ID":"cc1d06f6-3de0-4bbb-9656-aedab1dd61ab","Type":"ContainerDied","Data":"96183b9d02366f2ea64656904f45cf7d46c57eca110c83005de2074dd8e69624"}
Sep 19 11:00:19.509025 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.509008    2579 scope.go:117] "RemoveContainer" containerID="0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34"
Sep 19 11:00:19.509320 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:00:19.509296    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34\": container with ID starting with 0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34 not found: ID does not exist" containerID="0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34"
Sep 19 11:00:19.509370 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.509327    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34"} err="failed to get container status \"0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34\": rpc error: code = NotFound desc = could not find container \"0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34\": container with ID starting with 0c600ca7d59292ce7bcb558ddf701c0e4ac1f6845b09e5fba7c896b3d2281f34 not found: ID does not exist"
Sep 19 11:00:19.509370 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.509344    2579 scope.go:117] "RemoveContainer" containerID="4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96"
Sep 19 11:00:19.517624 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.517600    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"]
Sep 19 11:00:19.517927 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.517809    2579 scope.go:117] "RemoveContainer" containerID="4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96"
Sep 19 11:00:19.518152 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:00:19.518124    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96\": container with ID starting with 4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96 not found: ID does not exist" containerID="4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96"
Sep 19 11:00:19.518235 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.518160    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96"} err="failed to get container status \"4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96\": rpc error: code = NotFound desc = could not find container \"4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96\": container with ID starting with 4946e510be4b9caa4699eb7fc6eb2e8e48701b6ab4ea2d2fffa7412a2b4a1b96 not found: ID does not exist"
Sep 19 11:00:19.518235 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.518175    2579 scope.go:117] "RemoveContainer" containerID="1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855"
Sep 19 11:00:19.520602 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.520585    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695"]
Sep 19 11:00:19.526340 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.526325    2579 scope.go:117] "RemoveContainer" containerID="1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855"
Sep 19 11:00:19.526593 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:00:19.526575    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855\": container with ID starting with 1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855 not found: ID does not exist" containerID="1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855"
Sep 19 11:00:19.526655 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.526597    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855"} err="failed to get container status \"1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855\": rpc error: code = NotFound desc = could not find container \"1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855\": container with ID starting with 1d62e42a74215cf3ae3208d9f0ee73db388bcdae75b8c2afc8f9fb2390f70855 not found: ID does not exist"
Sep 19 11:00:19.533772 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.533754    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"]
Sep 19 11:00:19.539801 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.539781    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-9ac6b3-5f989f8b9d-v22fj"]
Sep 19 11:00:19.548625 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.548605    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"]
Sep 19 11:00:19.556732 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:19.556700    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz"]
Sep 19 11:00:21.202842 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:21.202807    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d669c10-a611-425a-ab8f-82668cdefee1" path="/var/lib/kubelet/pods/3d669c10-a611-425a-ab8f-82668cdefee1/volumes"
Sep 19 11:00:21.203299 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:21.203283    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1d06f6-3de0-4bbb-9656-aedab1dd61ab" path="/var/lib/kubelet/pods/cc1d06f6-3de0-4bbb-9656-aedab1dd61ab/volumes"
Sep 19 11:00:21.203617 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:21.203604    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d63cb64b-0099-435d-be84-16f09aaa9799" path="/var/lib/kubelet/pods/d63cb64b-0099-435d-be84-16f09aaa9799/volumes"
Sep 19 11:00:36.310689 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.310609    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"]
Sep 19 11:00:36.311164 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.310993    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2" podUID="ecbdbfee-0aeb-4f39-b904-45cc8ffa4155" containerName="maas-api" containerID="cri-o://ad0894b643b6ab58f9f927456473a19c644c8d4c66e956a86907b4d17339e2f0" gracePeriod=30
Sep 19 11:00:36.376743 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.376701    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"]
Sep 19 11:00:36.376989 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.376959    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk" podUID="52985b46-3303-4acb-9341-ce24da2f4c28" containerName="payload-processing" containerID="cri-o://c88dfd00183116780d8c5985ce149266b2745de32873d98d59754ddbfd558ae3" gracePeriod=30
Sep 19 11:00:36.600685 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.600649    2579 generic.go:356] "Generic (PLEG): container finished" podID="52985b46-3303-4acb-9341-ce24da2f4c28" containerID="c88dfd00183116780d8c5985ce149266b2745de32873d98d59754ddbfd558ae3" exitCode=0
Sep 19 11:00:36.600857 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.600765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk" event={"ID":"52985b46-3303-4acb-9341-ce24da2f4c28","Type":"ContainerDied","Data":"c88dfd00183116780d8c5985ce149266b2745de32873d98d59754ddbfd558ae3"}
Sep 19 11:00:36.603084 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.603054    2579 generic.go:356] "Generic (PLEG): container finished" podID="ecbdbfee-0aeb-4f39-b904-45cc8ffa4155" containerID="ad0894b643b6ab58f9f927456473a19c644c8d4c66e956a86907b4d17339e2f0" exitCode=0
Sep 19 11:00:36.603222 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.603120    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2" event={"ID":"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155","Type":"ContainerDied","Data":"ad0894b643b6ab58f9f927456473a19c644c8d4c66e956a86907b4d17339e2f0"}
Sep 19 11:00:36.632770 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.632749    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 11:00:36.653800 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.653773    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"
Sep 19 11:00:36.794887 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.794853    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52985b46-3303-4acb-9341-ce24da2f4c28-plugins-config-volume\") pod \"52985b46-3303-4acb-9341-ce24da2f4c28\" (UID: \"52985b46-3303-4acb-9341-ce24da2f4c28\") "
Sep 19 11:00:36.795085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.794897    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-maas-api-tls\") pod \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") "
Sep 19 11:00:36.795085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.794939    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-metrics-certs\") pod \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") "
Sep 19 11:00:36.795085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.794971    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq45n\" (UniqueName: \"kubernetes.io/projected/52985b46-3303-4acb-9341-ce24da2f4c28-kube-api-access-gq45n\") pod \"52985b46-3303-4acb-9341-ce24da2f4c28\" (UID: \"52985b46-3303-4acb-9341-ce24da2f4c28\") "
Sep 19 11:00:36.795085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.795066    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-openshift-service-ca\") pod \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") "
Sep 19 11:00:36.795319 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.795144    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fdsc\" (UniqueName: \"kubernetes.io/projected/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-kube-api-access-9fdsc\") pod \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\" (UID: \"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155\") "
Sep 19 11:00:36.795524 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.795327    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52985b46-3303-4acb-9341-ce24da2f4c28-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "52985b46-3303-4acb-9341-ce24da2f4c28" (UID: "52985b46-3303-4acb-9341-ce24da2f4c28"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:00:36.795616 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.795516    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ecbdbfee-0aeb-4f39-b904-45cc8ffa4155" (UID: "ecbdbfee-0aeb-4f39-b904-45cc8ffa4155"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:00:36.797149 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.797125    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52985b46-3303-4acb-9341-ce24da2f4c28-kube-api-access-gq45n" (OuterVolumeSpecName: "kube-api-access-gq45n") pod "52985b46-3303-4acb-9341-ce24da2f4c28" (UID: "52985b46-3303-4acb-9341-ce24da2f4c28"). InnerVolumeSpecName "kube-api-access-gq45n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:00:36.797359 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.797336    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-kube-api-access-9fdsc" (OuterVolumeSpecName: "kube-api-access-9fdsc") pod "ecbdbfee-0aeb-4f39-b904-45cc8ffa4155" (UID: "ecbdbfee-0aeb-4f39-b904-45cc8ffa4155"). InnerVolumeSpecName "kube-api-access-9fdsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:00:36.797582 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.797560    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ecbdbfee-0aeb-4f39-b904-45cc8ffa4155" (UID: "ecbdbfee-0aeb-4f39-b904-45cc8ffa4155"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:00:36.797686 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.797651    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ecbdbfee-0aeb-4f39-b904-45cc8ffa4155" (UID: "ecbdbfee-0aeb-4f39-b904-45cc8ffa4155"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:00:36.896472 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.896407    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fdsc\" (UniqueName: \"kubernetes.io/projected/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-kube-api-access-9fdsc\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:36.896472 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.896428    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52985b46-3303-4acb-9341-ce24da2f4c28-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:36.896472 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.896439    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-maas-api-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:36.896472 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.896449    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-metrics-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:36.896472 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.896457    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq45n\" (UniqueName: \"kubernetes.io/projected/52985b46-3303-4acb-9341-ce24da2f4c28-kube-api-access-gq45n\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:36.896472 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:36.896465    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155-openshift-service-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:00:37.609655 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:37.609630    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"
Sep 19 11:00:37.610178 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:37.609673    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2" event={"ID":"ecbdbfee-0aeb-4f39-b904-45cc8ffa4155","Type":"ContainerDied","Data":"554f597b077f4693336ef0ab301837b0586bc94095003466b1555b255628b85b"}
Sep 19 11:00:37.610178 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:37.609754    2579 scope.go:117] "RemoveContainer" containerID="ad0894b643b6ab58f9f927456473a19c644c8d4c66e956a86907b4d17339e2f0"
Sep 19 11:00:37.611174 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:37.611147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk" event={"ID":"52985b46-3303-4acb-9341-ce24da2f4c28","Type":"ContainerDied","Data":"d12df5da1956df9fceca314be2c9b468d339c6313a1fc7ff455c97a357f46fff"}
Sep 19 11:00:37.611233 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:37.611193    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"
Sep 19 11:00:37.619603 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:37.619581    2579 scope.go:117] "RemoveContainer" containerID="c88dfd00183116780d8c5985ce149266b2745de32873d98d59754ddbfd558ae3"
Sep 19 11:00:37.627913 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:37.627892    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"]
Sep 19 11:00:37.631406 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:37.631388    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk"]
Sep 19 11:00:37.641432 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:37.641413    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"]
Sep 19 11:00:37.645026 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:37.645006    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-266c89-7859bbc845-sflk2"]
Sep 19 11:00:39.203034 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:39.202994    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52985b46-3303-4acb-9341-ce24da2f4c28" path="/var/lib/kubelet/pods/52985b46-3303-4acb-9341-ce24da2f4c28/volumes"
Sep 19 11:00:39.203464 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:00:39.203401    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecbdbfee-0aeb-4f39-b904-45cc8ffa4155" path="/var/lib/kubelet/pods/ecbdbfee-0aeb-4f39-b904-45cc8ffa4155/volumes"
Sep 19 11:01:08.964247 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964207    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"]
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964575    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8e30635-b80c-4d33-bc75-050aa4672cdd" containerName="payload-pre-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964586    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8e30635-b80c-4d33-bc75-050aa4672cdd" containerName="payload-pre-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964600    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d669c10-a611-425a-ab8f-82668cdefee1" containerName="payload-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964605    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d669c10-a611-425a-ab8f-82668cdefee1" containerName="payload-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964614    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1d06f6-3de0-4bbb-9656-aedab1dd61ab" containerName="maas-api"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964619    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1d06f6-3de0-4bbb-9656-aedab1dd61ab" containerName="maas-api"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964627    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbdbfee-0aeb-4f39-b904-45cc8ffa4155" containerName="maas-api"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964632    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbdbfee-0aeb-4f39-b904-45cc8ffa4155" containerName="maas-api"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964644    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="067230f9-63b5-4078-8819-b7b1af98374f" containerName="payload-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964649    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="067230f9-63b5-4078-8819-b7b1af98374f" containerName="payload-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964658    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52985b46-3303-4acb-9341-ce24da2f4c28" containerName="payload-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964663    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="52985b46-3303-4acb-9341-ce24da2f4c28" containerName="payload-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964676    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6680deb5-2a03-4c8a-a28e-0a2da21e0d7b" containerName="cleanup"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964681    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6680deb5-2a03-4c8a-a28e-0a2da21e0d7b" containerName="cleanup"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964688    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerName="istio-proxy"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964693    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ca0aec-1576-4c32-8628-46dddac676e3" containerName="istio-proxy"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964699    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63cb64b-0099-435d-be84-16f09aaa9799" containerName="payload-pre-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964705    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63cb64b-0099-435d-be84-16f09aaa9799" containerName="payload-pre-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964788    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6680deb5-2a03-4c8a-a28e-0a2da21e0d7b" containerName="cleanup"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964796    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="52985b46-3303-4acb-9341-ce24da2f4c28" containerName="payload-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964803    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1d06f6-3de0-4bbb-9656-aedab1dd61ab" containerName="maas-api"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964810    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d63cb64b-0099-435d-be84-16f09aaa9799" containerName="payload-pre-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964815    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbdbfee-0aeb-4f39-b904-45cc8ffa4155" containerName="maas-api"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964820    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8e30635-b80c-4d33-bc75-050aa4672cdd" containerName="payload-pre-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964826    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="067230f9-63b5-4078-8819-b7b1af98374f" containerName="payload-processing"
Sep 19 11:01:08.964825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.964833    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d669c10-a611-425a-ab8f-82668cdefee1" containerName="payload-processing"
Sep 19 11:01:08.966770 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.966753    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:08.969238 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.969217    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-bd3aad-openshift-default-dockercfg-dxff7\""
Sep 19 11:01:08.978743 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:08.978703    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"]
Sep 19 11:01:09.049399 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.049370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-credential-socket\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.049517 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.049409    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-workload-certs\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.049596 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.049507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-istio-envoy\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.049596 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.049582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373408d9-48a3-4520-8d0b-98ba486ff202-istio-token\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.049707 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.049613    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzskk\" (UniqueName: \"kubernetes.io/projected/373408d9-48a3-4520-8d0b-98ba486ff202-kube-api-access-wzskk\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.049707 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.049642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-istio-data\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.049707 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.049683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-workload-socket\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.049882 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.049711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373408d9-48a3-4520-8d0b-98ba486ff202-istio-podinfo\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.049882 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.049757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373408d9-48a3-4520-8d0b-98ba486ff202-istiod-ca-cert\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.150809 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.150777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-istio-envoy\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.150954 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.150833    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373408d9-48a3-4520-8d0b-98ba486ff202-istio-token\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.150954 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.150864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzskk\" (UniqueName: \"kubernetes.io/projected/373408d9-48a3-4520-8d0b-98ba486ff202-kube-api-access-wzskk\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.150954 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.150889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-istio-data\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.150954 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.150926    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-workload-socket\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.150954 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.150952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373408d9-48a3-4520-8d0b-98ba486ff202-istio-podinfo\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.151214 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.150978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373408d9-48a3-4520-8d0b-98ba486ff202-istiod-ca-cert\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.151214 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.151018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-credential-socket\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.151214 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.151052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-workload-certs\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.151381 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.151302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-istio-data\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.151597 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.151575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-workload-socket\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.151696 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.151642    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-workload-certs\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.151696 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.151682    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-credential-socket\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.151820 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.151743    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373408d9-48a3-4520-8d0b-98ba486ff202-istiod-ca-cert\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.153080 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.153062    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-istio-envoy\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.153362 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.153344    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373408d9-48a3-4520-8d0b-98ba486ff202-istio-podinfo\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.157716 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.157693    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373408d9-48a3-4520-8d0b-98ba486ff202-istio-token\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.157991 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.157973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzskk\" (UniqueName: \"kubernetes.io/projected/373408d9-48a3-4520-8d0b-98ba486ff202-kube-api-access-wzskk\") pod \"e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") " pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.278994 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.278935    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:09.554703 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.554674    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"]
Sep 19 11:01:09.556142 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:01:09.556118    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373408d9_48a3_4520_8d0b_98ba486ff202.slice/crio-b2bfef3992af4f979c8280189068c721230665d8870d2d4b0b8bd04bca8cd64a WatchSource:0}: Error finding container b2bfef3992af4f979c8280189068c721230665d8870d2d4b0b8bd04bca8cd64a: Status 404 returned error can't find the container with id b2bfef3992af4f979c8280189068c721230665d8870d2d4b0b8bd04bca8cd64a
Sep 19 11:01:09.558163 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.558132    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:01:09.558236 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.558203    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:01:09.558236 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.558230    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:01:09.778765 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.778700    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" event={"ID":"373408d9-48a3-4520-8d0b-98ba486ff202","Type":"ContainerStarted","Data":"500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116"}
Sep 19 11:01:09.778984 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.778794    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" event={"ID":"373408d9-48a3-4520-8d0b-98ba486ff202","Type":"ContainerStarted","Data":"b2bfef3992af4f979c8280189068c721230665d8870d2d4b0b8bd04bca8cd64a"}
Sep 19 11:01:09.796825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:09.796775    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" podStartSLOduration=1.796755395 podStartE2EDuration="1.796755395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:01:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:01:09.794844092 +0000 UTC m=+1592.694033987" watchObservedRunningTime="2026-09-19 11:01:09.796755395 +0000 UTC m=+1592.695945286"
Sep 19 11:01:10.279587 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:10.279556    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:10.284210 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:10.284184    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:10.784515 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:10.784485    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:10.785224 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:10.785206    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:12.984568 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:12.984533    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"]
Sep 19 11:01:12.988093 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:12.988069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:12.990176 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:12.990156    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-bd3aad-serving-cert\""
Sep 19 11:01:12.996463 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:12.996438    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"]
Sep 19 11:01:13.085545 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.085518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.085662 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.085553    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.085662 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.085638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-metrics-certs\") pod \"maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.085792 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.085772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqhn5\" (UniqueName: \"kubernetes.io/projected/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-kube-api-access-hqhn5\") pod \"maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.186229 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.186203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqhn5\" (UniqueName: \"kubernetes.io/projected/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-kube-api-access-hqhn5\") pod \"maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.186368 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.186238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.186368 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.186261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.186368 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.186326    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-metrics-certs\") pod \"maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.186917 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.186890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.188742 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.188707    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-metrics-certs\") pod \"maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.188840 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.188794    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.193965 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.193947    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqhn5\" (UniqueName: \"kubernetes.io/projected/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-kube-api-access-hqhn5\") pod \"maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.304171 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.304151    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:13.569398 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.569323    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"]
Sep 19 11:01:13.572285 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.572263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"
Sep 19 11:01:13.574492 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.574459    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-bd3aad-dockercfg-mmzq8\""
Sep 19 11:01:13.574593 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.574491    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-bd3aad\""
Sep 19 11:01:13.583609 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.583529    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"]
Sep 19 11:01:13.586606 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.586577    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"]
Sep 19 11:01:13.588625 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:01:13.588592    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e9c116c_f5f2_43d6_acdb_9ebbdebc8ca9.slice/crio-92d23c64b6a7547e1f786601e88e35b3fdc47d978291a9bb022713e6a7f79ff0 WatchSource:0}: Error finding container 92d23c64b6a7547e1f786601e88e35b3fdc47d978291a9bb022713e6a7f79ff0: Status 404 returned error can't find the container with id 92d23c64b6a7547e1f786601e88e35b3fdc47d978291a9bb022713e6a7f79ff0
Sep 19 11:01:13.603775 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.603751    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"]
Sep 19 11:01:13.606292 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.606273    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"
Sep 19 11:01:13.615892 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.615873    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"]
Sep 19 11:01:13.691050 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.691014    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kzjz\" (UniqueName: \"kubernetes.io/projected/91f7b3f0-b724-4f6c-b893-bb6e29890479-kube-api-access-6kzjz\") pod \"payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2\" (UID: \"91f7b3f0-b724-4f6c-b893-bb6e29890479\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"
Sep 19 11:01:13.691213 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.691084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59405ed0-f5f8-4efe-9dba-cff906544748-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg\" (UID: \"59405ed0-f5f8-4efe-9dba-cff906544748\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"
Sep 19 11:01:13.691213 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.691135    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91f7b3f0-b724-4f6c-b893-bb6e29890479-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2\" (UID: \"91f7b3f0-b724-4f6c-b893-bb6e29890479\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"
Sep 19 11:01:13.691339 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.691264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfxml\" (UniqueName: \"kubernetes.io/projected/59405ed0-f5f8-4efe-9dba-cff906544748-kube-api-access-bfxml\") pod \"payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg\" (UID: \"59405ed0-f5f8-4efe-9dba-cff906544748\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"
Sep 19 11:01:13.792208 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.792176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kzjz\" (UniqueName: \"kubernetes.io/projected/91f7b3f0-b724-4f6c-b893-bb6e29890479-kube-api-access-6kzjz\") pod \"payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2\" (UID: \"91f7b3f0-b724-4f6c-b893-bb6e29890479\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"
Sep 19 11:01:13.792371 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.792220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59405ed0-f5f8-4efe-9dba-cff906544748-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg\" (UID: \"59405ed0-f5f8-4efe-9dba-cff906544748\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"
Sep 19 11:01:13.792371 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.792261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91f7b3f0-b724-4f6c-b893-bb6e29890479-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2\" (UID: \"91f7b3f0-b724-4f6c-b893-bb6e29890479\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"
Sep 19 11:01:13.792371 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.792311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfxml\" (UniqueName: \"kubernetes.io/projected/59405ed0-f5f8-4efe-9dba-cff906544748-kube-api-access-bfxml\") pod \"payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg\" (UID: \"59405ed0-f5f8-4efe-9dba-cff906544748\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"
Sep 19 11:01:13.793077 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.793051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59405ed0-f5f8-4efe-9dba-cff906544748-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg\" (UID: \"59405ed0-f5f8-4efe-9dba-cff906544748\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"
Sep 19 11:01:13.793077 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.793064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91f7b3f0-b724-4f6c-b893-bb6e29890479-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2\" (UID: \"91f7b3f0-b724-4f6c-b893-bb6e29890479\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"
Sep 19 11:01:13.799331 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.799306    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kzjz\" (UniqueName: \"kubernetes.io/projected/91f7b3f0-b724-4f6c-b893-bb6e29890479-kube-api-access-6kzjz\") pod \"payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2\" (UID: \"91f7b3f0-b724-4f6c-b893-bb6e29890479\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"
Sep 19 11:01:13.799599 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.799580    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfxml\" (UniqueName: \"kubernetes.io/projected/59405ed0-f5f8-4efe-9dba-cff906544748-kube-api-access-bfxml\") pod \"payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg\" (UID: \"59405ed0-f5f8-4efe-9dba-cff906544748\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"
Sep 19 11:01:13.800898 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.800875    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch" event={"ID":"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9","Type":"ContainerStarted","Data":"92d23c64b6a7547e1f786601e88e35b3fdc47d978291a9bb022713e6a7f79ff0"}
Sep 19 11:01:13.885502 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.885446    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"
Sep 19 11:01:13.917790 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:13.917759    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"
Sep 19 11:01:14.155457 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.155284    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"]
Sep 19 11:01:14.158079 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:01:14.158054    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f7b3f0_b724_4f6c_b893_bb6e29890479.slice/crio-4da4cc75e7e4b1e22b16c8a1afa1144372137d9a51b70fb58becb0c8aaf7ee30 WatchSource:0}: Error finding container 4da4cc75e7e4b1e22b16c8a1afa1144372137d9a51b70fb58becb0c8aaf7ee30: Status 404 returned error can't find the container with id 4da4cc75e7e4b1e22b16c8a1afa1144372137d9a51b70fb58becb0c8aaf7ee30
Sep 19 11:01:14.189428 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.189401    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"]
Sep 19 11:01:14.192150 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:01:14.192103    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59405ed0_f5f8_4efe_9dba_cff906544748.slice/crio-407e448d9f5b2d1350c232f43771cb51460751497548be60ce94dd948f18f779 WatchSource:0}: Error finding container 407e448d9f5b2d1350c232f43771cb51460751497548be60ce94dd948f18f779: Status 404 returned error can't find the container with id 407e448d9f5b2d1350c232f43771cb51460751497548be60ce94dd948f18f779
Sep 19 11:01:14.808642 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.808602    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch" event={"ID":"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9","Type":"ContainerStarted","Data":"f5f18a870cc6cac39b17e7b47b4bd1047d5b77c4d034bf69720c884174798626"}
Sep 19 11:01:14.808866 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.808758    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:14.810304 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.810275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2" event={"ID":"91f7b3f0-b724-4f6c-b893-bb6e29890479","Type":"ContainerStarted","Data":"b4d9992f797ae80d2597411da4524b0c3bd4698729a483750a23e1bd2a89cdbb"}
Sep 19 11:01:14.810444 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.810326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2" event={"ID":"91f7b3f0-b724-4f6c-b893-bb6e29890479","Type":"ContainerStarted","Data":"4da4cc75e7e4b1e22b16c8a1afa1144372137d9a51b70fb58becb0c8aaf7ee30"}
Sep 19 11:01:14.810444 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.810393    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"
Sep 19 11:01:14.811855 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.811828    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg" event={"ID":"59405ed0-f5f8-4efe-9dba-cff906544748","Type":"ContainerStarted","Data":"60904bd9bedbf6a1814708c2a63fa982b692fd9dcb3ac2cb3f3e429db984bc5b"}
Sep 19 11:01:14.811947 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.811871    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg" event={"ID":"59405ed0-f5f8-4efe-9dba-cff906544748","Type":"ContainerStarted","Data":"407e448d9f5b2d1350c232f43771cb51460751497548be60ce94dd948f18f779"}
Sep 19 11:01:14.811947 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.811911    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"
Sep 19 11:01:14.826294 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.826252    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch" podStartSLOduration=2.40291004 podStartE2EDuration="2.826239697s" totalImagesPullingTime="423.329657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:01:14.823975573 +0000 UTC m=+1597.723165467" watchObservedRunningTime="2026-09-19 11:01:14.826239697 +0000 UTC m=+1597.725429596"
Sep 19 11:01:14.839405 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.839366    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2" podStartSLOduration=1.8393550109999999 podStartE2EDuration="1.839355011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:01:14.83753372 +0000 UTC m=+1597.736723614" watchObservedRunningTime="2026-09-19 11:01:14.839355011 +0000 UTC m=+1597.738544948"
Sep 19 11:01:14.852331 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:14.852286    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg" podStartSLOduration=1.85227623 podStartE2EDuration="1.85227623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:01:14.850743547 +0000 UTC m=+1597.749933431" watchObservedRunningTime="2026-09-19 11:01:14.85227623 +0000 UTC m=+1597.751466122"
Sep 19 11:01:20.827751 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:20.824824    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:01:25.819670 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:25.819639    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"
Sep 19 11:01:25.820070 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:25.819708    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"
Sep 19 11:01:26.733015 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:26.732981    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": read tcp 10.133.0.2:37844->10.133.0.77:15021: read: connection reset by peer" start-of-body=
Sep 19 11:01:26.733191 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:26.733043    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": read tcp 10.133.0.2:37844->10.133.0.77:15021: read: connection reset by peer"
Sep 19 11:01:26.879119 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:26.879089    2579 generic.go:356] "Generic (PLEG): container finished" podID="373408d9-48a3-4520-8d0b-98ba486ff202" containerID="500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116" exitCode=0
Sep 19 11:01:26.879514 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:26.879165    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" event={"ID":"373408d9-48a3-4520-8d0b-98ba486ff202","Type":"ContainerDied","Data":"500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116"}
Sep 19 11:01:26.879673 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:26.879654    2579 scope.go:117] "RemoveContainer" containerID="500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116"
Sep 19 11:01:26.880671 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:26.880644    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:01:26.880784 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:26.880718    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:01:26.880784 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:26.880768    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:01:27.886385 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:27.886344    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" event={"ID":"373408d9-48a3-4520-8d0b-98ba486ff202","Type":"ContainerStarted","Data":"4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01"}
Sep 19 11:01:28.279676 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:28.279568    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:28.279902 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:28.279852    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 19 11:01:28.279990 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:28.279908    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 19 11:01:29.280204 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:29.280170    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 19 11:01:29.280590 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:29.280225    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 19 11:01:30.279507 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:30.279471    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 19 11:01:30.279686 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:30.279522    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 19 11:01:31.279608 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:31.279574    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 19 11:01:31.280028 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:31.279627    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 19 11:01:32.280057 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:32.280022    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 19 11:01:32.280463 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:32.280083    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 19 11:01:33.282848 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:33.282816    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:33.283315 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:33.283267    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:33.283921 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:33.283899    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:01:37.569899 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.569866    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"]
Sep 19 11:01:37.572620 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.572600    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.574869 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.574845    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-f210d9-openshift-default-dockercfg-9vtw6\""
Sep 19 11:01:37.585336 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.585314    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"]
Sep 19 11:01:37.708068 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.708037    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-workload-socket\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.708232 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.708078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dds7s\" (UniqueName: \"kubernetes.io/projected/0fd7a121-3c56-4195-824b-5cac0ce7fcea-kube-api-access-dds7s\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.708232 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.708169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-envoy\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.708232 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.708213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-credential-socket\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.708346 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.708238    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-podinfo\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.708346 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.708309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-token\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.708411 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.708346    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istiod-ca-cert\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.708411 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.708368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-workload-certs\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.708479 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.708449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-data\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.809329 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.809288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-workload-socket\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.809976 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.809946    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-workload-socket\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.809976 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.809959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dds7s\" (UniqueName: \"kubernetes.io/projected/0fd7a121-3c56-4195-824b-5cac0ce7fcea-kube-api-access-dds7s\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.810175 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.810022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-envoy\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.810175 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.810052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-credential-socket\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.810175 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.810083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-podinfo\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.810175 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.810114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-token\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.810175 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.810151    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istiod-ca-cert\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.810523 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.810285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-workload-certs\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.810523 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.810371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-data\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.810523 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.810469    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-credential-socket\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.810702 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.810678    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-workload-certs\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.810896 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.810875    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-data\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.811080 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.811058    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istiod-ca-cert\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.812708 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.812688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-envoy\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.812778 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.812742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-podinfo\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.818082 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.818060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-token\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.818531 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.818509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dds7s\" (UniqueName: \"kubernetes.io/projected/0fd7a121-3c56-4195-824b-5cac0ce7fcea-kube-api-access-dds7s\") pod \"e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") " pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:37.884173 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:37.884121    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:38.158083 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:38.158058    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"]
Sep 19 11:01:38.159842 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:01:38.159809    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd7a121_3c56_4195_824b_5cac0ce7fcea.slice/crio-3789f4e63fd9b4724c547404dcc238a7c2280abcee9f15628524b566abc95814 WatchSource:0}: Error finding container 3789f4e63fd9b4724c547404dcc238a7c2280abcee9f15628524b566abc95814: Status 404 returned error can't find the container with id 3789f4e63fd9b4724c547404dcc238a7c2280abcee9f15628524b566abc95814
Sep 19 11:01:38.162154 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:38.162120    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:01:38.162260 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:38.162201    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:01:38.162260 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:38.162248    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:01:38.961342 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:38.961302    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" event={"ID":"0fd7a121-3c56-4195-824b-5cac0ce7fcea","Type":"ContainerStarted","Data":"952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42"}
Sep 19 11:01:38.961700 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:38.961352    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" event={"ID":"0fd7a121-3c56-4195-824b-5cac0ce7fcea","Type":"ContainerStarted","Data":"3789f4e63fd9b4724c547404dcc238a7c2280abcee9f15628524b566abc95814"}
Sep 19 11:01:38.980269 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:38.980220    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" podStartSLOduration=1.980205914 podStartE2EDuration="1.980205914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:01:38.977653904 +0000 UTC m=+1621.876843797" watchObservedRunningTime="2026-09-19 11:01:38.980205914 +0000 UTC m=+1621.879395806"
Sep 19 11:01:39.442144 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:39.442114    2579 scope.go:117] "RemoveContainer" containerID="e2954b7f2e0c1808e9fef247ff783c5f799cf572200e7c6bb9c246960e00b6be"
Sep 19 11:01:39.885332 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:39.885301    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:39.891634 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:39.891608    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:39.967368 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:39.967343    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:39.968153 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:39.968131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:56.008863 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:56.008821    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 11:01:56.009346 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:56.008890    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 11:01:58.071980 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:58.071947    2579 generic.go:356] "Generic (PLEG): container finished" podID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerID="952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42" exitCode=0
Sep 19 11:01:58.072400 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:58.072019    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" event={"ID":"0fd7a121-3c56-4195-824b-5cac0ce7fcea","Type":"ContainerDied","Data":"952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42"}
Sep 19 11:01:58.072400 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:58.072372    2579 scope.go:117] "RemoveContainer" containerID="952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42"
Sep 19 11:01:58.073404 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:58.073381    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:01:58.073456 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:58.073444    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:01:58.073496 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:58.073477    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:01:59.079082 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:59.079050    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" event={"ID":"0fd7a121-3c56-4195-824b-5cac0ce7fcea","Type":"ContainerStarted","Data":"2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699"}
Sep 19 11:01:59.884553 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:59.884519    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:01:59.884795 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:59.884771    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 19 11:01:59.884903 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:01:59.884829    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 19 11:02:00.884572 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:00.884537    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 19 11:02:00.884982 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:00.884592    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 19 11:02:01.884555 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:01.884518    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 19 11:02:01.884749 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:01.884577    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 19 11:02:02.885289 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:02.885251    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 19 11:02:02.885703 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:02.885309    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 19 11:02:03.884430 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:03.884387    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 19 11:02:03.884609 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:03.884454    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 19 11:02:04.888863 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:04.888827    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:02:04.889244 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:04.889178    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:02:04.889915 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:04.889890    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:02:10.786319 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:10.786292    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-7hp29_5f1164e8-3969-4951-ad45-598c957c21db/payload-processing/0.log"
Sep 19 11:02:10.907311 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:10.907283    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-7hp29_5f1164e8-3969-4951-ad45-598c957c21db/payload-processing/0.log"
Sep 19 11:02:38.856784 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:38.856750    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg_59405ed0-f5f8-4efe-9dba-cff906544748/payload-processing/0.log"
Sep 19 11:02:38.974958 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:38.974932    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-7hp29_5f1164e8-3969-4951-ad45-598c957c21db/payload-processing/0.log"
Sep 19 11:02:39.095555 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.095529    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-7hp29_5f1164e8-3969-4951-ad45-598c957c21db/payload-processing/0.log"
Sep 19 11:02:39.747540 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.747504    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"]
Sep 19 11:02:39.750752 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.750715    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.752931 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.752906    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-953b43-openshift-default-dockercfg-mlpvr\""
Sep 19 11:02:39.758591 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.758570    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"]
Sep 19 11:02:39.844743 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.844697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-data\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.845002 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.844979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-workload-certs\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.845181 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.845164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istiod-ca-cert\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.845323 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.845305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tngzv\" (UniqueName: \"kubernetes.io/projected/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-kube-api-access-tngzv\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.845450 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.845435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-credential-socket\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.845570 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.845554    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-podinfo\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.845687 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.845671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-token\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.845818 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.845803    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-workload-socket\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.846021 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.846005    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-envoy\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.947202 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.947171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-data\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.947637 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.947215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-workload-certs\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.947637 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.947280    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istiod-ca-cert\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.947637 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.947320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tngzv\" (UniqueName: \"kubernetes.io/projected/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-kube-api-access-tngzv\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.947637 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.947358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-credential-socket\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.947637 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.947387    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-podinfo\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.947637 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.947424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-token\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.947637 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.947451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-workload-socket\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.947637 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.947523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-envoy\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.947637 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.947616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-data\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.948158 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.947666    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-workload-certs\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.948158 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.948088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istiod-ca-cert\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.948158 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.948104    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-credential-socket\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.948158 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.948146    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-workload-socket\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.949798 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.949776    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-envoy\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.949798 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.949788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-podinfo\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.963309 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.963281    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-token\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:39.963609 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:39.963589    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tngzv\" (UniqueName: \"kubernetes.io/projected/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-kube-api-access-tngzv\") pod \"e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") " pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:40.066651 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:40.066620    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:40.336061 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:40.336032    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"]
Sep 19 11:02:40.337898 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:02:40.337872    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5596b3_a92d_4600_ae30_2ff41d4d0d89.slice/crio-36ed419453a39d84ab247939f8d302b8637e173e949f7eed20a8460ed499adda WatchSource:0}: Error finding container 36ed419453a39d84ab247939f8d302b8637e173e949f7eed20a8460ed499adda: Status 404 returned error can't find the container with id 36ed419453a39d84ab247939f8d302b8637e173e949f7eed20a8460ed499adda
Sep 19 11:02:40.340041 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:40.340011    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:02:40.340118 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:40.340079    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:02:40.340118 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:40.340107    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:02:41.315508 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:41.315469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" event={"ID":"6b5596b3-a92d-4600-ae30-2ff41d4d0d89","Type":"ContainerStarted","Data":"0c241d37660b8cf2ec6c5fab93e54eff1297e38ad53d04c8a72b60b1db615201"}
Sep 19 11:02:41.315949 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:41.315527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" event={"ID":"6b5596b3-a92d-4600-ae30-2ff41d4d0d89","Type":"ContainerStarted","Data":"36ed419453a39d84ab247939f8d302b8637e173e949f7eed20a8460ed499adda"}
Sep 19 11:02:41.336045 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:41.335999    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" podStartSLOduration=2.335982859 podStartE2EDuration="2.335982859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:02:41.334337323 +0000 UTC m=+1684.233527227" watchObservedRunningTime="2026-09-19 11:02:41.335982859 +0000 UTC m=+1684.235172781"
Sep 19 11:02:42.067647 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:42.067616    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:42.073498 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:42.073472    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:42.321080 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:42.321002    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:42.321957 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:42.321939    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:02:46.556347 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:46.556314    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"]
Sep 19 11:02:46.558868 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:46.558849    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"
Sep 19 11:02:46.560948 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:46.560930    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-953b43-dockercfg-shtdj\""
Sep 19 11:02:46.561026 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:46.560953    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-953b43\""
Sep 19 11:02:46.568946 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:46.568922    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"]
Sep 19 11:02:46.611744 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:46.611680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns6fc\" (UniqueName: \"kubernetes.io/projected/39790280-5957-4a60-a939-e01403108bd3-kube-api-access-ns6fc\") pod \"payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2\" (UID: \"39790280-5957-4a60-a939-e01403108bd3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"
Sep 19 11:02:46.611924 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:46.611811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39790280-5957-4a60-a939-e01403108bd3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2\" (UID: \"39790280-5957-4a60-a939-e01403108bd3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"
Sep 19 11:02:46.712927 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:46.712892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39790280-5957-4a60-a939-e01403108bd3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2\" (UID: \"39790280-5957-4a60-a939-e01403108bd3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"
Sep 19 11:02:46.713090 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:46.713018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns6fc\" (UniqueName: \"kubernetes.io/projected/39790280-5957-4a60-a939-e01403108bd3-kube-api-access-ns6fc\") pod \"payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2\" (UID: \"39790280-5957-4a60-a939-e01403108bd3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"
Sep 19 11:02:46.713645 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:46.713625    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39790280-5957-4a60-a939-e01403108bd3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2\" (UID: \"39790280-5957-4a60-a939-e01403108bd3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"
Sep 19 11:02:46.720439 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:46.720417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns6fc\" (UniqueName: \"kubernetes.io/projected/39790280-5957-4a60-a939-e01403108bd3-kube-api-access-ns6fc\") pod \"payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2\" (UID: \"39790280-5957-4a60-a939-e01403108bd3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"
Sep 19 11:02:46.871030 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:46.870966    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"
Sep 19 11:02:47.144575 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:47.144547    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"]
Sep 19 11:02:47.146193 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:02:47.146164    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39790280_5957_4a60_a939_e01403108bd3.slice/crio-92af41cb129d9cf1aa30fe32d15bc704bc18d29c3a91c0acf1b2b729cd4f4654 WatchSource:0}: Error finding container 92af41cb129d9cf1aa30fe32d15bc704bc18d29c3a91c0acf1b2b729cd4f4654: Status 404 returned error can't find the container with id 92af41cb129d9cf1aa30fe32d15bc704bc18d29c3a91c0acf1b2b729cd4f4654
Sep 19 11:02:47.352522 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:47.352424    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2" event={"ID":"39790280-5957-4a60-a939-e01403108bd3","Type":"ContainerStarted","Data":"98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4"}
Sep 19 11:02:47.352522 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:47.352498    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2" event={"ID":"39790280-5957-4a60-a939-e01403108bd3","Type":"ContainerStarted","Data":"92af41cb129d9cf1aa30fe32d15bc704bc18d29c3a91c0acf1b2b729cd4f4654"}
Sep 19 11:02:47.352712 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:47.352534    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"
Sep 19 11:02:47.368281 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:47.368236    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2" podStartSLOduration=1.368218184 podStartE2EDuration="1.368218184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:02:47.366099081 +0000 UTC m=+1690.265289000" watchObservedRunningTime="2026-09-19 11:02:47.368218184 +0000 UTC m=+1690.267408079"
Sep 19 11:02:58.360409 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:02:58.360330    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"
Sep 19 11:03:03.452942 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:03.452908    2579 generic.go:356] "Generic (PLEG): container finished" podID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerID="0c241d37660b8cf2ec6c5fab93e54eff1297e38ad53d04c8a72b60b1db615201" exitCode=0
Sep 19 11:03:03.453420 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:03.452981    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" event={"ID":"6b5596b3-a92d-4600-ae30-2ff41d4d0d89","Type":"ContainerDied","Data":"0c241d37660b8cf2ec6c5fab93e54eff1297e38ad53d04c8a72b60b1db615201"}
Sep 19 11:03:03.453420 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:03.453355    2579 scope.go:117] "RemoveContainer" containerID="0c241d37660b8cf2ec6c5fab93e54eff1297e38ad53d04c8a72b60b1db615201"
Sep 19 11:03:03.454548 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:03.454519    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:03:03.454616 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:03.454592    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:03:03.454654 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:03.454625    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 19 11:03:04.460928 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:04.460893    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" event={"ID":"6b5596b3-a92d-4600-ae30-2ff41d4d0d89","Type":"ContainerStarted","Data":"1940e63b1312050b61159d8f6a8b00823a22a1715a7492ff0a2e78f5c8273f68"}
Sep 19 11:03:05.067045 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:05.067009    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:03:05.067324 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:05.067301    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 19 11:03:05.067392 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:05.067368    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 19 11:03:06.067803 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:06.067770    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 19 11:03:06.068272 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:06.067839    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 19 11:03:07.067261 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:07.067217    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 19 11:03:07.067460 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:07.067271    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 19 11:03:08.067152 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:08.067116    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 19 11:03:08.067536 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:08.067180    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 19 11:03:09.067691 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:09.067652    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 19 11:03:09.068105 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:09.067743    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 19 11:03:10.071372 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:10.071334    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:03:10.071768 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:10.071677    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:03:10.072291 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:10.072271    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:03:15.012232 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.012195    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"]
Sep 19 11:03:15.012883 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.012447    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2" podUID="39790280-5957-4a60-a939-e01403108bd3" containerName="payload-processing" containerID="cri-o://98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4" gracePeriod=30
Sep 19 11:03:15.276908 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.276848    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"
Sep 19 11:03:15.373304 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.373277    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39790280-5957-4a60-a939-e01403108bd3-plugins-config-volume\") pod \"39790280-5957-4a60-a939-e01403108bd3\" (UID: \"39790280-5957-4a60-a939-e01403108bd3\") "
Sep 19 11:03:15.373464 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.373319    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns6fc\" (UniqueName: \"kubernetes.io/projected/39790280-5957-4a60-a939-e01403108bd3-kube-api-access-ns6fc\") pod \"39790280-5957-4a60-a939-e01403108bd3\" (UID: \"39790280-5957-4a60-a939-e01403108bd3\") "
Sep 19 11:03:15.373603 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.373580    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39790280-5957-4a60-a939-e01403108bd3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "39790280-5957-4a60-a939-e01403108bd3" (UID: "39790280-5957-4a60-a939-e01403108bd3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:03:15.375448 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.375420    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39790280-5957-4a60-a939-e01403108bd3-kube-api-access-ns6fc" (OuterVolumeSpecName: "kube-api-access-ns6fc") pod "39790280-5957-4a60-a939-e01403108bd3" (UID: "39790280-5957-4a60-a939-e01403108bd3"). InnerVolumeSpecName "kube-api-access-ns6fc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:03:15.474834 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.474798    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39790280-5957-4a60-a939-e01403108bd3-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:15.474834 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.474832    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns6fc\" (UniqueName: \"kubernetes.io/projected/39790280-5957-4a60-a939-e01403108bd3-kube-api-access-ns6fc\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:15.527529 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.527455    2579 generic.go:356] "Generic (PLEG): container finished" podID="39790280-5957-4a60-a939-e01403108bd3" containerID="98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4" exitCode=0
Sep 19 11:03:15.527529 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.527517    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"
Sep 19 11:03:15.527712 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.527547    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2" event={"ID":"39790280-5957-4a60-a939-e01403108bd3","Type":"ContainerDied","Data":"98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4"}
Sep 19 11:03:15.527712 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.527637    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2" event={"ID":"39790280-5957-4a60-a939-e01403108bd3","Type":"ContainerDied","Data":"92af41cb129d9cf1aa30fe32d15bc704bc18d29c3a91c0acf1b2b729cd4f4654"}
Sep 19 11:03:15.527712 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.527669    2579 scope.go:117] "RemoveContainer" containerID="98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4"
Sep 19 11:03:15.537450 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.537433    2579 scope.go:117] "RemoveContainer" containerID="98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4"
Sep 19 11:03:15.537705 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:03:15.537686    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4\": container with ID starting with 98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4 not found: ID does not exist" containerID="98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4"
Sep 19 11:03:15.537788 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.537717    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4"} err="failed to get container status \"98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4\": rpc error: code = NotFound desc = could not find container \"98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4\": container with ID starting with 98ffb895a2f803459ea82c459a171dcbd686aa543ec1522e82ba49e02a0aabe4 not found: ID does not exist"
Sep 19 11:03:15.550605 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.550574    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"]
Sep 19 11:03:15.554460 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:15.554439    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2"]
Sep 19 11:03:17.203504 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:17.203422    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39790280-5957-4a60-a939-e01403108bd3" path="/var/lib/kubelet/pods/39790280-5957-4a60-a939-e01403108bd3/volumes"
Sep 19 11:03:21.469504 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:21.469469    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"]
Sep 19 11:03:21.469966 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:21.469690    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy" containerID="cri-o://1940e63b1312050b61159d8f6a8b00823a22a1715a7492ff0a2e78f5c8273f68" gracePeriod=30
Sep 19 11:03:25.074035 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:25.073998    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 19 11:03:25.074384 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:25.074065    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 11:03:26.600810 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.600783    2579 generic.go:356] "Generic (PLEG): container finished" podID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerID="1940e63b1312050b61159d8f6a8b00823a22a1715a7492ff0a2e78f5c8273f68" exitCode=0
Sep 19 11:03:26.601138 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.600868    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" event={"ID":"6b5596b3-a92d-4600-ae30-2ff41d4d0d89","Type":"ContainerDied","Data":"1940e63b1312050b61159d8f6a8b00823a22a1715a7492ff0a2e78f5c8273f68"}
Sep 19 11:03:26.601138 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.600962    2579 scope.go:117] "RemoveContainer" containerID="0c241d37660b8cf2ec6c5fab93e54eff1297e38ad53d04c8a72b60b1db615201"
Sep 19 11:03:26.731665 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.731643    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:03:26.870386 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.870359    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-workload-certs\") pod \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") "
Sep 19 11:03:26.870565 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.870391    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-token\") pod \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") "
Sep 19 11:03:26.870565 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.870424    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-data\") pod \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") "
Sep 19 11:03:26.870565 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.870450    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-podinfo\") pod \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") "
Sep 19 11:03:26.870565 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.870472    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-envoy\") pod \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") "
Sep 19 11:03:26.870565 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.870511    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-workload-socket\") pod \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") "
Sep 19 11:03:26.870886 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.870570    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-credential-socket\") pod \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") "
Sep 19 11:03:26.870886 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.870608    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istiod-ca-cert\") pod \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") "
Sep 19 11:03:26.870886 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.870680    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tngzv\" (UniqueName: \"kubernetes.io/projected/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-kube-api-access-tngzv\") pod \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\" (UID: \"6b5596b3-a92d-4600-ae30-2ff41d4d0d89\") "
Sep 19 11:03:26.870886 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.870681    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b5596b3-a92d-4600-ae30-2ff41d4d0d89" (UID: "6b5596b3-a92d-4600-ae30-2ff41d4d0d89"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:26.871107 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.870903    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b5596b3-a92d-4600-ae30-2ff41d4d0d89" (UID: "6b5596b3-a92d-4600-ae30-2ff41d4d0d89"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:26.871107 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.870976    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b5596b3-a92d-4600-ae30-2ff41d4d0d89" (UID: "6b5596b3-a92d-4600-ae30-2ff41d4d0d89"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:26.871107 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.871076    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b5596b3-a92d-4600-ae30-2ff41d4d0d89" (UID: "6b5596b3-a92d-4600-ae30-2ff41d4d0d89"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:03:26.871258 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.871136    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b5596b3-a92d-4600-ae30-2ff41d4d0d89" (UID: "6b5596b3-a92d-4600-ae30-2ff41d4d0d89"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:26.871258 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.871184    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-workload-socket\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:26.871258 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.871206    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-credential-socket\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:26.871258 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.871223    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-workload-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:26.872686 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.872664    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b5596b3-a92d-4600-ae30-2ff41d4d0d89" (UID: "6b5596b3-a92d-4600-ae30-2ff41d4d0d89"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:03:26.872818 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.872711    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b5596b3-a92d-4600-ae30-2ff41d4d0d89" (UID: "6b5596b3-a92d-4600-ae30-2ff41d4d0d89"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:03:26.873231 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.873212    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b5596b3-a92d-4600-ae30-2ff41d4d0d89" (UID: "6b5596b3-a92d-4600-ae30-2ff41d4d0d89"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:03:26.873313 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.873215    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-kube-api-access-tngzv" (OuterVolumeSpecName: "kube-api-access-tngzv") pod "6b5596b3-a92d-4600-ae30-2ff41d4d0d89" (UID: "6b5596b3-a92d-4600-ae30-2ff41d4d0d89"). InnerVolumeSpecName "kube-api-access-tngzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:03:26.971930 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.971900    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istiod-ca-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:26.971930 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.971922    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tngzv\" (UniqueName: \"kubernetes.io/projected/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-kube-api-access-tngzv\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:26.971930 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.971931    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-token\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:26.972116 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.971941    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:26.972116 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.971948    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-podinfo\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:26.972116 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:26.971958    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b5596b3-a92d-4600-ae30-2ff41d4d0d89-istio-envoy\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:27.607645 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:27.607617    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"
Sep 19 11:03:27.607645 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:27.607634    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g" event={"ID":"6b5596b3-a92d-4600-ae30-2ff41d4d0d89","Type":"ContainerDied","Data":"36ed419453a39d84ab247939f8d302b8637e173e949f7eed20a8460ed499adda"}
Sep 19 11:03:27.608125 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:27.607717    2579 scope.go:117] "RemoveContainer" containerID="1940e63b1312050b61159d8f6a8b00823a22a1715a7492ff0a2e78f5c8273f68"
Sep 19 11:03:27.625706 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:27.625682    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"]
Sep 19 11:03:27.631246 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:27.631213    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g"]
Sep 19 11:03:29.203501 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:29.203461    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" path="/var/lib/kubelet/pods/6b5596b3-a92d-4600-ae30-2ff41d4d0d89/volumes"
Sep 19 11:03:40.352393 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.352356    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"]
Sep 19 11:03:40.352877 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.352562    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch" podUID="9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9" containerName="maas-api" containerID="cri-o://f5f18a870cc6cac39b17e7b47b4bd1047d5b77c4d034bf69720c884174798626" gracePeriod=30
Sep 19 11:03:40.400610 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.400579    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"]
Sep 19 11:03:40.400897 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.400869    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg" podUID="59405ed0-f5f8-4efe-9dba-cff906544748" containerName="payload-processing" containerID="cri-o://60904bd9bedbf6a1814708c2a63fa982b692fd9dcb3ac2cb3f3e429db984bc5b" gracePeriod=30
Sep 19 11:03:40.408335 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.408299    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"]
Sep 19 11:03:40.408569 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.408544    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2" podUID="91f7b3f0-b724-4f6c-b893-bb6e29890479" containerName="payload-pre-processing" containerID="cri-o://b4d9992f797ae80d2597411da4524b0c3bd4698729a483750a23e1bd2a89cdbb" gracePeriod=30
Sep 19 11:03:40.686470 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.686426    2579 generic.go:356] "Generic (PLEG): container finished" podID="91f7b3f0-b724-4f6c-b893-bb6e29890479" containerID="b4d9992f797ae80d2597411da4524b0c3bd4698729a483750a23e1bd2a89cdbb" exitCode=0
Sep 19 11:03:40.686639 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.686571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2" event={"ID":"91f7b3f0-b724-4f6c-b893-bb6e29890479","Type":"ContainerDied","Data":"b4d9992f797ae80d2597411da4524b0c3bd4698729a483750a23e1bd2a89cdbb"}
Sep 19 11:03:40.690746 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.688773    2579 generic.go:356] "Generic (PLEG): container finished" podID="59405ed0-f5f8-4efe-9dba-cff906544748" containerID="60904bd9bedbf6a1814708c2a63fa982b692fd9dcb3ac2cb3f3e429db984bc5b" exitCode=0
Sep 19 11:03:40.690746 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.688929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg" event={"ID":"59405ed0-f5f8-4efe-9dba-cff906544748","Type":"ContainerDied","Data":"60904bd9bedbf6a1814708c2a63fa982b692fd9dcb3ac2cb3f3e429db984bc5b"}
Sep 19 11:03:40.691307 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.691281    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9" containerID="f5f18a870cc6cac39b17e7b47b4bd1047d5b77c4d034bf69720c884174798626" exitCode=0
Sep 19 11:03:40.691430 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.691317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch" event={"ID":"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9","Type":"ContainerDied","Data":"f5f18a870cc6cac39b17e7b47b4bd1047d5b77c4d034bf69720c884174798626"}
Sep 19 11:03:40.725643 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.725619    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:03:40.729026 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.729006    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"
Sep 19 11:03:40.732386 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.732370    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"
Sep 19 11:03:40.883127 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.883048    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59405ed0-f5f8-4efe-9dba-cff906544748-plugins-config-volume\") pod \"59405ed0-f5f8-4efe-9dba-cff906544748\" (UID: \"59405ed0-f5f8-4efe-9dba-cff906544748\") "
Sep 19 11:03:40.883127 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.883084    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqhn5\" (UniqueName: \"kubernetes.io/projected/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-kube-api-access-hqhn5\") pod \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") "
Sep 19 11:03:40.883127 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.883106    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-maas-api-tls\") pod \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") "
Sep 19 11:03:40.883127 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.883121    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91f7b3f0-b724-4f6c-b893-bb6e29890479-plugins-config-volume\") pod \"91f7b3f0-b724-4f6c-b893-bb6e29890479\" (UID: \"91f7b3f0-b724-4f6c-b893-bb6e29890479\") "
Sep 19 11:03:40.883441 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.883218    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-metrics-certs\") pod \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") "
Sep 19 11:03:40.883441 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.883243    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kzjz\" (UniqueName: \"kubernetes.io/projected/91f7b3f0-b724-4f6c-b893-bb6e29890479-kube-api-access-6kzjz\") pod \"91f7b3f0-b724-4f6c-b893-bb6e29890479\" (UID: \"91f7b3f0-b724-4f6c-b893-bb6e29890479\") "
Sep 19 11:03:40.883441 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.883282    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-openshift-service-ca\") pod \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\" (UID: \"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9\") "
Sep 19 11:03:40.883610 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.883524    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91f7b3f0-b724-4f6c-b893-bb6e29890479-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91f7b3f0-b724-4f6c-b893-bb6e29890479" (UID: "91f7b3f0-b724-4f6c-b893-bb6e29890479"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:03:40.883610 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.883596    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59405ed0-f5f8-4efe-9dba-cff906544748-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "59405ed0-f5f8-4efe-9dba-cff906544748" (UID: "59405ed0-f5f8-4efe-9dba-cff906544748"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:03:40.883756 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.883312    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfxml\" (UniqueName: \"kubernetes.io/projected/59405ed0-f5f8-4efe-9dba-cff906544748-kube-api-access-bfxml\") pod \"59405ed0-f5f8-4efe-9dba-cff906544748\" (UID: \"59405ed0-f5f8-4efe-9dba-cff906544748\") "
Sep 19 11:03:40.883756 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.883647    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9" (UID: "9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:03:40.884057 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.884036    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-openshift-service-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:40.884138 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.884063    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59405ed0-f5f8-4efe-9dba-cff906544748-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:40.884138 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.884081    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91f7b3f0-b724-4f6c-b893-bb6e29890479-plugins-config-volume\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:40.885960 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.885893    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9" (UID: "9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:03:40.885960 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.885925    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-kube-api-access-hqhn5" (OuterVolumeSpecName: "kube-api-access-hqhn5") pod "9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9" (UID: "9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9"). InnerVolumeSpecName "kube-api-access-hqhn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:03:40.886083 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.885974    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9" (UID: "9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:03:40.886083 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.885992    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59405ed0-f5f8-4efe-9dba-cff906544748-kube-api-access-bfxml" (OuterVolumeSpecName: "kube-api-access-bfxml") pod "59405ed0-f5f8-4efe-9dba-cff906544748" (UID: "59405ed0-f5f8-4efe-9dba-cff906544748"). InnerVolumeSpecName "kube-api-access-bfxml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:03:40.886083 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.885992    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f7b3f0-b724-4f6c-b893-bb6e29890479-kube-api-access-6kzjz" (OuterVolumeSpecName: "kube-api-access-6kzjz") pod "91f7b3f0-b724-4f6c-b893-bb6e29890479" (UID: "91f7b3f0-b724-4f6c-b893-bb6e29890479"). InnerVolumeSpecName "kube-api-access-6kzjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:03:40.984667 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.984643    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqhn5\" (UniqueName: \"kubernetes.io/projected/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-kube-api-access-hqhn5\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:40.984667 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.984668    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-maas-api-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:40.984849 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.984677    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9-metrics-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:40.984849 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.984685    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kzjz\" (UniqueName: \"kubernetes.io/projected/91f7b3f0-b724-4f6c-b893-bb6e29890479-kube-api-access-6kzjz\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:40.984849 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:40.984694    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfxml\" (UniqueName: \"kubernetes.io/projected/59405ed0-f5f8-4efe-9dba-cff906544748-kube-api-access-bfxml\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:03:41.700918 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.700882    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"
Sep 19 11:03:41.701364 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.700917    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch" event={"ID":"9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9","Type":"ContainerDied","Data":"92d23c64b6a7547e1f786601e88e35b3fdc47d978291a9bb022713e6a7f79ff0"}
Sep 19 11:03:41.701364 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.700994    2579 scope.go:117] "RemoveContainer" containerID="f5f18a870cc6cac39b17e7b47b4bd1047d5b77c4d034bf69720c884174798626"
Sep 19 11:03:41.703116 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.703094    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"
Sep 19 11:03:41.703215 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.703124    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2" event={"ID":"91f7b3f0-b724-4f6c-b893-bb6e29890479","Type":"ContainerDied","Data":"4da4cc75e7e4b1e22b16c8a1afa1144372137d9a51b70fb58becb0c8aaf7ee30"}
Sep 19 11:03:41.704810 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.704785    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"
Sep 19 11:03:41.704924 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.704827    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg" event={"ID":"59405ed0-f5f8-4efe-9dba-cff906544748","Type":"ContainerDied","Data":"407e448d9f5b2d1350c232f43771cb51460751497548be60ce94dd948f18f779"}
Sep 19 11:03:41.714733 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.714705    2579 scope.go:117] "RemoveContainer" containerID="b4d9992f797ae80d2597411da4524b0c3bd4698729a483750a23e1bd2a89cdbb"
Sep 19 11:03:41.722394 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.722377    2579 scope.go:117] "RemoveContainer" containerID="60904bd9bedbf6a1814708c2a63fa982b692fd9dcb3ac2cb3f3e429db984bc5b"
Sep 19 11:03:41.729650 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.729628    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"]
Sep 19 11:03:41.735185 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.735163    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bd3aad-8484989d5b-tp8ch"]
Sep 19 11:03:41.744849 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.744826    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"]
Sep 19 11:03:41.746715 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.746696    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2"]
Sep 19 11:03:41.758453 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.758433    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"]
Sep 19 11:03:41.767278 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:41.767255    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg"]
Sep 19 11:03:43.202243 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:43.202209    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59405ed0-f5f8-4efe-9dba-cff906544748" path="/var/lib/kubelet/pods/59405ed0-f5f8-4efe-9dba-cff906544748/volumes"
Sep 19 11:03:43.202629 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:43.202578    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91f7b3f0-b724-4f6c-b893-bb6e29890479" path="/var/lib/kubelet/pods/91f7b3f0-b724-4f6c-b893-bb6e29890479/volumes"
Sep 19 11:03:43.202972 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:03:43.202957    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9" path="/var/lib/kubelet/pods/9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9/volumes"
Sep 19 11:04:29.049694 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:29.049642    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"]
Sep 19 11:04:29.050308 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:29.049890    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy" containerID="cri-o://4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01" gracePeriod=30
Sep 19 11:04:33.285750 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:33.285688    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 11:04:33.286131 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:33.285789    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 11:04:34.296939 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.296917    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:04:34.413899 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.413832    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373408d9-48a3-4520-8d0b-98ba486ff202-istio-podinfo\") pod \"373408d9-48a3-4520-8d0b-98ba486ff202\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") "
Sep 19 11:04:34.413899 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.413871    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-istio-data\") pod \"373408d9-48a3-4520-8d0b-98ba486ff202\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") "
Sep 19 11:04:34.413899 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.413892    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373408d9-48a3-4520-8d0b-98ba486ff202-istio-token\") pod \"373408d9-48a3-4520-8d0b-98ba486ff202\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") "
Sep 19 11:04:34.414140 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.413916    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-credential-socket\") pod \"373408d9-48a3-4520-8d0b-98ba486ff202\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") "
Sep 19 11:04:34.414140 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.413934    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzskk\" (UniqueName: \"kubernetes.io/projected/373408d9-48a3-4520-8d0b-98ba486ff202-kube-api-access-wzskk\") pod \"373408d9-48a3-4520-8d0b-98ba486ff202\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") "
Sep 19 11:04:34.414140 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.413969    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-workload-certs\") pod \"373408d9-48a3-4520-8d0b-98ba486ff202\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") "
Sep 19 11:04:34.414140 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.413995    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-workload-socket\") pod \"373408d9-48a3-4520-8d0b-98ba486ff202\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") "
Sep 19 11:04:34.414140 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.414093    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-istio-envoy\") pod \"373408d9-48a3-4520-8d0b-98ba486ff202\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") "
Sep 19 11:04:34.414405 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.414144    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373408d9-48a3-4520-8d0b-98ba486ff202-istiod-ca-cert\") pod \"373408d9-48a3-4520-8d0b-98ba486ff202\" (UID: \"373408d9-48a3-4520-8d0b-98ba486ff202\") "
Sep 19 11:04:34.414405 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.414154    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-istio-data" (OuterVolumeSpecName: "istio-data") pod "373408d9-48a3-4520-8d0b-98ba486ff202" (UID: "373408d9-48a3-4520-8d0b-98ba486ff202"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:04:34.414405 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.414298    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "373408d9-48a3-4520-8d0b-98ba486ff202" (UID: "373408d9-48a3-4520-8d0b-98ba486ff202"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:04:34.414405 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.414315    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "373408d9-48a3-4520-8d0b-98ba486ff202" (UID: "373408d9-48a3-4520-8d0b-98ba486ff202"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:04:34.414405 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.414395    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "373408d9-48a3-4520-8d0b-98ba486ff202" (UID: "373408d9-48a3-4520-8d0b-98ba486ff202"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:04:34.414696 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.414460    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-istio-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:34.414696 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.414491    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-credential-socket\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:34.414696 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.414506    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-workload-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:34.414696 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.414670    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/373408d9-48a3-4520-8d0b-98ba486ff202-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "373408d9-48a3-4520-8d0b-98ba486ff202" (UID: "373408d9-48a3-4520-8d0b-98ba486ff202"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:04:34.415918 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.415890    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/373408d9-48a3-4520-8d0b-98ba486ff202-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "373408d9-48a3-4520-8d0b-98ba486ff202" (UID: "373408d9-48a3-4520-8d0b-98ba486ff202"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:04:34.416164 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.416138    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/373408d9-48a3-4520-8d0b-98ba486ff202-istio-token" (OuterVolumeSpecName: "istio-token") pod "373408d9-48a3-4520-8d0b-98ba486ff202" (UID: "373408d9-48a3-4520-8d0b-98ba486ff202"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:04:34.416289 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.416204    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/373408d9-48a3-4520-8d0b-98ba486ff202-kube-api-access-wzskk" (OuterVolumeSpecName: "kube-api-access-wzskk") pod "373408d9-48a3-4520-8d0b-98ba486ff202" (UID: "373408d9-48a3-4520-8d0b-98ba486ff202"). InnerVolumeSpecName "kube-api-access-wzskk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:04:34.416356 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.416299    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "373408d9-48a3-4520-8d0b-98ba486ff202" (UID: "373408d9-48a3-4520-8d0b-98ba486ff202"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:04:34.515063 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.515038    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373408d9-48a3-4520-8d0b-98ba486ff202-istio-token\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:34.515063 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.515058    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzskk\" (UniqueName: \"kubernetes.io/projected/373408d9-48a3-4520-8d0b-98ba486ff202-kube-api-access-wzskk\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:34.515187 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.515067    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-workload-socket\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:34.515187 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.515078    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373408d9-48a3-4520-8d0b-98ba486ff202-istio-envoy\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:34.515187 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.515086    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373408d9-48a3-4520-8d0b-98ba486ff202-istiod-ca-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:34.515187 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:34.515093    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373408d9-48a3-4520-8d0b-98ba486ff202-istio-podinfo\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:35.007783 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.007752    2579 generic.go:356] "Generic (PLEG): container finished" podID="373408d9-48a3-4520-8d0b-98ba486ff202" containerID="4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01" exitCode=0
Sep 19 11:04:35.007928 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.007792    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"
Sep 19 11:04:35.007928 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.007831    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" event={"ID":"373408d9-48a3-4520-8d0b-98ba486ff202","Type":"ContainerDied","Data":"4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01"}
Sep 19 11:04:35.007928 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.007890    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx" event={"ID":"373408d9-48a3-4520-8d0b-98ba486ff202","Type":"ContainerDied","Data":"b2bfef3992af4f979c8280189068c721230665d8870d2d4b0b8bd04bca8cd64a"}
Sep 19 11:04:35.007928 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.007921    2579 scope.go:117] "RemoveContainer" containerID="4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01"
Sep 19 11:04:35.018772 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.018755    2579 scope.go:117] "RemoveContainer" containerID="500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116"
Sep 19 11:04:35.026885 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.026868    2579 scope.go:117] "RemoveContainer" containerID="4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01"
Sep 19 11:04:35.027224 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:04:35.027164    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01\": container with ID starting with 4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01 not found: ID does not exist" containerID="4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01"
Sep 19 11:04:35.027343 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.027234    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01"} err="failed to get container status \"4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01\": rpc error: code = NotFound desc = could not find container \"4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01\": container with ID starting with 4bfbeb0d5caf22df13f2f26afdf2a18ffa9561a2b52bfe7f949aaf1902d79b01 not found: ID does not exist"
Sep 19 11:04:35.027343 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.027293    2579 scope.go:117] "RemoveContainer" containerID="500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116"
Sep 19 11:04:35.027625 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:04:35.027602    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116\": container with ID starting with 500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116 not found: ID does not exist" containerID="500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116"
Sep 19 11:04:35.027764 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.027632    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116"} err="failed to get container status \"500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116\": rpc error: code = NotFound desc = could not find container \"500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116\": container with ID starting with 500c8bf518f9677f736e6b952621cf1a25f9e6c13da992e101f1dde78e13b116 not found: ID does not exist"
Sep 19 11:04:35.032241 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.032219    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"]
Sep 19 11:04:35.036103 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.036083    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx"]
Sep 19 11:04:35.201986 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:35.201961    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" path="/var/lib/kubelet/pods/373408d9-48a3-4520-8d0b-98ba486ff202/volumes"
Sep 19 11:04:39.324676 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:39.324648    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 11:04:39.331381 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:39.331361    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 11:04:46.542431 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:46.542400    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"]
Sep 19 11:04:46.542957 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:46.542600    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy" containerID="cri-o://2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699" gracePeriod=30
Sep 19 11:04:49.892237 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:49.892201    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 11:04:49.892628 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:49.892268    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 11:04:51.787323 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.787301    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:04:51.864456 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.864392    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-podinfo\") pod \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") "
Sep 19 11:04:51.864456 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.864438    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-token\") pod \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") "
Sep 19 11:04:51.864643 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.864552    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-data\") pod \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") "
Sep 19 11:04:51.864643 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.864595    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dds7s\" (UniqueName: \"kubernetes.io/projected/0fd7a121-3c56-4195-824b-5cac0ce7fcea-kube-api-access-dds7s\") pod \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") "
Sep 19 11:04:51.864643 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.864619    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istiod-ca-cert\") pod \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") "
Sep 19 11:04:51.864853 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.864673    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-workload-certs\") pod \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") "
Sep 19 11:04:51.864853 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.864704    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-envoy\") pod \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") "
Sep 19 11:04:51.864853 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.864744    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-credential-socket\") pod \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") "
Sep 19 11:04:51.864853 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.864806    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-workload-socket\") pod \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\" (UID: \"0fd7a121-3c56-4195-824b-5cac0ce7fcea\") "
Sep 19 11:04:51.864853 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.864811    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-data" (OuterVolumeSpecName: "istio-data") pod "0fd7a121-3c56-4195-824b-5cac0ce7fcea" (UID: "0fd7a121-3c56-4195-824b-5cac0ce7fcea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:04:51.865112 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.864997    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0fd7a121-3c56-4195-824b-5cac0ce7fcea" (UID: "0fd7a121-3c56-4195-824b-5cac0ce7fcea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:04:51.865112 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.865017    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0fd7a121-3c56-4195-824b-5cac0ce7fcea" (UID: "0fd7a121-3c56-4195-824b-5cac0ce7fcea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:04:51.865229 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.865211    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:51.865284 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.865229    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-workload-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:51.865284 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.865244    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-credential-socket\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:51.865284 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.865246    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0fd7a121-3c56-4195-824b-5cac0ce7fcea" (UID: "0fd7a121-3c56-4195-824b-5cac0ce7fcea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:04:51.865446 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.865293    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0fd7a121-3c56-4195-824b-5cac0ce7fcea" (UID: "0fd7a121-3c56-4195-824b-5cac0ce7fcea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:04:51.866662 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.866632    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0fd7a121-3c56-4195-824b-5cac0ce7fcea" (UID: "0fd7a121-3c56-4195-824b-5cac0ce7fcea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:04:51.866808 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.866752    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-token" (OuterVolumeSpecName: "istio-token") pod "0fd7a121-3c56-4195-824b-5cac0ce7fcea" (UID: "0fd7a121-3c56-4195-824b-5cac0ce7fcea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:04:51.866808 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.866752    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fd7a121-3c56-4195-824b-5cac0ce7fcea-kube-api-access-dds7s" (OuterVolumeSpecName: "kube-api-access-dds7s") pod "0fd7a121-3c56-4195-824b-5cac0ce7fcea" (UID: "0fd7a121-3c56-4195-824b-5cac0ce7fcea"). InnerVolumeSpecName "kube-api-access-dds7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:04:51.866973 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.866956    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0fd7a121-3c56-4195-824b-5cac0ce7fcea" (UID: "0fd7a121-3c56-4195-824b-5cac0ce7fcea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:04:51.965885 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.965862    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-podinfo\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:51.965885 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.965883    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-token\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:51.966005 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.965892    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dds7s\" (UniqueName: \"kubernetes.io/projected/0fd7a121-3c56-4195-824b-5cac0ce7fcea-kube-api-access-dds7s\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:51.966005 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.965903    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istiod-ca-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:51.966005 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.965911    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-istio-envoy\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:51.966005 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:51.965918    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd7a121-3c56-4195-824b-5cac0ce7fcea-workload-socket\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:04:52.109908 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:52.109877    2579 generic.go:356] "Generic (PLEG): container finished" podID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerID="2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699" exitCode=0
Sep 19 11:04:52.110010 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:52.109923    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"
Sep 19 11:04:52.110010 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:52.109961    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" event={"ID":"0fd7a121-3c56-4195-824b-5cac0ce7fcea","Type":"ContainerDied","Data":"2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699"}
Sep 19 11:04:52.110103 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:52.110017    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq" event={"ID":"0fd7a121-3c56-4195-824b-5cac0ce7fcea","Type":"ContainerDied","Data":"3789f4e63fd9b4724c547404dcc238a7c2280abcee9f15628524b566abc95814"}
Sep 19 11:04:52.110103 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:52.110041    2579 scope.go:117] "RemoveContainer" containerID="2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699"
Sep 19 11:04:52.120049 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:52.120031    2579 scope.go:117] "RemoveContainer" containerID="952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42"
Sep 19 11:04:52.127935 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:52.127917    2579 scope.go:117] "RemoveContainer" containerID="2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699"
Sep 19 11:04:52.128186 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:04:52.128165    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699\": container with ID starting with 2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699 not found: ID does not exist" containerID="2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699"
Sep 19 11:04:52.128320 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:52.128194    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699"} err="failed to get container status \"2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699\": rpc error: code = NotFound desc = could not find container \"2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699\": container with ID starting with 2412b112a1416b42750930a95586122c28b90313edcf27e1523e7c5013d22699 not found: ID does not exist"
Sep 19 11:04:52.128320 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:52.128210    2579 scope.go:117] "RemoveContainer" containerID="952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42"
Sep 19 11:04:52.128432 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:04:52.128418    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42\": container with ID starting with 952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42 not found: ID does not exist" containerID="952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42"
Sep 19 11:04:52.128473 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:52.128439    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42"} err="failed to get container status \"952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42\": rpc error: code = NotFound desc = could not find container \"952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42\": container with ID starting with 952575a6893e58a42b507aede6827a9d76a4405f73e5e8b758d7f8c2f91f0f42 not found: ID does not exist"
Sep 19 11:04:52.132249 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:52.132227    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"]
Sep 19 11:04:52.137678 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:52.137657    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq"]
Sep 19 11:04:53.203054 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:04:53.203022    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" path="/var/lib/kubelet/pods/0fd7a121-3c56-4195-824b-5cac0ce7fcea/volumes"
Sep 19 11:05:21.370214 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:21.370183    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"]
Sep 19 11:05:21.370809 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:21.370396    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy" containerID="cri-o://f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656" gracePeriod=30
Sep 19 11:05:23.481133 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:23.481089    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-6nrs7"]
Sep 19 11:05:23.481713 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:23.481395    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bb96ff4f5-6nrs7" podUID="7a07d545-eef1-410a-ae73-b90a5eddad1c" containerName="manager" containerID="cri-o://b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1" gracePeriod=30
Sep 19 11:05:23.726113 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:23.726088    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 11:05:23.820012 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:23.819986    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-webhook-cert\") pod \"7a07d545-eef1-410a-ae73-b90a5eddad1c\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") "
Sep 19 11:05:23.820152 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:23.820030    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-metrics-certs\") pod \"7a07d545-eef1-410a-ae73-b90a5eddad1c\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") "
Sep 19 11:05:23.820152 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:23.820067    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wlc6\" (UniqueName: \"kubernetes.io/projected/7a07d545-eef1-410a-ae73-b90a5eddad1c-kube-api-access-6wlc6\") pod \"7a07d545-eef1-410a-ae73-b90a5eddad1c\" (UID: \"7a07d545-eef1-410a-ae73-b90a5eddad1c\") "
Sep 19 11:05:23.822011 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:23.821978    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7a07d545-eef1-410a-ae73-b90a5eddad1c" (UID: "7a07d545-eef1-410a-ae73-b90a5eddad1c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:05:23.822117 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:23.822083    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a07d545-eef1-410a-ae73-b90a5eddad1c-kube-api-access-6wlc6" (OuterVolumeSpecName: "kube-api-access-6wlc6") pod "7a07d545-eef1-410a-ae73-b90a5eddad1c" (UID: "7a07d545-eef1-410a-ae73-b90a5eddad1c"). InnerVolumeSpecName "kube-api-access-6wlc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:05:23.822117 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:23.822084    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7a07d545-eef1-410a-ae73-b90a5eddad1c" (UID: "7a07d545-eef1-410a-ae73-b90a5eddad1c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:05:23.921175 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:23.921152    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-webhook-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:05:23.921175 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:23.921171    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a07d545-eef1-410a-ae73-b90a5eddad1c-metrics-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:05:23.921311 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:23.921180    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wlc6\" (UniqueName: \"kubernetes.io/projected/7a07d545-eef1-410a-ae73-b90a5eddad1c-kube-api-access-6wlc6\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:05:24.296078 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:24.296005    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a07d545-eef1-410a-ae73-b90a5eddad1c" containerID="b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1" exitCode=0
Sep 19 11:05:24.296078 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:24.296052    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96ff4f5-6nrs7"
Sep 19 11:05:24.296235 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:24.296093    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96ff4f5-6nrs7" event={"ID":"7a07d545-eef1-410a-ae73-b90a5eddad1c","Type":"ContainerDied","Data":"b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1"}
Sep 19 11:05:24.296235 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:24.296151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96ff4f5-6nrs7" event={"ID":"7a07d545-eef1-410a-ae73-b90a5eddad1c","Type":"ContainerDied","Data":"464ff38fc5a8baf8c3c104276f0ea93a15947ee72d980514d7a771f0752a8f8f"}
Sep 19 11:05:24.296235 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:24.296180    2579 scope.go:117] "RemoveContainer" containerID="b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1"
Sep 19 11:05:24.308144 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:24.308067    2579 scope.go:117] "RemoveContainer" containerID="b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1"
Sep 19 11:05:24.309172 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:05:24.309138    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1\": container with ID starting with b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1 not found: ID does not exist" containerID="b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1"
Sep 19 11:05:24.309274 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:24.309182    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1"} err="failed to get container status \"b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1\": rpc error: code = NotFound desc = could not find container \"b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1\": container with ID starting with b5963d78bec4c263ca6159032df9be72ca0c2600281a6c32daebf83d11dfa9c1 not found: ID does not exist"
Sep 19 11:05:24.317108 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:24.317083    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-6nrs7"]
Sep 19 11:05:24.318858 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:24.318826    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-6nrs7"]
Sep 19 11:05:25.202852 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:25.202819    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a07d545-eef1-410a-ae73-b90a5eddad1c" path="/var/lib/kubelet/pods/7a07d545-eef1-410a-ae73-b90a5eddad1c/volumes"
Sep 19 11:05:25.754313 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:25.754268    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 11:05:25.754482 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:25.754353    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 11:05:26.627190 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.627162    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 11:05:26.751621 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.751549    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istiod-ca-cert\") pod \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") "
Sep 19 11:05:26.751621 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.751593    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-workload-socket\") pod \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") "
Sep 19 11:05:26.751843 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.751637    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-credential-socket\") pod \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") "
Sep 19 11:05:26.751843 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.751688    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq9sd\" (UniqueName: \"kubernetes.io/projected/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-kube-api-access-fq9sd\") pod \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") "
Sep 19 11:05:26.751843 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.751718    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-podinfo\") pod \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") "
Sep 19 11:05:26.751843 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.751762    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-envoy\") pod \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") "
Sep 19 11:05:26.751843 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.751795    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-token\") pod \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") "
Sep 19 11:05:26.751843 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.751836    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-data\") pod \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") "
Sep 19 11:05:26.752202 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.751893    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-workload-certs\") pod \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\" (UID: \"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f\") "
Sep 19 11:05:26.752202 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.752002    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" (UID: "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:05:26.752202 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.752034    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" (UID: "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:05:26.752367 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.752229    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" (UID: "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:05:26.752429 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.752383    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-data" (OuterVolumeSpecName: "istio-data") pod "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" (UID: "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:05:26.752527 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.752496    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" (UID: "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:05:26.752690 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.752640    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istiod-ca-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:05:26.752690 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.752664    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-workload-socket\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:05:26.754425 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.754399    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-token" (OuterVolumeSpecName: "istio-token") pod "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" (UID: "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:05:26.754627 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.754597    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" (UID: "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:05:26.754765 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.754657    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" (UID: "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:05:26.754765 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.754694    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-kube-api-access-fq9sd" (OuterVolumeSpecName: "kube-api-access-fq9sd") pod "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" (UID: "fdcdc08b-f7fa-4f54-a163-0aad2c830c3f"). InnerVolumeSpecName "kube-api-access-fq9sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:05:26.853671 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.853639    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq9sd\" (UniqueName: \"kubernetes.io/projected/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-kube-api-access-fq9sd\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:05:26.853671 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.853672    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-podinfo\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:05:26.853878 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.853687    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-envoy\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:05:26.853878 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.853700    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-token\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:05:26.853878 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.853713    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-istio-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:05:26.853878 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.853741    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-workload-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:05:26.853878 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:26.853751    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f-credential-socket\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:05:27.314207 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:27.314173    2579 generic.go:356] "Generic (PLEG): container finished" podID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerID="f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656" exitCode=0
Sep 19 11:05:27.314352 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:27.314220    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"
Sep 19 11:05:27.314352 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:27.314234    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" event={"ID":"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f","Type":"ContainerDied","Data":"f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656"}
Sep 19 11:05:27.314352 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:27.314273    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8" event={"ID":"fdcdc08b-f7fa-4f54-a163-0aad2c830c3f","Type":"ContainerDied","Data":"f5cb7d6a48070956bf5f6b6f1a1220cef0ef282bd33b8e9b697499c3188c40b5"}
Sep 19 11:05:27.314352 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:27.314294    2579 scope.go:117] "RemoveContainer" containerID="f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656"
Sep 19 11:05:27.323430 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:27.323414    2579 scope.go:117] "RemoveContainer" containerID="554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b"
Sep 19 11:05:27.330648 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:27.330616    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"]
Sep 19 11:05:27.331629 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:27.331606    2579 scope.go:117] "RemoveContainer" containerID="f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656"
Sep 19 11:05:27.331906 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:05:27.331884    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656\": container with ID starting with f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656 not found: ID does not exist" containerID="f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656"
Sep 19 11:05:27.331968 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:27.331917    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656"} err="failed to get container status \"f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656\": rpc error: code = NotFound desc = could not find container \"f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656\": container with ID starting with f45c06f0781016835eb0a5ca40398a0d97a02e0becbf7d43b41d01c671511656 not found: ID does not exist"
Sep 19 11:05:27.331968 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:27.331940    2579 scope.go:117] "RemoveContainer" containerID="554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b"
Sep 19 11:05:27.332196 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:05:27.332177    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b\": container with ID starting with 554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b not found: ID does not exist" containerID="554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b"
Sep 19 11:05:27.332238 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:27.332202    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b"} err="failed to get container status \"554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b\": rpc error: code = NotFound desc = could not find container \"554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b\": container with ID starting with 554967891cde61946072ccb7f97d5165b22da4ab1d625ebf51c67d91a2f5998b not found: ID does not exist"
Sep 19 11:05:27.332881 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:27.332862    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8"]
Sep 19 11:05:29.203583 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:29.203546    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" path="/var/lib/kubelet/pods/fdcdc08b-f7fa-4f54-a163-0aad2c830c3f/volumes"
Sep 19 11:05:39.513027 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:05:39.512992    2579 scope.go:117] "RemoveContainer" containerID="40e9e1015d284dfc4e339e7c259a79c047df11ff1d6fe3075adec607f4f187bf"
Sep 19 11:06:25.089946 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.089909    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-jmc2d"]
Sep 19 11:06:25.090621 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090523    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39790280-5957-4a60-a939-e01403108bd3" containerName="payload-processing"
Sep 19 11:06:25.090621 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090547    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="39790280-5957-4a60-a939-e01403108bd3" containerName="payload-processing"
Sep 19 11:06:25.090621 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090563    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy"
Sep 19 11:06:25.090621 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090572    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy"
Sep 19 11:06:25.090621 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090591    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy"
Sep 19 11:06:25.090621 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090601    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy"
Sep 19 11:06:25.090621 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090614    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy"
Sep 19 11:06:25.090621 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090622    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090632    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9" containerName="maas-api"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090640    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9" containerName="maas-api"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090650    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59405ed0-f5f8-4efe-9dba-cff906544748" containerName="payload-processing"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090658    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="59405ed0-f5f8-4efe-9dba-cff906544748" containerName="payload-processing"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090673    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090681    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090697    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a07d545-eef1-410a-ae73-b90a5eddad1c" containerName="manager"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090705    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a07d545-eef1-410a-ae73-b90a5eddad1c" containerName="manager"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090717    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f7b3f0-b724-4f6c-b893-bb6e29890479" containerName="payload-pre-processing"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090742    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f7b3f0-b724-4f6c-b893-bb6e29890479" containerName="payload-pre-processing"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090754    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090762    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090772    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090781    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090798    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090807    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090902    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090916    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="39790280-5957-4a60-a939-e01403108bd3" containerName="payload-processing"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090926    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090937    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f7b3f0-b724-4f6c-b893-bb6e29890479" containerName="payload-pre-processing"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090948    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e9c116c-f5f2-43d6-acdb-9ebbdebc8ca9" containerName="maas-api"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090957    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090969    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090980    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="59405ed0-f5f8-4efe-9dba-cff906544748" containerName="payload-processing"
Sep 19 11:06:25.091085 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.090988    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a07d545-eef1-410a-ae73-b90a5eddad1c" containerName="manager"
Sep 19 11:06:25.094391 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.094367    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:25.097445 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.097413    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7vkjd\""
Sep 19 11:06:25.097617 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.097595    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 19 11:06:25.097684 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.097636    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 19 11:06:25.097747 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.097638    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 19 11:06:25.102318 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.102251    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-jmc2d"]
Sep 19 11:06:25.199815 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.199790    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22503502-2320-4bef-b0d1-64aa8d9e1b37-metrics-certs\") pod \"maas-controller-bb96ff4f5-jmc2d\" (UID: \"22503502-2320-4bef-b0d1-64aa8d9e1b37\") " pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:25.199922 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.199819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmfk5\" (UniqueName: \"kubernetes.io/projected/22503502-2320-4bef-b0d1-64aa8d9e1b37-kube-api-access-pmfk5\") pod \"maas-controller-bb96ff4f5-jmc2d\" (UID: \"22503502-2320-4bef-b0d1-64aa8d9e1b37\") " pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:25.199922 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.199892    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22503502-2320-4bef-b0d1-64aa8d9e1b37-webhook-cert\") pod \"maas-controller-bb96ff4f5-jmc2d\" (UID: \"22503502-2320-4bef-b0d1-64aa8d9e1b37\") " pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:25.300405 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.300382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22503502-2320-4bef-b0d1-64aa8d9e1b37-metrics-certs\") pod \"maas-controller-bb96ff4f5-jmc2d\" (UID: \"22503502-2320-4bef-b0d1-64aa8d9e1b37\") " pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:25.300520 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.300413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmfk5\" (UniqueName: \"kubernetes.io/projected/22503502-2320-4bef-b0d1-64aa8d9e1b37-kube-api-access-pmfk5\") pod \"maas-controller-bb96ff4f5-jmc2d\" (UID: \"22503502-2320-4bef-b0d1-64aa8d9e1b37\") " pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:25.300520 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.300450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22503502-2320-4bef-b0d1-64aa8d9e1b37-webhook-cert\") pod \"maas-controller-bb96ff4f5-jmc2d\" (UID: \"22503502-2320-4bef-b0d1-64aa8d9e1b37\") " pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:25.302982 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.302950    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22503502-2320-4bef-b0d1-64aa8d9e1b37-metrics-certs\") pod \"maas-controller-bb96ff4f5-jmc2d\" (UID: \"22503502-2320-4bef-b0d1-64aa8d9e1b37\") " pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:25.303079 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.303003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22503502-2320-4bef-b0d1-64aa8d9e1b37-webhook-cert\") pod \"maas-controller-bb96ff4f5-jmc2d\" (UID: \"22503502-2320-4bef-b0d1-64aa8d9e1b37\") " pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:25.307405 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.307387    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmfk5\" (UniqueName: \"kubernetes.io/projected/22503502-2320-4bef-b0d1-64aa8d9e1b37-kube-api-access-pmfk5\") pod \"maas-controller-bb96ff4f5-jmc2d\" (UID: \"22503502-2320-4bef-b0d1-64aa8d9e1b37\") " pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:25.407132 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.407072    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:25.674544 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.674492    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-jmc2d"]
Sep 19 11:06:25.676892 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:06:25.676858    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22503502_2320_4bef_b0d1_64aa8d9e1b37.slice/crio-da0b546eecf310ab0e895a4feef96d28ffdf2fe9a1d3ffbce57090bdf0438901 WatchSource:0}: Error finding container da0b546eecf310ab0e895a4feef96d28ffdf2fe9a1d3ffbce57090bdf0438901: Status 404 returned error can't find the container with id da0b546eecf310ab0e895a4feef96d28ffdf2fe9a1d3ffbce57090bdf0438901
Sep 19 11:06:25.678216 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:25.678196    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 11:06:26.619254 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:26.619216    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96ff4f5-jmc2d" event={"ID":"22503502-2320-4bef-b0d1-64aa8d9e1b37","Type":"ContainerStarted","Data":"b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121"}
Sep 19 11:06:26.619704 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:26.619268    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96ff4f5-jmc2d" event={"ID":"22503502-2320-4bef-b0d1-64aa8d9e1b37","Type":"ContainerStarted","Data":"da0b546eecf310ab0e895a4feef96d28ffdf2fe9a1d3ffbce57090bdf0438901"}
Sep 19 11:06:26.619704 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:26.619310    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:26.636136 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:26.636090    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bb96ff4f5-jmc2d" podStartSLOduration=1.223616059 podStartE2EDuration="1.636074037s" totalImagesPullingTime="412.457978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:06:26.633579483 +0000 UTC m=+1909.532769377" watchObservedRunningTime="2026-09-19 11:06:26.636074037 +0000 UTC m=+1909.535263928"
Sep 19 11:06:37.627138 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:37.627095    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:46.916116 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:46.916076    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-jmc2d"]
Sep 19 11:06:46.916623 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:46.916345    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bb96ff4f5-jmc2d" podUID="22503502-2320-4bef-b0d1-64aa8d9e1b37" containerName="manager" containerID="cri-o://b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121" gracePeriod=30
Sep 19 11:06:47.176253 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.176195    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:47.268156 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.268128    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmfk5\" (UniqueName: \"kubernetes.io/projected/22503502-2320-4bef-b0d1-64aa8d9e1b37-kube-api-access-pmfk5\") pod \"22503502-2320-4bef-b0d1-64aa8d9e1b37\" (UID: \"22503502-2320-4bef-b0d1-64aa8d9e1b37\") "
Sep 19 11:06:47.268312 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.268215    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22503502-2320-4bef-b0d1-64aa8d9e1b37-webhook-cert\") pod \"22503502-2320-4bef-b0d1-64aa8d9e1b37\" (UID: \"22503502-2320-4bef-b0d1-64aa8d9e1b37\") "
Sep 19 11:06:47.268312 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.268264    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22503502-2320-4bef-b0d1-64aa8d9e1b37-metrics-certs\") pod \"22503502-2320-4bef-b0d1-64aa8d9e1b37\" (UID: \"22503502-2320-4bef-b0d1-64aa8d9e1b37\") "
Sep 19 11:06:47.270106 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.270076    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22503502-2320-4bef-b0d1-64aa8d9e1b37-kube-api-access-pmfk5" (OuterVolumeSpecName: "kube-api-access-pmfk5") pod "22503502-2320-4bef-b0d1-64aa8d9e1b37" (UID: "22503502-2320-4bef-b0d1-64aa8d9e1b37"). InnerVolumeSpecName "kube-api-access-pmfk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:06:47.270226 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.270199    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22503502-2320-4bef-b0d1-64aa8d9e1b37-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "22503502-2320-4bef-b0d1-64aa8d9e1b37" (UID: "22503502-2320-4bef-b0d1-64aa8d9e1b37"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:06:47.270289 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.270223    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22503502-2320-4bef-b0d1-64aa8d9e1b37-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "22503502-2320-4bef-b0d1-64aa8d9e1b37" (UID: "22503502-2320-4bef-b0d1-64aa8d9e1b37"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:06:47.369889 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.369863    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22503502-2320-4bef-b0d1-64aa8d9e1b37-webhook-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:06:47.369889 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.369887    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22503502-2320-4bef-b0d1-64aa8d9e1b37-metrics-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:06:47.370053 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.369917    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmfk5\" (UniqueName: \"kubernetes.io/projected/22503502-2320-4bef-b0d1-64aa8d9e1b37-kube-api-access-pmfk5\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:06:47.729572 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.729543    2579 generic.go:356] "Generic (PLEG): container finished" podID="22503502-2320-4bef-b0d1-64aa8d9e1b37" containerID="b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121" exitCode=0
Sep 19 11:06:47.729707 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.729591    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96ff4f5-jmc2d"
Sep 19 11:06:47.729707 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.729633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96ff4f5-jmc2d" event={"ID":"22503502-2320-4bef-b0d1-64aa8d9e1b37","Type":"ContainerDied","Data":"b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121"}
Sep 19 11:06:47.729707 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.729692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96ff4f5-jmc2d" event={"ID":"22503502-2320-4bef-b0d1-64aa8d9e1b37","Type":"ContainerDied","Data":"da0b546eecf310ab0e895a4feef96d28ffdf2fe9a1d3ffbce57090bdf0438901"}
Sep 19 11:06:47.729836 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.729734    2579 scope.go:117] "RemoveContainer" containerID="b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121"
Sep 19 11:06:47.738630 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.738612    2579 scope.go:117] "RemoveContainer" containerID="b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121"
Sep 19 11:06:47.738907 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:06:47.738887    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121\": container with ID starting with b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121 not found: ID does not exist" containerID="b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121"
Sep 19 11:06:47.738973 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.738915    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121"} err="failed to get container status \"b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121\": rpc error: code = NotFound desc = could not find container \"b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121\": container with ID starting with b2b0b8c4f04035f6ea7698190910026614703f7a68ecc826559e96453f075121 not found: ID does not exist"
Sep 19 11:06:47.750512 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.750484    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-jmc2d"]
Sep 19 11:06:47.752245 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:47.752222    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-jmc2d"]
Sep 19 11:06:48.489666 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.489626    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-nvpnn"]
Sep 19 11:06:48.490164 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.490121    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22503502-2320-4bef-b0d1-64aa8d9e1b37" containerName="manager"
Sep 19 11:06:48.490164 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.490146    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22503502-2320-4bef-b0d1-64aa8d9e1b37" containerName="manager"
Sep 19 11:06:48.490164 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.490166    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy"
Sep 19 11:06:48.490331 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.490172    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy"
Sep 19 11:06:48.490331 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.490252    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b5596b3-a92d-4600-ae30-2ff41d4d0d89" containerName="istio-proxy"
Sep 19 11:06:48.490331 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.490263    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdcdc08b-f7fa-4f54-a163-0aad2c830c3f" containerName="istio-proxy"
Sep 19 11:06:48.490331 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.490275    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="373408d9-48a3-4520-8d0b-98ba486ff202" containerName="istio-proxy"
Sep 19 11:06:48.490331 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.490286    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fd7a121-3c56-4195-824b-5cac0ce7fcea" containerName="istio-proxy"
Sep 19 11:06:48.490331 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.490293    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="22503502-2320-4bef-b0d1-64aa8d9e1b37" containerName="manager"
Sep 19 11:06:48.494904 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.494884    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:06:48.498239 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.498188    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 19 11:06:48.498387 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.498249    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 19 11:06:48.498387 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.498274    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7vkjd\""
Sep 19 11:06:48.498387 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.498251    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 19 11:06:48.501819 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.501792    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-nvpnn"]
Sep 19 11:06:48.578966 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.578937    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8200310-2a3f-4727-b575-b5ec2b8bfcfd-webhook-cert\") pod \"maas-controller-bb96ff4f5-nvpnn\" (UID: \"e8200310-2a3f-4727-b575-b5ec2b8bfcfd\") " pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:06:48.579078 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.579033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8200310-2a3f-4727-b575-b5ec2b8bfcfd-metrics-certs\") pod \"maas-controller-bb96ff4f5-nvpnn\" (UID: \"e8200310-2a3f-4727-b575-b5ec2b8bfcfd\") " pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:06:48.579135 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.579075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5xdd\" (UniqueName: \"kubernetes.io/projected/e8200310-2a3f-4727-b575-b5ec2b8bfcfd-kube-api-access-l5xdd\") pod \"maas-controller-bb96ff4f5-nvpnn\" (UID: \"e8200310-2a3f-4727-b575-b5ec2b8bfcfd\") " pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:06:48.679436 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.679406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8200310-2a3f-4727-b575-b5ec2b8bfcfd-metrics-certs\") pod \"maas-controller-bb96ff4f5-nvpnn\" (UID: \"e8200310-2a3f-4727-b575-b5ec2b8bfcfd\") " pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:06:48.679551 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.679443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5xdd\" (UniqueName: \"kubernetes.io/projected/e8200310-2a3f-4727-b575-b5ec2b8bfcfd-kube-api-access-l5xdd\") pod \"maas-controller-bb96ff4f5-nvpnn\" (UID: \"e8200310-2a3f-4727-b575-b5ec2b8bfcfd\") " pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:06:48.679551 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.679485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8200310-2a3f-4727-b575-b5ec2b8bfcfd-webhook-cert\") pod \"maas-controller-bb96ff4f5-nvpnn\" (UID: \"e8200310-2a3f-4727-b575-b5ec2b8bfcfd\") " pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:06:48.681993 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.681973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8200310-2a3f-4727-b575-b5ec2b8bfcfd-webhook-cert\") pod \"maas-controller-bb96ff4f5-nvpnn\" (UID: \"e8200310-2a3f-4727-b575-b5ec2b8bfcfd\") " pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:06:48.682078 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.682005    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8200310-2a3f-4727-b575-b5ec2b8bfcfd-metrics-certs\") pod \"maas-controller-bb96ff4f5-nvpnn\" (UID: \"e8200310-2a3f-4727-b575-b5ec2b8bfcfd\") " pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:06:48.686801 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.686780    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5xdd\" (UniqueName: \"kubernetes.io/projected/e8200310-2a3f-4727-b575-b5ec2b8bfcfd-kube-api-access-l5xdd\") pod \"maas-controller-bb96ff4f5-nvpnn\" (UID: \"e8200310-2a3f-4727-b575-b5ec2b8bfcfd\") " pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:06:48.807822 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:48.807805    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:06:49.077177 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:49.077149    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb96ff4f5-nvpnn"]
Sep 19 11:06:49.078679 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:06:49.078655    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8200310_2a3f_4727_b575_b5ec2b8bfcfd.slice/crio-a5d1df01aee0a61443fd1af360eb84d44d53151308ed2c9f5f5cd756c832b188 WatchSource:0}: Error finding container a5d1df01aee0a61443fd1af360eb84d44d53151308ed2c9f5f5cd756c832b188: Status 404 returned error can't find the container with id a5d1df01aee0a61443fd1af360eb84d44d53151308ed2c9f5f5cd756c832b188
Sep 19 11:06:49.203934 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:49.203905    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22503502-2320-4bef-b0d1-64aa8d9e1b37" path="/var/lib/kubelet/pods/22503502-2320-4bef-b0d1-64aa8d9e1b37/volumes"
Sep 19 11:06:49.741565 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:49.741476    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96ff4f5-nvpnn" event={"ID":"e8200310-2a3f-4727-b575-b5ec2b8bfcfd","Type":"ContainerStarted","Data":"3df413283fedf805d8046763383ceacd443c1eacdbb7dce745629f11714b0068"}
Sep 19 11:06:49.741966 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:49.741618    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:06:49.741966 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:49.741637    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96ff4f5-nvpnn" event={"ID":"e8200310-2a3f-4727-b575-b5ec2b8bfcfd","Type":"ContainerStarted","Data":"a5d1df01aee0a61443fd1af360eb84d44d53151308ed2c9f5f5cd756c832b188"}
Sep 19 11:06:49.758641 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:06:49.758598    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bb96ff4f5-nvpnn" podStartSLOduration=1.4031058220000001 podStartE2EDuration="1.758582674s" totalImagesPullingTime="355.476852ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:06:49.756163853 +0000 UTC m=+1932.655353742" watchObservedRunningTime="2026-09-19 11:06:49.758582674 +0000 UTC m=+1932.657772565"
Sep 19 11:07:00.748631 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:07:00.748601    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bb96ff4f5-nvpnn"
Sep 19 11:09:39.353974 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:09:39.353942    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 11:09:39.366957 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:09:39.366939    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hk5p9_7ebd3a5f-3104-4518-b44b-6e88911e8d93/ovn-acl-logging/0.log"
Sep 19 11:10:40.775968 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:40.775931    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"]
Sep 19 11:10:40.779310 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:40.779292    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:40.788321 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:40.788288    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"]
Sep 19 11:10:40.913244 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:40.913218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50830bb5-9d96-45d3-a856-b5a3eefde0a8-metrics-certs\") pod \"maas-api-546445c5bc-tpvnr\" (UID: \"50830bb5-9d96-45d3-a856-b5a3eefde0a8\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:40.913385 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:40.913255    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50830bb5-9d96-45d3-a856-b5a3eefde0a8-openshift-service-ca\") pod \"maas-api-546445c5bc-tpvnr\" (UID: \"50830bb5-9d96-45d3-a856-b5a3eefde0a8\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:40.913385 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:40.913292    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ft78\" (UniqueName: \"kubernetes.io/projected/50830bb5-9d96-45d3-a856-b5a3eefde0a8-kube-api-access-4ft78\") pod \"maas-api-546445c5bc-tpvnr\" (UID: \"50830bb5-9d96-45d3-a856-b5a3eefde0a8\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:40.913385 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:40.913360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50830bb5-9d96-45d3-a856-b5a3eefde0a8-maas-api-tls\") pod \"maas-api-546445c5bc-tpvnr\" (UID: \"50830bb5-9d96-45d3-a856-b5a3eefde0a8\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:41.013813 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.013780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50830bb5-9d96-45d3-a856-b5a3eefde0a8-metrics-certs\") pod \"maas-api-546445c5bc-tpvnr\" (UID: \"50830bb5-9d96-45d3-a856-b5a3eefde0a8\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:41.013813 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.013814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50830bb5-9d96-45d3-a856-b5a3eefde0a8-openshift-service-ca\") pod \"maas-api-546445c5bc-tpvnr\" (UID: \"50830bb5-9d96-45d3-a856-b5a3eefde0a8\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:41.013979 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.013847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ft78\" (UniqueName: \"kubernetes.io/projected/50830bb5-9d96-45d3-a856-b5a3eefde0a8-kube-api-access-4ft78\") pod \"maas-api-546445c5bc-tpvnr\" (UID: \"50830bb5-9d96-45d3-a856-b5a3eefde0a8\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:41.013979 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.013867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50830bb5-9d96-45d3-a856-b5a3eefde0a8-maas-api-tls\") pod \"maas-api-546445c5bc-tpvnr\" (UID: \"50830bb5-9d96-45d3-a856-b5a3eefde0a8\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:41.014483 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.014450    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50830bb5-9d96-45d3-a856-b5a3eefde0a8-openshift-service-ca\") pod \"maas-api-546445c5bc-tpvnr\" (UID: \"50830bb5-9d96-45d3-a856-b5a3eefde0a8\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:41.016241 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.016222    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50830bb5-9d96-45d3-a856-b5a3eefde0a8-maas-api-tls\") pod \"maas-api-546445c5bc-tpvnr\" (UID: \"50830bb5-9d96-45d3-a856-b5a3eefde0a8\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:41.016344 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.016293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50830bb5-9d96-45d3-a856-b5a3eefde0a8-metrics-certs\") pod \"maas-api-546445c5bc-tpvnr\" (UID: \"50830bb5-9d96-45d3-a856-b5a3eefde0a8\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:41.021354 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.021331    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ft78\" (UniqueName: \"kubernetes.io/projected/50830bb5-9d96-45d3-a856-b5a3eefde0a8-kube-api-access-4ft78\") pod \"maas-api-546445c5bc-tpvnr\" (UID: \"50830bb5-9d96-45d3-a856-b5a3eefde0a8\") " pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:41.092150 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.092112    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:41.375028 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.375002    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"]
Sep 19 11:10:41.377112 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:10:41.377083    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50830bb5_9d96_45d3_a856_b5a3eefde0a8.slice/crio-7eaefc5824fec1ac6ceaa8be6f20be492375019d392f0a7eb1dd7e9181e42af0 WatchSource:0}: Error finding container 7eaefc5824fec1ac6ceaa8be6f20be492375019d392f0a7eb1dd7e9181e42af0: Status 404 returned error can't find the container with id 7eaefc5824fec1ac6ceaa8be6f20be492375019d392f0a7eb1dd7e9181e42af0
Sep 19 11:10:41.942551 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.942511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr" event={"ID":"50830bb5-9d96-45d3-a856-b5a3eefde0a8","Type":"ContainerStarted","Data":"8c54b9cf809c68d87692fd2e129f143a1d9250c3788392651ca965195c504ad1"}
Sep 19 11:10:41.942948 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.942579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr" event={"ID":"50830bb5-9d96-45d3-a856-b5a3eefde0a8","Type":"ContainerStarted","Data":"7eaefc5824fec1ac6ceaa8be6f20be492375019d392f0a7eb1dd7e9181e42af0"}
Sep 19 11:10:41.942948 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.942701    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:41.960843 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:41.960799    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr" podStartSLOduration=1.531884465 podStartE2EDuration="1.960785056s" totalImagesPullingTime="428.900591ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:10:41.958674199 +0000 UTC m=+2164.857864090" watchObservedRunningTime="2026-09-19 11:10:41.960785056 +0000 UTC m=+2164.859974949"
Sep 19 11:10:47.952950 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:47.952918    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-546445c5bc-tpvnr"
Sep 19 11:10:55.308028 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:55.307994    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f47b4794c-9579x"]
Sep 19 11:10:55.308629 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:55.308227    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x" podUID="720af5c5-dec6-49dd-b2e5-aef2b26459de" containerName="maas-api" containerID="cri-o://910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d" gracePeriod=30
Sep 19 11:10:56.555742 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.555703    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 11:10:56.638950 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.638886    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n56br\" (UniqueName: \"kubernetes.io/projected/720af5c5-dec6-49dd-b2e5-aef2b26459de-kube-api-access-n56br\") pod \"720af5c5-dec6-49dd-b2e5-aef2b26459de\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") "
Sep 19 11:10:56.638950 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.638926    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720af5c5-dec6-49dd-b2e5-aef2b26459de-openshift-service-ca\") pod \"720af5c5-dec6-49dd-b2e5-aef2b26459de\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") "
Sep 19 11:10:56.639147 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.638959    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-metrics-certs\") pod \"720af5c5-dec6-49dd-b2e5-aef2b26459de\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") "
Sep 19 11:10:56.639147 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.638994    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-maas-api-tls\") pod \"720af5c5-dec6-49dd-b2e5-aef2b26459de\" (UID: \"720af5c5-dec6-49dd-b2e5-aef2b26459de\") "
Sep 19 11:10:56.639260 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.639241    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/720af5c5-dec6-49dd-b2e5-aef2b26459de-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "720af5c5-dec6-49dd-b2e5-aef2b26459de" (UID: "720af5c5-dec6-49dd-b2e5-aef2b26459de"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:10:56.641112 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.641084    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "720af5c5-dec6-49dd-b2e5-aef2b26459de" (UID: "720af5c5-dec6-49dd-b2e5-aef2b26459de"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:10:56.641210 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.641136    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/720af5c5-dec6-49dd-b2e5-aef2b26459de-kube-api-access-n56br" (OuterVolumeSpecName: "kube-api-access-n56br") pod "720af5c5-dec6-49dd-b2e5-aef2b26459de" (UID: "720af5c5-dec6-49dd-b2e5-aef2b26459de"). InnerVolumeSpecName "kube-api-access-n56br". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:10:56.641252 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.641215    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "720af5c5-dec6-49dd-b2e5-aef2b26459de" (UID: "720af5c5-dec6-49dd-b2e5-aef2b26459de"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:10:56.740181 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.740155    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-metrics-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:10:56.740181 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.740177    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720af5c5-dec6-49dd-b2e5-aef2b26459de-maas-api-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:10:56.740311 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.740185    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n56br\" (UniqueName: \"kubernetes.io/projected/720af5c5-dec6-49dd-b2e5-aef2b26459de-kube-api-access-n56br\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:10:56.740311 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:56.740195    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720af5c5-dec6-49dd-b2e5-aef2b26459de-openshift-service-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 19 11:10:57.027801 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:57.027694    2579 generic.go:356] "Generic (PLEG): container finished" podID="720af5c5-dec6-49dd-b2e5-aef2b26459de" containerID="910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d" exitCode=0
Sep 19 11:10:57.027801 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:57.027762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x" event={"ID":"720af5c5-dec6-49dd-b2e5-aef2b26459de","Type":"ContainerDied","Data":"910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d"}
Sep 19 11:10:57.027801 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:57.027766    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x"
Sep 19 11:10:57.028069 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:57.027806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f47b4794c-9579x" event={"ID":"720af5c5-dec6-49dd-b2e5-aef2b26459de","Type":"ContainerDied","Data":"573f72a5a11fc472e409229bbb57d075a1106639490562ff1cac1c66da085527"}
Sep 19 11:10:57.028069 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:57.027827    2579 scope.go:117] "RemoveContainer" containerID="910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d"
Sep 19 11:10:57.037437 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:57.037421    2579 scope.go:117] "RemoveContainer" containerID="910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d"
Sep 19 11:10:57.037713 ip-10-0-143-186 kubenswrapper[2579]: E0919 11:10:57.037693    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d\": container with ID starting with 910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d not found: ID does not exist" containerID="910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d"
Sep 19 11:10:57.037814 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:57.037720    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d"} err="failed to get container status \"910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d\": rpc error: code = NotFound desc = could not find container \"910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d\": container with ID starting with 910adc76464269b19a8e592b5b925363a7833bc5625c74cfee43ae852df9393d not found: ID does not exist"
Sep 19 11:10:57.048317 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:57.048297    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f47b4794c-9579x"]
Sep 19 11:10:57.050001 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:57.049984    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-f47b4794c-9579x"]
Sep 19 11:10:57.208809 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:10:57.208776    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="720af5c5-dec6-49dd-b2e5-aef2b26459de" path="/var/lib/kubelet/pods/720af5c5-dec6-49dd-b2e5-aef2b26459de/volumes"
Sep 19 11:11:10.506426 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:10.506372    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b9547bd8f-m7cgc_bbaf7b45-4cb4-4b44-aed6-3e727b57cb60/authorino/0.log"
Sep 19 11:11:16.221786 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:16.221750    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-64b9cf4bfb-bqhjn_17f9bf68-630c-4229-a429-e3cf4ea9a876/manager/0.log"
Sep 19 11:11:16.327319 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:16.327283    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-c5fml_14a05ed2-5cc5-4c38-8db6-77360789dcfb/manager/0.log"
Sep 19 11:11:16.436929 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:16.436902    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xb6vx_d7e48adf-6645-4680-8ea2-32671aa63241/manager/0.log"
Sep 19 11:11:16.560693 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:16.560667    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bb96ff4f5-nvpnn_e8200310-2a3f-4727-b575-b5ec2b8bfcfd/manager/0.log"
Sep 19 11:11:16.671873 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:16.671854    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4j9vr_f34c5053-1baa-47f4-a7f7-10f286a89925/server/0.log"
Sep 19 11:11:17.026811 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:17.026786    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b87889df-s448x_ca84fb4f-7a1f-41b1-99b3-7610fc668af7/copy-manifests/0.log"
Sep 19 11:11:17.035012 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:17.034977    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b87889df-s448x_ca84fb4f-7a1f-41b1-99b3-7610fc668af7/manager/0.log"
Sep 19 11:11:17.477526 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:17.477500    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-546445c5bc-tpvnr_50830bb5-9d96-45d3-a856-b5a3eefde0a8/maas-api/0.log"
Sep 19 11:11:17.915301 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:17.915278    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-56dr7_ad3b5958-b13e-44c2-ab84-e9f0ac877e97/postgres/0.log"
Sep 19 11:11:18.669576 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:18.669542    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b9547bd8f-m7cgc_bbaf7b45-4cb4-4b44-aed6-3e727b57cb60/authorino/0.log"
Sep 19 11:11:18.778492 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:18.778455    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-w8bth_60bc21e1-feea-4ab0-829f-1e98bd65fa63/manager/0.log"
Sep 19 11:11:18.885779 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:18.885752    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-c4vg9_c46d2897-15ff-4572-b72f-373e60dbd9b5/manager/0.log"
Sep 19 11:11:19.346739 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:19.346698    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-pbkp9_0f209e4b-d76c-4eac-873f-62d0ec094244/manager/0.log"
Sep 19 11:11:19.911205 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:19.911175    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b786b9b5-h9glx_a6b2f6f7-4482-4e38-9564-c9dff59414fc/kube-auth-proxy/0.log"
Sep 19 11:11:20.135295 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:20.135270    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g4xvk_35caa86b-d1ee-48fe-a901-9faa53de020c/istio-proxy/1.log"
Sep 19 11:11:20.344693 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:20.344669    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-7hp29_5f1164e8-3969-4951-ad45-598c957c21db/payload-processing/0.log"
Sep 19 11:11:20.798666 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:20.798588    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl_aa7f1917-4291-47d3-b736-09b95c6f97e5/main/0.log"
Sep 19 11:11:20.902979 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:20.902952    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-mj79v_23032bbd-1f5e-4d03-aa90-7be4c41e4244/main/0.log"
Sep 19 11:11:23.021100 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:23.021066    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b9547bd8f-m7cgc_bbaf7b45-4cb4-4b44-aed6-3e727b57cb60/authorino/0.log"
Sep 19 11:11:28.675548 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:28.675508    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-64b9cf4bfb-bqhjn_17f9bf68-630c-4229-a429-e3cf4ea9a876/manager/0.log"
Sep 19 11:11:28.776810 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:28.776777    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-c5fml_14a05ed2-5cc5-4c38-8db6-77360789dcfb/manager/0.log"
Sep 19 11:11:28.898035 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:28.898005    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xb6vx_d7e48adf-6645-4680-8ea2-32671aa63241/manager/0.log"
Sep 19 11:11:29.023785 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:29.023701    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bb96ff4f5-nvpnn_e8200310-2a3f-4727-b575-b5ec2b8bfcfd/manager/0.log"
Sep 19 11:11:29.134324 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:29.134299    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4j9vr_f34c5053-1baa-47f4-a7f7-10f286a89925/server/0.log"
Sep 19 11:11:29.491825 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:29.491798    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b87889df-s448x_ca84fb4f-7a1f-41b1-99b3-7610fc668af7/copy-manifests/0.log"
Sep 19 11:11:29.498307 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:29.498282    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b87889df-s448x_ca84fb4f-7a1f-41b1-99b3-7610fc668af7/manager/0.log"
Sep 19 11:11:29.962592 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:29.962558    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-546445c5bc-tpvnr_50830bb5-9d96-45d3-a856-b5a3eefde0a8/maas-api/0.log"
Sep 19 11:11:30.380663 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:30.380634    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-56dr7_ad3b5958-b13e-44c2-ab84-e9f0ac877e97/postgres/0.log"
Sep 19 11:11:31.144331 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:31.144304    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b9547bd8f-m7cgc_bbaf7b45-4cb4-4b44-aed6-3e727b57cb60/authorino/0.log"
Sep 19 11:11:31.258871 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:31.258814    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-w8bth_60bc21e1-feea-4ab0-829f-1e98bd65fa63/manager/0.log"
Sep 19 11:11:31.364164 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:31.364140    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-c4vg9_c46d2897-15ff-4572-b72f-373e60dbd9b5/manager/0.log"
Sep 19 11:11:31.831651 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:31.831605    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-pbkp9_0f209e4b-d76c-4eac-873f-62d0ec094244/manager/0.log"
Sep 19 11:11:32.423000 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:32.422969    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b786b9b5-h9glx_a6b2f6f7-4482-4e38-9564-c9dff59414fc/kube-auth-proxy/0.log"
Sep 19 11:11:32.647504 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:32.647479    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g4xvk_35caa86b-d1ee-48fe-a901-9faa53de020c/istio-proxy/1.log"
Sep 19 11:11:32.904490 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:32.904464    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-7hp29_5f1164e8-3969-4951-ad45-598c957c21db/payload-processing/0.log"
Sep 19 11:11:33.375317 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:33.375288    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mzsxl_aa7f1917-4291-47d3-b736-09b95c6f97e5/main/0.log"
Sep 19 11:11:33.496287 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:33.496261    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-mj79v_23032bbd-1f5e-4d03-aa90-7be4c41e4244/main/0.log"
Sep 19 11:11:52.028526 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.028444    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bb96ff4f5-nvpnn_e8200310-2a3f-4727-b575-b5ec2b8bfcfd/manager/0.log"
Sep 19 11:11:52.184677 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.184646    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bb96ff4f5-nvpnn_e8200310-2a3f-4727-b575-b5ec2b8bfcfd/manager/0.log"
Sep 19 11:11:52.640542 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.640511    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-7hp29_5f1164e8-3969-4951-ad45-598c957c21db/payload-processing/0.log"
Sep 19 11:11:52.749071 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.749041    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-7hp29_5f1164e8-3969-4951-ad45-598c957c21db/payload-processing/0.log"
Sep 19 11:11:52.905460 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.905379    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mc4ck/must-gather-2bhhw"]
Sep 19 11:11:52.905875 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.905857    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="720af5c5-dec6-49dd-b2e5-aef2b26459de" containerName="maas-api"
Sep 19 11:11:52.905981 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.905877    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="720af5c5-dec6-49dd-b2e5-aef2b26459de" containerName="maas-api"
Sep 19 11:11:52.906040 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.905992    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="720af5c5-dec6-49dd-b2e5-aef2b26459de" containerName="maas-api"
Sep 19 11:11:52.910355 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.910330    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mc4ck/must-gather-2bhhw"
Sep 19 11:11:52.912538 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.912513    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mc4ck\"/\"kube-root-ca.crt\""
Sep 19 11:11:52.912674 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.912609    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mc4ck\"/\"openshift-service-ca.crt\""
Sep 19 11:11:52.912674 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.912653    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mc4ck\"/\"default-dockercfg-rpzfz\""
Sep 19 11:11:52.919939 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:52.919915    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mc4ck/must-gather-2bhhw"]
Sep 19 11:11:53.083607 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:53.083584    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9366ff6e-5e61-428b-ba8e-0f138053dde1-must-gather-output\") pod \"must-gather-2bhhw\" (UID: \"9366ff6e-5e61-428b-ba8e-0f138053dde1\") " pod="openshift-must-gather-mc4ck/must-gather-2bhhw"
Sep 19 11:11:53.083929 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:53.083656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzcfj\" (UniqueName: \"kubernetes.io/projected/9366ff6e-5e61-428b-ba8e-0f138053dde1-kube-api-access-pzcfj\") pod \"must-gather-2bhhw\" (UID: \"9366ff6e-5e61-428b-ba8e-0f138053dde1\") " pod="openshift-must-gather-mc4ck/must-gather-2bhhw"
Sep 19 11:11:53.184482 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:53.184408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9366ff6e-5e61-428b-ba8e-0f138053dde1-must-gather-output\") pod \"must-gather-2bhhw\" (UID: \"9366ff6e-5e61-428b-ba8e-0f138053dde1\") " pod="openshift-must-gather-mc4ck/must-gather-2bhhw"
Sep 19 11:11:53.184599 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:53.184482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzcfj\" (UniqueName: \"kubernetes.io/projected/9366ff6e-5e61-428b-ba8e-0f138053dde1-kube-api-access-pzcfj\") pod \"must-gather-2bhhw\" (UID: \"9366ff6e-5e61-428b-ba8e-0f138053dde1\") " pod="openshift-must-gather-mc4ck/must-gather-2bhhw"
Sep 19 11:11:53.184813 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:53.184787    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9366ff6e-5e61-428b-ba8e-0f138053dde1-must-gather-output\") pod \"must-gather-2bhhw\" (UID: \"9366ff6e-5e61-428b-ba8e-0f138053dde1\") " pod="openshift-must-gather-mc4ck/must-gather-2bhhw"
Sep 19 11:11:53.192278 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:53.192246    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzcfj\" (UniqueName: \"kubernetes.io/projected/9366ff6e-5e61-428b-ba8e-0f138053dde1-kube-api-access-pzcfj\") pod \"must-gather-2bhhw\" (UID: \"9366ff6e-5e61-428b-ba8e-0f138053dde1\") " pod="openshift-must-gather-mc4ck/must-gather-2bhhw"
Sep 19 11:11:53.221109 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:53.221080    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mc4ck/must-gather-2bhhw"
Sep 19 11:11:53.491044 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:53.491015    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mc4ck/must-gather-2bhhw"]
Sep 19 11:11:53.492844 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:11:53.492815    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9366ff6e_5e61_428b_ba8e_0f138053dde1.slice/crio-8ee50ec2fa4ab90dd6a01c3abc2429b0252f10b6d035f47a149e763250942e82 WatchSource:0}: Error finding container 8ee50ec2fa4ab90dd6a01c3abc2429b0252f10b6d035f47a149e763250942e82: Status 404 returned error can't find the container with id 8ee50ec2fa4ab90dd6a01c3abc2429b0252f10b6d035f47a149e763250942e82
Sep 19 11:11:53.494620 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:53.494604    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 11:11:54.326562 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:54.326523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mc4ck/must-gather-2bhhw" event={"ID":"9366ff6e-5e61-428b-ba8e-0f138053dde1","Type":"ContainerStarted","Data":"7640ce7d9180fe5daeca86cc66bcfa71e387dc7f0443d15f7cdec037002011a5"}
Sep 19 11:11:54.326925 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:54.326579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mc4ck/must-gather-2bhhw" event={"ID":"9366ff6e-5e61-428b-ba8e-0f138053dde1","Type":"ContainerStarted","Data":"8ee50ec2fa4ab90dd6a01c3abc2429b0252f10b6d035f47a149e763250942e82"}
Sep 19 11:11:55.334285 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:55.334244    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mc4ck/must-gather-2bhhw" event={"ID":"9366ff6e-5e61-428b-ba8e-0f138053dde1","Type":"ContainerStarted","Data":"24ef2f0e74ee98574fd4dbcb3b04deb2a8f973a82ef2483155358d0ec0d50f2e"}
Sep 19 11:11:55.349237 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:55.349182    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mc4ck/must-gather-2bhhw" podStartSLOduration=2.664057772 podStartE2EDuration="3.349167038s" totalImagesPullingTime="685.109266ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:11:55.348959006 +0000 UTC m=+2238.248148978" watchObservedRunningTime="2026-09-19 11:11:55.349167038 +0000 UTC m=+2238.248356969"
Sep 19 11:11:55.629716 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:55.629641    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7stdm_5562ade4-b9ad-402c-99ad-38724e6f5221/global-pull-secret-syncer/0.log"
Sep 19 11:11:55.800962 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:55.800935    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p6szj_4ce4789f-0ebf-458b-bcd6-bdcc5adf27d5/konnectivity-agent/0.log"
Sep 19 11:11:55.841394 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:11:55.841359    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-186.ec2.internal_c0db033f393a4308e61b0b4763bc529a/haproxy/0.log"
Sep 19 11:12:01.156136 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:01.156088    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b9547bd8f-m7cgc_bbaf7b45-4cb4-4b44-aed6-3e727b57cb60/authorino/0.log"
Sep 19 11:12:01.186362 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:01.186333    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-w8bth_60bc21e1-feea-4ab0-829f-1e98bd65fa63/manager/0.log"
Sep 19 11:12:01.233037 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:01.233010    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-c4vg9_c46d2897-15ff-4572-b72f-373e60dbd9b5/manager/0.log"
Sep 19 11:12:01.395766 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:01.395706    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-pbkp9_0f209e4b-d76c-4eac-873f-62d0ec094244/manager/0.log"
Sep 19 11:12:02.662154 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:02.662119    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f3eba0f-65d4-42d3-82bb-a56fb515fd75/alertmanager/0.log"
Sep 19 11:12:02.684813 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:02.684785    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f3eba0f-65d4-42d3-82bb-a56fb515fd75/config-reloader/0.log"
Sep 19 11:12:02.705512 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:02.705485    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f3eba0f-65d4-42d3-82bb-a56fb515fd75/kube-rbac-proxy-web/0.log"
Sep 19 11:12:02.729529 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:02.729499    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f3eba0f-65d4-42d3-82bb-a56fb515fd75/kube-rbac-proxy/0.log"
Sep 19 11:12:02.751939 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:02.751911    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f3eba0f-65d4-42d3-82bb-a56fb515fd75/kube-rbac-proxy-metric/0.log"
Sep 19 11:12:02.793355 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:02.793320    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f3eba0f-65d4-42d3-82bb-a56fb515fd75/prom-label-proxy/0.log"
Sep 19 11:12:02.815708 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:02.815679    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f3eba0f-65d4-42d3-82bb-a56fb515fd75/init-config-reloader/0.log"
Sep 19 11:12:03.161628 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:03.161597    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vpk7s_98120cac-9503-4ae2-b8ee-57298e73c167/node-exporter/0.log"
Sep 19 11:12:03.181037 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:03.180960    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vpk7s_98120cac-9503-4ae2-b8ee-57298e73c167/kube-rbac-proxy/0.log"
Sep 19 11:12:03.202909 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:03.202879    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vpk7s_98120cac-9503-4ae2-b8ee-57298e73c167/init-textfile/0.log"
Sep 19 11:12:03.613547 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:03.613519    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f8c99f754-dxvz5_496d4ba2-7414-4cdb-932b-7a7f0e597203/thanos-query/0.log"
Sep 19 11:12:03.631420 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:03.631396    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f8c99f754-dxvz5_496d4ba2-7414-4cdb-932b-7a7f0e597203/kube-rbac-proxy-web/0.log"
Sep 19 11:12:03.649166 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:03.649139    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f8c99f754-dxvz5_496d4ba2-7414-4cdb-932b-7a7f0e597203/kube-rbac-proxy/0.log"
Sep 19 11:12:03.666493 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:03.666460    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f8c99f754-dxvz5_496d4ba2-7414-4cdb-932b-7a7f0e597203/prom-label-proxy/0.log"
Sep 19 11:12:03.684363 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:03.684339    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f8c99f754-dxvz5_496d4ba2-7414-4cdb-932b-7a7f0e597203/kube-rbac-proxy-rules/0.log"
Sep 19 11:12:03.701486 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:03.701463    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f8c99f754-dxvz5_496d4ba2-7414-4cdb-932b-7a7f0e597203/kube-rbac-proxy-metrics/0.log"
Sep 19 11:12:05.734749 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.734697    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"]
Sep 19 11:12:05.740989 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.740962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.747644 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.747617    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"]
Sep 19 11:12:05.814748 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.814177    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/65c11848-c434-4ccc-a5b4-5c378f7079ed-proc\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.814748 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.814211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65c11848-c434-4ccc-a5b4-5c378f7079ed-lib-modules\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.814748 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.814264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65c11848-c434-4ccc-a5b4-5c378f7079ed-sys\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.814748 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.814279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/65c11848-c434-4ccc-a5b4-5c378f7079ed-podres\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.814748 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.814330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwk9f\" (UniqueName: \"kubernetes.io/projected/65c11848-c434-4ccc-a5b4-5c378f7079ed-kube-api-access-dwk9f\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.915005 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.914969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwk9f\" (UniqueName: \"kubernetes.io/projected/65c11848-c434-4ccc-a5b4-5c378f7079ed-kube-api-access-dwk9f\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.915201 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.915024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/65c11848-c434-4ccc-a5b4-5c378f7079ed-proc\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.915201 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.915053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65c11848-c434-4ccc-a5b4-5c378f7079ed-lib-modules\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.915201 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.915125    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/65c11848-c434-4ccc-a5b4-5c378f7079ed-proc\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.915201 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.915133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65c11848-c434-4ccc-a5b4-5c378f7079ed-sys\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.915201 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.915188    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65c11848-c434-4ccc-a5b4-5c378f7079ed-sys\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.915201 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.915200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/65c11848-c434-4ccc-a5b4-5c378f7079ed-podres\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.915484 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.915255    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65c11848-c434-4ccc-a5b4-5c378f7079ed-lib-modules\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.915484 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.915377    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/65c11848-c434-4ccc-a5b4-5c378f7079ed-podres\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:05.922117 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:05.922089    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwk9f\" (UniqueName: \"kubernetes.io/projected/65c11848-c434-4ccc-a5b4-5c378f7079ed-kube-api-access-dwk9f\") pod \"perf-node-gather-daemonset-hscwj\" (UID: \"65c11848-c434-4ccc-a5b4-5c378f7079ed\") " pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:06.055693 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:06.055665    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:06.191070 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:06.191013    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86588cd8f4-2mdzt_85e8a638-7305-41dd-a166-3b98a092d400/console/0.log"
Sep 19 11:12:06.350434 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:06.350394    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"]
Sep 19 11:12:06.353848 ip-10-0-143-186 kubenswrapper[2579]: W0919 11:12:06.353819    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod65c11848_c434_4ccc_a5b4_5c378f7079ed.slice/crio-309456c0bfe4d5210b422021e34be4e905c848c2fb58c91a18062ac8e6d57d16 WatchSource:0}: Error finding container 309456c0bfe4d5210b422021e34be4e905c848c2fb58c91a18062ac8e6d57d16: Status 404 returned error can't find the container with id 309456c0bfe4d5210b422021e34be4e905c848c2fb58c91a18062ac8e6d57d16
Sep 19 11:12:06.428842 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:06.428806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj" event={"ID":"65c11848-c434-4ccc-a5b4-5c378f7079ed","Type":"ContainerStarted","Data":"309456c0bfe4d5210b422021e34be4e905c848c2fb58c91a18062ac8e6d57d16"}
Sep 19 11:12:07.438172 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:07.438135    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj" event={"ID":"65c11848-c434-4ccc-a5b4-5c378f7079ed","Type":"ContainerStarted","Data":"750f8a06e3ff61c6d223d5002c2912a8dd3396a6cb2165c1555a5dd2174f280a"}
Sep 19 11:12:07.438610 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:07.438232    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:07.453498 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:07.453452    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj" podStartSLOduration=2.453437298 podStartE2EDuration="2.453437298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:12:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:12:07.451925143 +0000 UTC m=+2250.351115036" watchObservedRunningTime="2026-09-19 11:12:07.453437298 +0000 UTC m=+2250.352627190"
Sep 19 11:12:07.940625 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:07.940587    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tztnz_02262f5a-d60e-41b9-a942-8ae81cf009b1/dns/0.log"
Sep 19 11:12:07.958123 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:07.958097    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tztnz_02262f5a-d60e-41b9-a942-8ae81cf009b1/kube-rbac-proxy/0.log"
Sep 19 11:12:08.000302 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:08.000277    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l4x25_fcdcdcc3-35cb-457f-b2a6-de1abecb2cb4/dns-node-resolver/0.log"
Sep 19 11:12:08.579491 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:08.579456    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rhh5b_a924e506-1103-4d63-83b9-74d7974ae6d6/node-ca/0.log"
Sep 19 11:12:09.795424 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:09.795395    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b786b9b5-h9glx_a6b2f6f7-4482-4e38-9564-c9dff59414fc/kube-auth-proxy/0.log"
Sep 19 11:12:09.851007 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:09.850979    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g4xvk_35caa86b-d1ee-48fe-a901-9faa53de020c/istio-proxy/0.log"
Sep 19 11:12:09.856515 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:09.856487    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g4xvk_35caa86b-d1ee-48fe-a901-9faa53de020c/istio-proxy/1.log"
Sep 19 11:12:09.896608 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:09.896579    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-7hp29_5f1164e8-3969-4951-ad45-598c957c21db/payload-processing/0.log"
Sep 19 11:12:10.780110 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:10.780080    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dhz2s_2fcd2c88-949d-4f19-922d-285340024356/serve-healthcheck-canary/0.log"
Sep 19 11:12:11.295162 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:11.295130    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hzw4_21744756-dc19-4619-a75c-c114d0364cf8/kube-rbac-proxy/0.log"
Sep 19 11:12:11.312486 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:11.312463    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hzw4_21744756-dc19-4619-a75c-c114d0364cf8/exporter/0.log"
Sep 19 11:12:11.330110 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:11.330083    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hzw4_21744756-dc19-4619-a75c-c114d0364cf8/extractor/0.log"
Sep 19 11:12:13.423912 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:13.423875    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-64b9cf4bfb-bqhjn_17f9bf68-630c-4229-a429-e3cf4ea9a876/manager/0.log"
Sep 19 11:12:13.444779 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:13.444755    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-c5fml_14a05ed2-5cc5-4c38-8db6-77360789dcfb/manager/0.log"
Sep 19 11:12:13.458509 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:13.458474    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mc4ck/perf-node-gather-daemonset-hscwj"
Sep 19 11:12:13.889819 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:13.889779    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xb6vx_d7e48adf-6645-4680-8ea2-32671aa63241/manager/0.log"
Sep 19 11:12:13.962070 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:13.961982    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bb96ff4f5-nvpnn_e8200310-2a3f-4727-b575-b5ec2b8bfcfd/manager/0.log"
Sep 19 11:12:13.980760 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:13.980717    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4j9vr_f34c5053-1baa-47f4-a7f7-10f286a89925/server/0.log"
Sep 19 11:12:14.163691 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:14.163566    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b87889df-s448x_ca84fb4f-7a1f-41b1-99b3-7610fc668af7/manager/0.log"
Sep 19 11:12:14.181279 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:14.181251    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b87889df-s448x_ca84fb4f-7a1f-41b1-99b3-7610fc668af7/copy-manifests/0.log"
Sep 19 11:12:15.727802 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:15.727778    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-mfdm8_7d5965d9-25f6-4c92-bdc9-5996fd1d7f9c/openshift-lws-operator/0.log"
Sep 19 11:12:16.503889 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:16.503846    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b786b9b5-h9glx_a6b2f6f7-4482-4e38-9564-c9dff59414fc/kube-auth-proxy/0.log"
Sep 19 11:12:16.535261 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:16.535224    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g4xvk_35caa86b-d1ee-48fe-a901-9faa53de020c/istio-proxy/0.log"
Sep 19 11:12:16.541340 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:16.541307    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g4xvk_35caa86b-d1ee-48fe-a901-9faa53de020c/istio-proxy/1.log"
Sep 19 11:12:16.566280 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:16.566253    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-7hp29_5f1164e8-3969-4951-ad45-598c957c21db/payload-processing/0.log"
Sep 19 11:12:18.572928 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:18.572891    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b786b9b5-h9glx_a6b2f6f7-4482-4e38-9564-c9dff59414fc/kube-auth-proxy/0.log"
Sep 19 11:12:18.607828 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:18.607799    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g4xvk_35caa86b-d1ee-48fe-a901-9faa53de020c/istio-proxy/0.log"
Sep 19 11:12:18.612897 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:18.612871    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g4xvk_35caa86b-d1ee-48fe-a901-9faa53de020c/istio-proxy/1.log"
Sep 19 11:12:18.636601 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:18.636584    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-85fd65c94c-7hp29_5f1164e8-3969-4951-ad45-598c957c21db/payload-processing/0.log"
Sep 19 11:12:22.025500 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:22.025473    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fq5vn_7991cbac-7da3-4611-b3a4-e6a8ed62901e/kube-multus-additional-cni-plugins/0.log"
Sep 19 11:12:22.042177 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:22.042153    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fq5vn_7991cbac-7da3-4611-b3a4-e6a8ed62901e/egress-router-binary-copy/0.log"
Sep 19 11:12:22.058428 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:22.058411    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fq5vn_7991cbac-7da3-4611-b3a4-e6a8ed62901e/cni-plugins/0.log"
Sep 19 11:12:22.073923 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:22.073905    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fq5vn_7991cbac-7da3-4611-b3a4-e6a8ed62901e/bond-cni-plugin/0.log"
Sep 19 11:12:22.090787 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:22.090765    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fq5vn_7991cbac-7da3-4611-b3a4-e6a8ed62901e/routeoverride-cni/0.log"
Sep 19 11:12:22.107826 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:22.107805    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fq5vn_7991cbac-7da3-4611-b3a4-e6a8ed62901e/whereabouts-cni-bincopy/0.log"
Sep 19 11:12:22.123630 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:22.123610    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fq5vn_7991cbac-7da3-4611-b3a4-e6a8ed62901e/whereabouts-cni/0.log"
Sep 19 11:12:22.367586 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:22.367562    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-l7vf7_34fe78b4-d425-4404-b550-61a7a8873f89/kube-multus/0.log"
Sep 19 11:12:22.388205 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:22.388177    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2dwvp_2b41c220-4b51-4250-989b-fdc1c5a684c8/network-metrics-daemon/0.log"
Sep 19 11:12:22.400659 ip-10-0-143-186 kubenswrapper[2579]: I0919 11:12:22.400635    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2dwvp_2b41c220-4b51-4250-989b-fdc1c5a684c8/kube-rbac-proxy/0.log"