Sep 10 15:59:48.713593 ip-10-0-132-43 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 15:59:48.713603 ip-10-0-132-43 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 15:59:48.713610 ip-10-0-132-43 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 15:59:48.713753 ip-10-0-132-43 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 16:00:00.148272 ip-10-0-132-43 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 16:00:00.148289 ip-10-0-132-43 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6f6fb8d8d6b6440c97509d48e24a74ae --
Sep 10 16:01:55.480986 ip-10-0-132-43 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 16:01:55.847584 ip-10-0-132-43 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 16:01:55.847584 ip-10-0-132-43 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 16:01:55.847584 ip-10-0-132-43 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 16:01:55.847584 ip-10-0-132-43 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 16:01:55.847584 ip-10-0-132-43 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 16:01:55.849699 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.849584    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 16:01:55.852481 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852465    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 16:01:55.852481 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852482    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852486    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852490    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852493    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852496    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852499    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852502    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852505    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852508    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852511    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852514    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852516    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852519    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852522    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852525    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852528    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852532    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852535    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852537    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852540    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 16:01:55.852545 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852542    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852546    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852550    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852554    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852558    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852561    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852563    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852566    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852569    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852571    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852574    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852576    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852579    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852582    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852585    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852589    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852591    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852594    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852596    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 16:01:55.853058 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852599    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852602    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852605    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852607    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852610    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852612    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852615    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852618    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852620    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852623    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852626    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852630    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852632    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852635    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852638    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852641    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852644    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852646    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852649    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852652    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 16:01:55.853791 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852654    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852657    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852660    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852662    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852665    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852667    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852670    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852673    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852675    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852678    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852681    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852686    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852689    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852692    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852695    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852697    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852700    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852703    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852706    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 16:01:55.854293 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852709    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852712    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852715    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852717    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852721    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852736    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852738    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852741    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852744    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852747    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852749    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852752    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852755    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852757    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852760    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852762    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852765    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852768    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852771    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 16:01:55.854858 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.852773    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855098    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855110    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855113    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855116    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855120    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855123    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855126    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855129    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855131    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855135    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855138    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855140    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855143    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855145    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855148    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855151    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855154    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855156    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 16:01:55.855323 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855159    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855162    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855165    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855168    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855171    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855173    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855176    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855178    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855181    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855183    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855186    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855188    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855191    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855193    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855196    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855199    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855202    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855205    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855208    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855210    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 16:01:55.855811 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855213    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855215    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855218    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855220    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855223    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855225    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855228    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855231    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855233    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855236    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855238    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855241    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855244    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855247    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855250    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855252    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855257    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855260    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855265    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 16:01:55.856322 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855268    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855271    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855274    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855277    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855281    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855284    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855287    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855290    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855293    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855296    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855299    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855302    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855304    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855307    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855309    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855312    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855315    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855317    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855321    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 16:01:55.856794 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855324    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855326    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855329    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855332    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855335    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855337    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855340    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855344    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855347    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855349    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855352    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855354    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855357    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855359    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855362    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855365    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855367    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855370    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855372    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855375    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 16:01:55.857257 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855377    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855383    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855386    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855764    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855770    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855773    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855775    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855779    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855781    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855784    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855786    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855789    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855792    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855794    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855797    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855799    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855802    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855805    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855807    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855811    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 16:01:55.857765 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855813    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855816    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855819    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855821    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855825    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855827    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855830    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855832    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855835    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855838    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855841    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855843    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855846    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855849    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855852    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855854    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855856    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855859    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855862    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855864    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 16:01:55.858254 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855867    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855869    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855871    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855874    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855877    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855880    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855882    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855885    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855887    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855890    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855892    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855895    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855897    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855900    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855903    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855905    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855908    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855910    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855913    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855915    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 16:01:55.858768 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855918    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855920    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855923    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855926    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855929    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855932    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855935    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855938    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855940    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855943    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855945    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855966    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855969    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855973    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855975    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855978    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855981    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855985    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855991    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 16:01:55.859285 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855995    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.855998    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856002    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856005    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856007    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856010    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856013    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856016    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856019    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856023    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856027    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856030    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856033    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856035    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856038    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856041    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856043    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856046    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856048    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 16:01:55.859753 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856051    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856053    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856056    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856058    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856126    2562 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856161    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856168    2562 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856172    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856176    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856180    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856184    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856188    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856191    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856194    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856198    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856201    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856204    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856207    2562 flags.go:64] FLAG: --cgroup-root=""
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856210    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856213    2562 flags.go:64] FLAG: --client-ca-file=""
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856217    2562 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856220    2562 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856223    2562 flags.go:64] FLAG: --cluster-domain=""
Sep 10 16:01:55.860211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856226    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856229    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856232    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856235    2562 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856243    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856246    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856249    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856253    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856255    2562 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856258    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856261    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856264    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856267    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856271    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856274    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856277    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856279    2562 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856282    2562 flags.go:64] FLAG: --enable-server="true"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856286    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856290    2562 flags.go:64] FLAG: --event-burst="100"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856293    2562 flags.go:64] FLAG: --event-qps="50"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856296    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856299    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856302    2562 flags.go:64] FLAG: --eviction-hard=""
Sep 10 16:01:55.860791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856305    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856309    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856311    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856314    2562 flags.go:64] FLAG: --eviction-soft=""
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856317    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856320    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856323    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856326    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856329    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856332    2562 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856335    2562 flags.go:64] FLAG: --feature-gates=""
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856338    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856343    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856346    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856349    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856352    2562 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856355    2562 flags.go:64] FLAG: --help="false"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856358    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-132-43.ec2.internal"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856361    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856364    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856367    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856370    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856373    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856376    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 16:01:55.861360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856379    2562 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856382    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856385    2562 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856388    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856391    2562 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856394    2562 flags.go:64] FLAG: --kube-reserved=""
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856396    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856399    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856402    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856405    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856408    2562 flags.go:64] FLAG: --lock-file=""
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856411    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856413    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856416    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856422    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856425    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856428    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856431    2562 flags.go:64] FLAG: --logging-format="text"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856433    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856437    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856442    2562 flags.go:64] FLAG: --manifest-url=""
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856445    2562 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856449    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856452    2562 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856456    2562 flags.go:64] FLAG: --max-pods="110"
Sep 10 16:01:55.861985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856459    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856462    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856465    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856468    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856471    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856474    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856477    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856484    2562 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856487    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856490    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856493    2562 flags.go:64] FLAG: --pod-cidr=""
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856496    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856502    2562 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856505    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856508    2562 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856511    2562 flags.go:64] FLAG: --port="10250"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856515    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856518    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04a0b9496a3034970"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856521    2562 flags.go:64] FLAG: --qos-reserved=""
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856524    2562 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856527    2562 flags.go:64] FLAG: --register-node="true"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856530    2562 flags.go:64] FLAG: --register-with-taints=""
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856533    2562 flags.go:64] FLAG: --registry-burst="10"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856537    2562 flags.go:64] FLAG: --registry-qps="5"
Sep 10 16:01:55.862611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856540    2562 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856543    2562 flags.go:64] FLAG: --reserved-memory=""
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856546    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856550    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856554    2562 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856556    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856559    2562 flags.go:64] FLAG: --runonce="false"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856562    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856565    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856568    2562 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856570    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856573    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856576    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856579    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856582    2562 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856585    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856588    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856591    2562 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856594    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856597    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856600    2562 flags.go:64] FLAG: --system-cgroups=""
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856602    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856608    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856613    2562 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856616    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 16:01:55.863244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856620    2562 flags.go:64] FLAG: --tls-min-version=""
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856623    2562 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856626    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856629    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856632    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856634    2562 flags.go:64] FLAG: --v="2"
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856638    2562 flags.go:64] FLAG: --version="false"
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856642    2562 flags.go:64] FLAG: --vmodule=""
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856646    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.856649    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856798    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856804    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856808    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856811    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856813    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856816    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856819    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856821    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856824    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856827    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856830    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856832    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 16:01:55.863883 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856835    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856837    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856840    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856843    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856846    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856848    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856852    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856856    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856861    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856864    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856867    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856870    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856873    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856876    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856879    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856881    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856884    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856886    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856889    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 16:01:55.864412 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856892    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856894    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856898    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856900    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856903    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856905    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856908    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856911    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856913    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856916    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856919    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856922    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856924    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856927    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856929    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856932    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856935    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856937    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856940    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856943    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 16:01:55.864887 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856945    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856949    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856959    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856962    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856964    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856967    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856969    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856972    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856974    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856977    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856980    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856982    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856986    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856990    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856994    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856997    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.856999    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857002    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857004    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857007    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 16:01:55.865367 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857010    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857012    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857015    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857017    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857020    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857023    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857025    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857028    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857030    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857033    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857035    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857038    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857040    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857044    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857047    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857049    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857052    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857054    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857057    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857059    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 16:01:55.866030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857061    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857064    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857066    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857069    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857071    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857075    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857079    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.857081    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.857698    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.865247    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.865372    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.866148    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.866160    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866217    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866222    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 16:01:55.866557 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866226    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866231    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866235    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866239    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866241    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866244    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866247    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866249    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866252    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866254    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866257    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866260    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866262    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866265    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866267    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866270    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866273    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866275    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866278    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 16:01:55.866949 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866281    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866283    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866286    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866288    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866291    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866294    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866297    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866299    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866304    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866306    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866309    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866311    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866314    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866316    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866319    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866321    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866324    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866326    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866329    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866331    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 16:01:55.867414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866334    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866336    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866339    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866341    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866344    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866354    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866357    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866359    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866362    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866365    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866367    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866369    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866372    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866375    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866377    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866380    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866382    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866385    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866388    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866390    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 16:01:55.867908 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866393    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866397    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866400    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866402    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866405    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866407    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866410    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866412    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866415    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866418    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866420    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866423    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866425    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866428    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866431    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866433    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866436    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866438    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866441    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866443    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 16:01:55.868392 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866446    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866448    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866451    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866453    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866456    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866458    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866461    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866463    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866466    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866468    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866471    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866473    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866476    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866481    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866485    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866488    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866491    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 16:01:55.868890 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866495    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.866500    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866621    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866626    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866629    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866632    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866635    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866637    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866640    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866643    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866645    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866648    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866650    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866653    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866655    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 16:01:55.869343 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866658    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866660    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866663    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866666    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866668    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866671    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866673    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866676    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866678    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866680    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866683    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866685    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866689    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866691    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866694    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866702    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866705    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866707    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866710    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866712    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 16:01:55.869740 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866715    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866717    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866720    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866740    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866743    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866746    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866748    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866750    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866753    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866755    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866758    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866760    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866764    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866768    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866771    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866774    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866777    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866780    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866782    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866785    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 16:01:55.870227 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866787    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866790    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866792    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866795    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866797    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866802    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866805    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866808    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866817    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866820    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866823    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866826    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866828    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866831    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866834    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866836    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866838    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866841    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866843    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866846    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 16:01:55.870719 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866848    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866851    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866853    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866856    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866858    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866861    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866863    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866866    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866869    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866871    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866873    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866876    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866879    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866881    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866884    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866887    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866891    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866894    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866896    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 16:01:55.871224 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866899    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 16:01:55.871681 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866901    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 16:01:55.871681 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866910    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 16:01:55.871681 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866913    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 16:01:55.871681 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866915    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 16:01:55.871681 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866918    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 16:01:55.871681 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:55.866920    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 16:01:55.871681 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.866925    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 16:01:55.871681 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.867067    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 16:01:55.871681 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.869132    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 16:01:55.871681 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.870131    2562 server.go:1019] "Starting client certificate rotation"
Sep 10 16:01:55.871681 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.870244    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 16:01:55.871681 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.870792    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 16:01:55.872979 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.872966    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 16:01:55.879819 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.879766    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 16:01:55.891252 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.891234    2562 log.go:25] "Validated CRI v1 runtime API"
Sep 10 16:01:55.895489 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.895473    2562 log.go:25] "Validated CRI v1 image API"
Sep 10 16:01:55.896300 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.896286    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 16:01:55.899238 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.899220    2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 abcceb59-05e3-4e62-a9df-0bbebe5341fd:/dev/nvme0n1p3 ffaf8387-f121-438f-855e-2b5f58b367e3:/dev/nvme0n1p4]
Sep 10 16:01:55.899315 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.899236    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 16:01:55.902455 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.902432    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 16:01:55.904431 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.904315    2562 manager.go:216] Machine: {Timestamp:2026-09-10 16:01:55.902984792 +0000 UTC m=+0.315070992 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096704 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec276390ca62f073ce76973b8cb0169e SystemUUID:ec276390-ca62-f073-ce76-973b8cb0169e BootID:6f6fb8d8-d6b6-440c-9750-9d48e24a74ae Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b3:47:73:4d:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b3:47:73:4d:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:9a:7b:56:49:88 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 16:01:55.904431 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.904422    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 16:01:55.904543 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.904497    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 16:01:55.907793 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.907768    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 16:01:55.907937 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.907795    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-43.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 16:01:55.908511 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.908502    2562 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 16:01:55.908542 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.908513    2562 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 16:01:55.908542 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.908520    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 16:01:55.909093 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.909083    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 16:01:55.910198 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.910189    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 16:01:55.912922 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.912911    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 16:01:55.913022 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.913013    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 16:01:55.913068 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.913040    2562 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 16:01:55.913068 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.913051    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 16:01:55.913068 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.913063    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 16:01:55.913201 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.913074    2562 kubelet.go:398] "Adding apiserver pod source"
Sep 10 16:01:55.913201 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.913087    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 16:01:55.913470 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.913460    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 16:01:55.913526 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.913477    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 16:01:55.915703 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.915686    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 16:01:55.917987 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.917972    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 16:01:55.918056 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918002    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 16:01:55.918145 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918135    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 16:01:55.918175 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918149    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 16:01:55.918175 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918155    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 16:01:55.918175 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918161    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 16:01:55.918175 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918169    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 16:01:55.918175 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918175    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 16:01:55.918707 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918698    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 16:01:55.918707 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918707    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 16:01:55.918783 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918714    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 16:01:55.918783 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918719    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 16:01:55.918783 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918740    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 16:01:55.918783 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.918748    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 16:01:55.920386 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.920338    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 16:01:55.920671 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.920651    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 16:01:55.922268 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:55.922226    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-43.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 16:01:55.922434 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:55.922257    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 16:01:55.924781 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.924765    2562 server.go:1268] "Started kubelet"
Sep 10 16:01:55.924881 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.924845    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 16:01:55.924881 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.924845    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 16:01:55.924965 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.924908    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 16:01:55.925035 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.925017    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-43.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 16:01:55.925763 ip-10-0-132-43 systemd[1]: Started Kubernetes Kubelet.
Sep 10 16:01:55.925980 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.925954    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 16:01:55.926057 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.925955    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dtsxs"
Sep 10 16:01:55.926306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.926291    2562 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 16:01:55.929405 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:55.929386    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 16:01:55.930754 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.930719    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 16:01:55.930908 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.930895    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 16:01:55.931622 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:55.931409    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-43.ec2.internal\" not found"
Sep 10 16:01:55.931804 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.931768    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 16:01:55.931804 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.931785    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 16:01:55.931901 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.931862    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 16:01:55.932670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.932655    2562 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 16:01:55.932670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.932669    2562 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 16:01:55.933296 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.933282    2562 factory.go:153] Registering CRI-O factory
Sep 10 16:01:55.933352 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.933298    2562 factory.go:223] Registration of the crio container factory successfully
Sep 10 16:01:55.933352 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.933349    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 16:01:55.933416 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.933356    2562 factory.go:55] Registering systemd factory
Sep 10 16:01:55.933416 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.933362    2562 factory.go:223] Registration of the systemd container factory successfully
Sep 10 16:01:55.933416 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.933373    2562 factory.go:103] Registering Raw factory
Sep 10 16:01:55.933416 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.933382    2562 manager.go:1196] Started watching for new ooms in manager
Sep 10 16:01:55.933622 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.933613    2562 manager.go:349] Starting recovery of all containers
Sep 10 16:01:55.934517 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.934492    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dtsxs"
Sep 10 16:01:55.936736 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:55.936696    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-43.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 16:01:55.936876 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:55.936854    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 16:01:55.937417 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:55.936554    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-43.ec2.internal.18d4010f00ef2163  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-43.ec2.internal,UID:ip-10-0-132-43.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-43.ec2.internal,},FirstTimestamp:2026-09-10 16:01:55.924738403 +0000 UTC m=+0.336824603,LastTimestamp:2026-09-10 16:01:55.924738403 +0000 UTC m=+0.336824603,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-43.ec2.internal,}"
Sep 10 16:01:55.941153 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.941137    2562 manager.go:354] Recovery completed
Sep 10 16:01:55.947395 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.947380    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 16:01:55.949068 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.949050    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 16:01:55.949137 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.949083    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 16:01:55.949137 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.949098    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientPID"
Sep 10 16:01:55.949676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.949663    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 16:01:55.949676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.949675    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 16:01:55.949783 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.949690    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 16:01:55.949783 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.949708    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 16:01:55.950520 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.950503    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 16:01:55.950591 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.950529    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 16:01:55.950591 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.950539    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientPID"
Sep 10 16:01:55.950759 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.950748    2562 policy_none.go:49] "None policy: Start"
Sep 10 16:01:55.950794 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.950762    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 16:01:55.950794 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.950772    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 16:01:55.951807 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.951797    2562 policy_none.go:47] "Start"
Sep 10 16:01:55.977528 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.977513    2562 manager.go:337] "Starting Device Plugin manager"
Sep 10 16:01:55.977617 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:55.977551    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 16:01:55.977617 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.977564    2562 server.go:87] "Starting device plugin registration server"
Sep 10 16:01:55.977866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.977849    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 16:01:55.977944 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.977864    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 16:01:55.978423 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.978051    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 16:01:55.978423 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.978127    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 16:01:55.978423 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:55.978136    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 16:01:55.978637 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:55.978537    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 16:01:55.978637 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:55.978573    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-43.ec2.internal\" not found"
Sep 10 16:01:56.062692 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.062656    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 16:01:56.063942 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.063871    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 16:01:56.063942 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.063924    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 16:01:56.064062 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.063956    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 16:01:56.064062 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.064000    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 16:01:56.066948 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.066926    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 16:01:56.078773 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.078753    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 16:01:56.079618 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.079604    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 16:01:56.079703 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.079637    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 16:01:56.079703 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.079655    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientPID"
Sep 10 16:01:56.079703 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.079685    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.086809 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.086790    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.086875 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.086815    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-43.ec2.internal\": node \"ip-10-0-132-43.ec2.internal\" not found"
Sep 10 16:01:56.103283 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.103211    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-43.ec2.internal\" not found"
Sep 10 16:01:56.165070 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.165026    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-43.ec2.internal"]
Sep 10 16:01:56.165217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.165111    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 16:01:56.166863 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.166842    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 16:01:56.166972 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.166876    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 16:01:56.166972 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.166886    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientPID"
Sep 10 16:01:56.168413 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.168398    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 16:01:56.168502 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.168490    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.168543 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.168519    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 16:01:56.169226 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.169209    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 16:01:56.169309 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.169241    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 16:01:56.169309 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.169253    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientPID"
Sep 10 16:01:56.169309 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.169209    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 16:01:56.169419 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.169321    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 16:01:56.169419 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.169338    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientPID"
Sep 10 16:01:56.170469 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.170452    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.170506 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.170480    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 16:01:56.171249 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.171232    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 16:01:56.171338 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.171264    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 16:01:56.171338 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.171278    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeHasSufficientPID"
Sep 10 16:01:56.185310 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.185292    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-43.ec2.internal\" not found" node="ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.189121 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.189104    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-43.ec2.internal\" not found" node="ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.204329 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.204308    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-43.ec2.internal\" not found"
Sep 10 16:01:56.234496 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.234470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8737f89cceb63fd2f10ea539aa22dbf1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal\" (UID: \"8737f89cceb63fd2f10ea539aa22dbf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.234607 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.234501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8737f89cceb63fd2f10ea539aa22dbf1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal\" (UID: \"8737f89cceb63fd2f10ea539aa22dbf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.234607 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.234519    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c0a1ff402e4c440e263b451c0fbfb11-config\") pod \"kube-apiserver-proxy-ip-10-0-132-43.ec2.internal\" (UID: \"1c0a1ff402e4c440e263b451c0fbfb11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.304980 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.304949    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-43.ec2.internal\" not found"
Sep 10 16:01:56.335277 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.335247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8737f89cceb63fd2f10ea539aa22dbf1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal\" (UID: \"8737f89cceb63fd2f10ea539aa22dbf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.335401 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.335306    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8737f89cceb63fd2f10ea539aa22dbf1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal\" (UID: \"8737f89cceb63fd2f10ea539aa22dbf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.335401 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.335340    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8737f89cceb63fd2f10ea539aa22dbf1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal\" (UID: \"8737f89cceb63fd2f10ea539aa22dbf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.335401 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.335370    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8737f89cceb63fd2f10ea539aa22dbf1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal\" (UID: \"8737f89cceb63fd2f10ea539aa22dbf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.335401 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.335397    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c0a1ff402e4c440e263b451c0fbfb11-config\") pod \"kube-apiserver-proxy-ip-10-0-132-43.ec2.internal\" (UID: \"1c0a1ff402e4c440e263b451c0fbfb11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.335554 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.335429    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c0a1ff402e4c440e263b451c0fbfb11-config\") pod \"kube-apiserver-proxy-ip-10-0-132-43.ec2.internal\" (UID: \"1c0a1ff402e4c440e263b451c0fbfb11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.405598 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.405534    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-43.ec2.internal\" not found"
Sep 10 16:01:56.490877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.490837    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.492061 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.492042    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:56.506551 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.506530    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-43.ec2.internal\" not found"
Sep 10 16:01:56.611521 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.611462    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-43.ec2.internal\" not found"
Sep 10 16:01:56.712389 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.712308    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-43.ec2.internal\" not found"
Sep 10 16:01:56.817797 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.817750    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-43.ec2.internal\" not found"
Sep 10 16:01:56.870357 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.870317    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 16:01:56.870896 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.870484    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 16:01:56.918439 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:56.918397    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-43.ec2.internal\" not found"
Sep 10 16:01:56.937133 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.937094    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 15:56:56 +0000 UTC" deadline="2028-03-15 10:23:12.034425672 +0000 UTC"
Sep 10 16:01:56.937133 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.937125    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13242h21m15.097303856s"
Sep 10 16:01:56.984758 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.984671    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 16:01:56.985849 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:56.985824    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 16:01:57.032190 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.032147    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:57.045771 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.045747    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 16:01:57.047561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.047545    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-43.ec2.internal"
Sep 10 16:01:57.058879 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.058852    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 16:01:57.104721 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.104693    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 16:01:57.156870 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:57.156682    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0a1ff402e4c440e263b451c0fbfb11.slice/crio-6b9a9b069d476dee4b535c6c7b0cf34fd1d1d87d52202a8cde829ecd77d2ce0f WatchSource:0}: Error finding container 6b9a9b069d476dee4b535c6c7b0cf34fd1d1d87d52202a8cde829ecd77d2ce0f: Status 404 returned error can't find the container with id 6b9a9b069d476dee4b535c6c7b0cf34fd1d1d87d52202a8cde829ecd77d2ce0f
Sep 10 16:01:57.157088 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:57.157070    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8737f89cceb63fd2f10ea539aa22dbf1.slice/crio-13d02bd0b4a0818ead1ae242429ee673f1de98fdd6d59c54cbf55ee027d18ce9 WatchSource:0}: Error finding container 13d02bd0b4a0818ead1ae242429ee673f1de98fdd6d59c54cbf55ee027d18ce9: Status 404 returned error can't find the container with id 13d02bd0b4a0818ead1ae242429ee673f1de98fdd6d59c54cbf55ee027d18ce9
Sep 10 16:01:57.161931 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.161914    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 16:01:57.917094 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.917056    2562 apiserver.go:52] "Watching apiserver"
Sep 10 16:01:57.927819 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.927786    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 16:01:57.928297 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.928270    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-4srmx","kube-system/global-pull-secret-syncer-5jnrv","kube-system/konnectivity-agent-dwt9d","kube-system/kube-apiserver-proxy-ip-10-0-132-43.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7","openshift-cluster-node-tuning-operator/tuned-9pp69","openshift-multus/multus-additional-cni-plugins-2zx87","openshift-multus/network-metrics-daemon-pvd2k","openshift-ovn-kubernetes/ovnkube-node-469b9","openshift-image-registry/node-ca-695sv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal","openshift-multus/multus-p28gs","openshift-network-diagnostics/network-check-target-4xw78"]
Sep 10 16:01:57.929918 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.929890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-695sv"
Sep 10 16:01:57.931304 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.931283    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:01:57.931411 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:57.931365    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:01:57.931594 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.931581    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 16:01:57.932450 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.932426    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dwt9d"
Sep 10 16:01:57.933010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.932979    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 16:01:57.933473 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.933335    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nt2cf\""
Sep 10 16:01:57.933473 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.933349    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 16:01:57.933473 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.933370    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 16:01:57.934845 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.934302    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:57.934999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.934979    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 16:01:57.935239 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.935211    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wfqlt\""
Sep 10 16:01:57.936029 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.935644    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 16:01:57.936029 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.935766    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:57.937068 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.937044    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:57.937520 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.937357    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-688sw\""
Sep 10 16:01:57.937772 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.937751    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 16:01:57.937963 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.937939    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 16:01:57.938035 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.937974    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 16:01:57.938363 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.938340    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:01:57.938457 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:57.938414    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:01:57.938633 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.938611    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 16:01:57.938707 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.938682    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lg7rc\""
Sep 10 16:01:57.938946 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.938927    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 16:01:57.940692 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.939923    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:57.941306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.940928    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 16:01:57.941306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.940972    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 16:01:57.941306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.941208    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 16:01:57.941306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.941214    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 16:01:57.941549 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.941402    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fmw4p\""
Sep 10 16:01:57.941549 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.941516    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4srmx"
Sep 10 16:01:57.941654 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.941606    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 16:01:57.943300 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.942866    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 16:01:57.943300 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.942890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p28gs"
Sep 10 16:01:57.944396 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.944158    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:01:57.944396 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:57.944236    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:01:57.945894 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.945021    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 16:01:57.945894 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.945052    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 16:01:57.945894 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.945446    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 16:01:57.946077 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.946001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd09ccc9-f489-4f26-9bb0-823dc02b483a-konnectivity-ca\") pod \"konnectivity-agent-dwt9d\" (UID: \"fd09ccc9-f489-4f26-9bb0-823dc02b483a\") " pod="kube-system/konnectivity-agent-dwt9d"
Sep 10 16:01:57.946077 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.946043    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 16:01:57.946077 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.946053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9286b05-9412-43dc-89c0-9ef8b198a429-host\") pod \"node-ca-695sv\" (UID: \"e9286b05-9412-43dc-89c0-9ef8b198a429\") " pod="openshift-image-registry/node-ca-695sv"
Sep 10 16:01:57.946235 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.946083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9286b05-9412-43dc-89c0-9ef8b198a429-serviceca\") pod \"node-ca-695sv\" (UID: \"e9286b05-9412-43dc-89c0-9ef8b198a429\") " pod="openshift-image-registry/node-ca-695sv"
Sep 10 16:01:57.946235 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.946115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7921cd1d-ec59-489d-944d-57030a1fd6ed-kubelet-config\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:01:57.946340 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.946144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd09ccc9-f489-4f26-9bb0-823dc02b483a-agent-certs\") pod \"konnectivity-agent-dwt9d\" (UID: \"fd09ccc9-f489-4f26-9bb0-823dc02b483a\") " pod="kube-system/konnectivity-agent-dwt9d"
Sep 10 16:01:57.946340 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.946312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75bln\" (UniqueName: \"kubernetes.io/projected/e9286b05-9412-43dc-89c0-9ef8b198a429-kube-api-access-75bln\") pod \"node-ca-695sv\" (UID: \"e9286b05-9412-43dc-89c0-9ef8b198a429\") " pod="openshift-image-registry/node-ca-695sv"
Sep 10 16:01:57.946447 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.946344    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7921cd1d-ec59-489d-944d-57030a1fd6ed-dbus\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:01:57.946447 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.946424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:01:57.946740 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.946707    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 16:01:57.946846 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.946819    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 16:01:57.949439 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.947176    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dk7dz\""
Sep 10 16:01:57.949439 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.947286    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6hhzh\""
Sep 10 16:01:57.949439 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.947583    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 16:01:57.949439 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.947701    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 16:01:57.949439 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.947750    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 16:01:57.949439 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.948420    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 16:01:57.949858 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.949835    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z9t9p\""
Sep 10 16:01:57.988306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.988280    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-thgxj"
Sep 10 16:01:57.998036 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:57.997984    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-thgxj"
Sep 10 16:01:58.034005 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.033851    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 16:01:58.046944 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.046909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.047089 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.046958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-cnibin\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.047089 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.046990    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-multus-conf-dir\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.047089 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047018    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-sysctl-conf\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.047089 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d3abde2-7ce3-4eeb-afdf-610976782c38-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.047089 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-run-openvswitch\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.047375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-kubelet\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.047375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047123    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-run-k8s-cni-cncf-io\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.047375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-run-netns\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.047375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-var-lib-cni-multus\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.047375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047201    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-kubernetes\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.047375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-host\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.047375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-slash\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.047375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-run-multus-certs\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.047375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbkv8\" (UniqueName: \"kubernetes.io/projected/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-kube-api-access-lbkv8\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.047375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047330    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7921cd1d-ec59-489d-944d-57030a1fd6ed-kubelet-config\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:01:58.047375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-sys-fs\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-cni-bin\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-system-cni-dir\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-cni-binary-copy\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d3abde2-7ce3-4eeb-afdf-610976782c38-cni-binary-copy\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-var-lib-cni-bin\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-hostroot\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047548    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d3abde2-7ce3-4eeb-afdf-610976782c38-cnibin\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r829\" (UniqueName: \"kubernetes.io/projected/29d23217-e4bd-450d-afcd-032930e26933-kube-api-access-6r829\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6378f58d-bf7e-465c-b526-706f539d2469-host-slash\") pod \"iptables-alerter-4srmx\" (UID: \"6378f58d-bf7e-465c-b526-706f539d2469\") " pod="openshift-network-operator/iptables-alerter-4srmx"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047633    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-run-systemd\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-etc-selinux\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-run-ovn-kubernetes\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047725    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-cni-netd\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047751    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnrsh\" (UniqueName: \"kubernetes.io/projected/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-kube-api-access-gnrsh\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047777    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-var-lib-kubelet\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.048010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d3abde2-7ce3-4eeb-afdf-610976782c38-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlzhf\" (UniqueName: \"kubernetes.io/projected/8d3abde2-7ce3-4eeb-afdf-610976782c38-kube-api-access-xlzhf\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047895    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7921cd1d-ec59-489d-944d-57030a1fd6ed-dbus\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047922    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-run-ovn\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-multus-daemon-config\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.047971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-tmp\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048008    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-sysctl-d\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048059    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3abde2-7ce3-4eeb-afdf-610976782c38-system-cni-dir\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6jn8\" (UniqueName: \"kubernetes.io/projected/6378f58d-bf7e-465c-b526-706f539d2469-kube-api-access-f6jn8\") pod \"iptables-alerter-4srmx\" (UID: \"6378f58d-bf7e-465c-b526-706f539d2469\") " pod="openshift-network-operator/iptables-alerter-4srmx"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048112    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn96t\" (UniqueName: \"kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t\") pod \"network-check-target-4xw78\" (UID: \"e0f1b108-be29-48e0-abd0-26469f0ecfe0\") " pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd09ccc9-f489-4f26-9bb0-823dc02b483a-konnectivity-ca\") pod \"konnectivity-agent-dwt9d\" (UID: \"fd09ccc9-f489-4f26-9bb0-823dc02b483a\") " pod="kube-system/konnectivity-agent-dwt9d"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048167    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-ovnkube-script-lib\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048220    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-systemd\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6378f58d-bf7e-465c-b526-706f539d2469-iptables-alerter-script\") pod \"iptables-alerter-4srmx\" (UID: \"6378f58d-bf7e-465c-b526-706f539d2469\") " pod="openshift-network-operator/iptables-alerter-4srmx"
Sep 10 16:01:58.048782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9286b05-9412-43dc-89c0-9ef8b198a429-host\") pod \"node-ca-695sv\" (UID: \"e9286b05-9412-43dc-89c0-9ef8b198a429\") " pod="openshift-image-registry/node-ca-695sv"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-socket-dir\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-systemd-units\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-lib-modules\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75bln\" (UniqueName: \"kubernetes.io/projected/e9286b05-9412-43dc-89c0-9ef8b198a429-kube-api-access-75bln\") pod \"node-ca-695sv\" (UID: \"e9286b05-9412-43dc-89c0-9ef8b198a429\") " pod="openshift-image-registry/node-ca-695sv"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-node-log\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-env-overrides\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-multus-socket-dir-parent\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-ovnkube-config\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-ovn-node-metrics-cert\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048715    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9286b05-9412-43dc-89c0-9ef8b198a429-host\") pod \"node-ca-695sv\" (UID: \"e9286b05-9412-43dc-89c0-9ef8b198a429\") " pod="openshift-image-registry/node-ca-695sv"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-multus-cni-dir\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048775    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-run\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42rph\" (UniqueName: \"kubernetes.io/projected/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-kube-api-access-42rph\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048631    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7921cd1d-ec59-489d-944d-57030a1fd6ed-kubelet-config\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-modprobe-d\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048894    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-sysconfig\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.049584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9286b05-9412-43dc-89c0-9ef8b198a429-serviceca\") pod \"node-ca-695sv\" (UID: \"e9286b05-9412-43dc-89c0-9ef8b198a429\") " pod="openshift-image-registry/node-ca-695sv"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-run-netns\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.048983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-var-lib-kubelet\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049028    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7921cd1d-ec59-489d-944d-57030a1fd6ed-dbus\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-log-socket\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.049153    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.049220    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret podName:7921cd1d-ec59-489d-944d-57030a1fd6ed nodeName:}" failed. No retries permitted until 2026-09-10 16:01:58.549189019 +0000 UTC m=+2.961275207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret") pod "global-pull-secret-syncer-5jnrv" (UID: "7921cd1d-ec59-489d-944d-57030a1fd6ed") : object "kube-system"/"original-pull-secret" not registered
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049493    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9286b05-9412-43dc-89c0-9ef8b198a429-serviceca\") pod \"node-ca-695sv\" (UID: \"e9286b05-9412-43dc-89c0-9ef8b198a429\") " pod="openshift-image-registry/node-ca-695sv"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d3abde2-7ce3-4eeb-afdf-610976782c38-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd09ccc9-f489-4f26-9bb0-823dc02b483a-agent-certs\") pod \"konnectivity-agent-dwt9d\" (UID: \"fd09ccc9-f489-4f26-9bb0-823dc02b483a\") " pod="kube-system/konnectivity-agent-dwt9d"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-registration-dir\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8xfb\" (UniqueName: \"kubernetes.io/projected/58a644eb-7a5b-416c-a0f8-fbfe442b373e-kube-api-access-t8xfb\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-var-lib-openvswitch\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049830    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-etc-openvswitch\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-etc-kubernetes\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.050499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049905    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-sys\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.051337 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049929    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-tuned\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.051337 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.049954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-device-dir\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.051337 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.050115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd09ccc9-f489-4f26-9bb0-823dc02b483a-konnectivity-ca\") pod \"konnectivity-agent-dwt9d\" (UID: \"fd09ccc9-f489-4f26-9bb0-823dc02b483a\") " pod="kube-system/konnectivity-agent-dwt9d"
Sep 10 16:01:58.051337 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.050366    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 16:01:58.051658 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.051593    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 16:01:58.055062 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.055036    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd09ccc9-f489-4f26-9bb0-823dc02b483a-agent-certs\") pod \"konnectivity-agent-dwt9d\" (UID: \"fd09ccc9-f489-4f26-9bb0-823dc02b483a\") " pod="kube-system/konnectivity-agent-dwt9d"
Sep 10 16:01:58.061223 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.061194    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75bln\" (UniqueName: \"kubernetes.io/projected/e9286b05-9412-43dc-89c0-9ef8b198a429-kube-api-access-75bln\") pod \"node-ca-695sv\" (UID: \"e9286b05-9412-43dc-89c0-9ef8b198a429\") " pod="openshift-image-registry/node-ca-695sv"
Sep 10 16:01:58.070696 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.070641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-43.ec2.internal" event={"ID":"1c0a1ff402e4c440e263b451c0fbfb11","Type":"ContainerStarted","Data":"6b9a9b069d476dee4b535c6c7b0cf34fd1d1d87d52202a8cde829ecd77d2ce0f"}
Sep 10 16:01:58.073850 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.073793    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal" event={"ID":"8737f89cceb63fd2f10ea539aa22dbf1","Type":"ContainerStarted","Data":"13d02bd0b4a0818ead1ae242429ee673f1de98fdd6d59c54cbf55ee027d18ce9"}
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.150911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-socket-dir\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.150952    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-systemd-units\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.150975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-lib-modules\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-node-log\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-env-overrides\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151062    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-multus-socket-dir-parent\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-ovnkube-config\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151102    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-systemd-units\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-ovn-node-metrics-cert\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-multus-cni-dir\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151145    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-socket-dir\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-run\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151175    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-multus-socket-dir-parent\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151170    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-lib-modules\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151203    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42rph\" (UniqueName: \"kubernetes.io/projected/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-kube-api-access-42rph\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151211    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-run\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.151251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151254    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-node-log\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151257    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-multus-cni-dir\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-modprobe-d\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-sysconfig\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151363    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-run-netns\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151814    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-env-overrides\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-var-lib-kubelet\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-log-socket\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151902    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-modprobe-d\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151914    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d3abde2-7ce3-4eeb-afdf-610976782c38-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151944    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-registration-dir\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151951    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-var-lib-kubelet\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8xfb\" (UniqueName: \"kubernetes.io/projected/58a644eb-7a5b-416c-a0f8-fbfe442b373e-kube-api-access-t8xfb\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-var-lib-openvswitch\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151993    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-run-netns\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-etc-openvswitch\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-etc-kubernetes\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.152246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-sys\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152044    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-var-lib-openvswitch\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-tuned\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-device-dir\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-cnibin\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152179    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-multus-conf-dir\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.151917    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-sysconfig\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-sysctl-conf\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-log-socket\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d3abde2-7ce3-4eeb-afdf-610976782c38-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152272    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-etc-openvswitch\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152282    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-run-openvswitch\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-kubelet\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-run-k8s-cni-cncf-io\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152335    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-registration-dir\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152375    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-multus-conf-dir\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.153121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152407    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-run-netns\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-var-lib-cni-multus\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-kubernetes\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152497    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-host\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152491    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-sysctl-conf\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-slash\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-run-multus-certs\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152553    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d3abde2-7ce3-4eeb-afdf-610976782c38-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbkv8\" (UniqueName: \"kubernetes.io/projected/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-kube-api-access-lbkv8\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-sys-fs\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152612    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-kubelet\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152630    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-cni-bin\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-system-cni-dir\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152657    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-run-openvswitch\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152684    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-cni-binary-copy\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d3abde2-7ce3-4eeb-afdf-610976782c38-cni-binary-copy\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-var-lib-cni-bin\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152746    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-kubernetes\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.153999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-hostroot\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152785    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-etc-kubernetes\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d3abde2-7ce3-4eeb-afdf-610976782c38-cnibin\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152856    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-slash\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-host\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-run-multus-certs\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152920    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r829\" (UniqueName: \"kubernetes.io/projected/29d23217-e4bd-450d-afcd-032930e26933-kube-api-access-6r829\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.152983    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d3abde2-7ce3-4eeb-afdf-610976782c38-cnibin\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.153026    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-run-netns\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.153033    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-sys-fs\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.154698    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-ovnkube-config\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.154782    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-system-cni-dir\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.154828    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-var-lib-cni-multus\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.154894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6378f58d-bf7e-465c-b526-706f539d2469-host-slash\") pod \"iptables-alerter-4srmx\" (UID: \"6378f58d-bf7e-465c-b526-706f539d2469\") " pod="openshift-network-operator/iptables-alerter-4srmx"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.154931    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-run-systemd\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.154962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.154958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-etc-selinux\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.154993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-run-ovn-kubernetes\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155026    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-cni-netd\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnrsh\" (UniqueName: \"kubernetes.io/projected/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-kube-api-access-gnrsh\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155066    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d3abde2-7ce3-4eeb-afdf-610976782c38-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155095    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-var-lib-kubelet\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d3abde2-7ce3-4eeb-afdf-610976782c38-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155409    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-cni-bin\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlzhf\" (UniqueName: \"kubernetes.io/projected/8d3abde2-7ce3-4eeb-afdf-610976782c38-kube-api-access-xlzhf\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155475    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-run-ovn\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155508    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-multus-daemon-config\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-tmp\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155610    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-sysctl-d\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.155676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3abde2-7ce3-4eeb-afdf-610976782c38-system-cni-dir\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.156418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155731    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d3abde2-7ce3-4eeb-afdf-610976782c38-cni-binary-copy\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.156418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155675    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6jn8\" (UniqueName: \"kubernetes.io/projected/6378f58d-bf7e-465c-b526-706f539d2469-kube-api-access-f6jn8\") pod \"iptables-alerter-4srmx\" (UID: \"6378f58d-bf7e-465c-b526-706f539d2469\") " pod="openshift-network-operator/iptables-alerter-4srmx"
Sep 10 16:01:58.156418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155937    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-var-lib-cni-bin\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.156418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.155371    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6378f58d-bf7e-465c-b526-706f539d2469-host-slash\") pod \"iptables-alerter-4srmx\" (UID: \"6378f58d-bf7e-465c-b526-706f539d2469\") " pod="openshift-network-operator/iptables-alerter-4srmx"
Sep 10 16:01:58.156418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.156004    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-var-lib-kubelet\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.156418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.156051    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-run-systemd\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.156418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.156230    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-run-ovn\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.156777 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.156600    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-cni-binary-copy\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.156777 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.156647    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn96t\" (UniqueName: \"kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t\") pod \"network-check-target-4xw78\" (UID: \"e0f1b108-be29-48e0-abd0-26469f0ecfe0\") " pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:01:58.156777 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.156689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.156777 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.156720    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-ovnkube-script-lib\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.156777 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.156746    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-systemd\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.156777 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.156777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6378f58d-bf7e-465c-b526-706f539d2469-iptables-alerter-script\") pod \"iptables-alerter-4srmx\" (UID: \"6378f58d-bf7e-465c-b526-706f539d2469\") " pod="openshift-network-operator/iptables-alerter-4srmx"
Sep 10 16:01:58.157447 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.157290    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-multus-daemon-config\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.157447 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.157369    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6378f58d-bf7e-465c-b526-706f539d2469-iptables-alerter-script\") pod \"iptables-alerter-4srmx\" (UID: \"6378f58d-bf7e-465c-b526-706f539d2469\") " pod="openshift-network-operator/iptables-alerter-4srmx"
Sep 10 16:01:58.157604 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.157553    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.158469 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.157855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-hostroot\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.158469 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.157973    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-etc-selinux\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.158469 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.158062    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 16:01:58.158469 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.158131    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs podName:29d23217-e4bd-450d-afcd-032930e26933 nodeName:}" failed. No retries permitted until 2026-09-10 16:01:58.65811234 +0000 UTC m=+3.070198537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs") pod "network-metrics-daemon-pvd2k" (UID: "29d23217-e4bd-450d-afcd-032930e26933") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 16:01:58.158469 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.158166    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-ovn-node-metrics-cert\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.158780 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.158470    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-cni-netd\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.158780 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.158721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58a644eb-7a5b-416c-a0f8-fbfe442b373e-device-dir\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.158937 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.158779    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-run-ovn-kubernetes\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.158937 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.158841    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-tmp\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.158937 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.158860    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-sys\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.158937 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.158906    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.159144 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.158946    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-cnibin\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.159144 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.158948    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d3abde2-7ce3-4eeb-afdf-610976782c38-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.159144 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.158959    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-sysctl-d\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.159144 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.158956    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-systemd\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.159144 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.158990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-host-run-k8s-cni-cncf-io\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.159144 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.159010    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d3abde2-7ce3-4eeb-afdf-610976782c38-system-cni-dir\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.159428 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.159162    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-etc-tuned\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.161293 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.160832    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-ovnkube-script-lib\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.167551 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.166933    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8xfb\" (UniqueName: \"kubernetes.io/projected/58a644eb-7a5b-416c-a0f8-fbfe442b373e-kube-api-access-t8xfb\") pod \"aws-ebs-csi-driver-node-cm6d7\" (UID: \"58a644eb-7a5b-416c-a0f8-fbfe442b373e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.168192 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.167861    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42rph\" (UniqueName: \"kubernetes.io/projected/e034499c-3d7b-4e4a-9d3a-cba1eda4eafa-kube-api-access-42rph\") pod \"tuned-9pp69\" (UID: \"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa\") " pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.169679 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.169320    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 16:01:58.169679 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.169344    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 16:01:58.169679 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.169360    2562 projected.go:196] Error preparing data for projected volume kube-api-access-sn96t for pod openshift-network-diagnostics/network-check-target-4xw78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 16:01:58.169679 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.169425    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t podName:e0f1b108-be29-48e0-abd0-26469f0ecfe0 nodeName:}" failed. No retries permitted until 2026-09-10 16:01:58.66940517 +0000 UTC m=+3.081491358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sn96t" (UniqueName: "kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t") pod "network-check-target-4xw78" (UID: "e0f1b108-be29-48e0-abd0-26469f0ecfe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 16:01:58.169679 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.169635    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbkv8\" (UniqueName: \"kubernetes.io/projected/7cf110d0-37d7-44fb-a5c0-2e717f5286e1-kube-api-access-lbkv8\") pod \"multus-p28gs\" (UID: \"7cf110d0-37d7-44fb-a5c0-2e717f5286e1\") " pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.178149 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.177828    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnrsh\" (UniqueName: \"kubernetes.io/projected/4ff34241-c13b-4ff9-bfd0-59aa3ce34c83-kube-api-access-gnrsh\") pod \"ovnkube-node-469b9\" (UID: \"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83\") " pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.178149 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.177847    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6jn8\" (UniqueName: \"kubernetes.io/projected/6378f58d-bf7e-465c-b526-706f539d2469-kube-api-access-f6jn8\") pod \"iptables-alerter-4srmx\" (UID: \"6378f58d-bf7e-465c-b526-706f539d2469\") " pod="openshift-network-operator/iptables-alerter-4srmx"
Sep 10 16:01:58.178149 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.177956    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r829\" (UniqueName: \"kubernetes.io/projected/29d23217-e4bd-450d-afcd-032930e26933-kube-api-access-6r829\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:01:58.179156 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.179119    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlzhf\" (UniqueName: \"kubernetes.io/projected/8d3abde2-7ce3-4eeb-afdf-610976782c38-kube-api-access-xlzhf\") pod \"multus-additional-cni-plugins-2zx87\" (UID: \"8d3abde2-7ce3-4eeb-afdf-610976782c38\") " pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.246348 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.246307    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-695sv"
Sep 10 16:01:58.255597 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.255562    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dwt9d"
Sep 10 16:01:58.265259 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.265236    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7"
Sep 10 16:01:58.272322 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.272300    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9pp69"
Sep 10 16:01:58.279898 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.279877    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2zx87"
Sep 10 16:01:58.286913 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.286891    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:01:58.295851 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.295824    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4srmx"
Sep 10 16:01:58.303093 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.303071    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p28gs"
Sep 10 16:01:58.436895 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:58.436864    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf110d0_37d7_44fb_a5c0_2e717f5286e1.slice/crio-fd5b90ca5a41396b31cc2488a14e0991dfc12d01d4acac3bfdcd8f9cd1c42c5d WatchSource:0}: Error finding container fd5b90ca5a41396b31cc2488a14e0991dfc12d01d4acac3bfdcd8f9cd1c42c5d: Status 404 returned error can't find the container with id fd5b90ca5a41396b31cc2488a14e0991dfc12d01d4acac3bfdcd8f9cd1c42c5d
Sep 10 16:01:58.437366 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:58.437344    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9286b05_9412_43dc_89c0_9ef8b198a429.slice/crio-cc445673735bbe534750fc14920d0fe536bc1cccdcee241ed7a67fd72cd94c30 WatchSource:0}: Error finding container cc445673735bbe534750fc14920d0fe536bc1cccdcee241ed7a67fd72cd94c30: Status 404 returned error can't find the container with id cc445673735bbe534750fc14920d0fe536bc1cccdcee241ed7a67fd72cd94c30
Sep 10 16:01:58.442789 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:58.442764    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd09ccc9_f489_4f26_9bb0_823dc02b483a.slice/crio-afd5f116c1e92c56541e76160c20f992f17232b6128f67ceb46eca06b875bfa6 WatchSource:0}: Error finding container afd5f116c1e92c56541e76160c20f992f17232b6128f67ceb46eca06b875bfa6: Status 404 returned error can't find the container with id afd5f116c1e92c56541e76160c20f992f17232b6128f67ceb46eca06b875bfa6
Sep 10 16:01:58.443511 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:58.443484    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a644eb_7a5b_416c_a0f8_fbfe442b373e.slice/crio-fc6fd5b100a1d120b6d6946d462b2b17ffd80902dd946bb94e357fd30db63eb1 WatchSource:0}: Error finding container fc6fd5b100a1d120b6d6946d462b2b17ffd80902dd946bb94e357fd30db63eb1: Status 404 returned error can't find the container with id fc6fd5b100a1d120b6d6946d462b2b17ffd80902dd946bb94e357fd30db63eb1
Sep 10 16:01:58.444151 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:58.444095    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6378f58d_bf7e_465c_b526_706f539d2469.slice/crio-fab587367ad39ec0c66e14f5848c39e8e021c5a1b20a09e2186950218ee2a993 WatchSource:0}: Error finding container fab587367ad39ec0c66e14f5848c39e8e021c5a1b20a09e2186950218ee2a993: Status 404 returned error can't find the container with id fab587367ad39ec0c66e14f5848c39e8e021c5a1b20a09e2186950218ee2a993
Sep 10 16:01:58.445093 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:58.445073    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode034499c_3d7b_4e4a_9d3a_cba1eda4eafa.slice/crio-7d5bfd72f10dfc58b6100efb3f5f7cf5ce741cb723e41b4876a05cbb593a86c1 WatchSource:0}: Error finding container 7d5bfd72f10dfc58b6100efb3f5f7cf5ce741cb723e41b4876a05cbb593a86c1: Status 404 returned error can't find the container with id 7d5bfd72f10dfc58b6100efb3f5f7cf5ce741cb723e41b4876a05cbb593a86c1
Sep 10 16:01:58.446912 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:58.446890    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff34241_c13b_4ff9_bfd0_59aa3ce34c83.slice/crio-121aa23459923bf01c91772735aff1b6d2a8ccd03a2128372568e232507bd477 WatchSource:0}: Error finding container 121aa23459923bf01c91772735aff1b6d2a8ccd03a2128372568e232507bd477: Status 404 returned error can't find the container with id 121aa23459923bf01c91772735aff1b6d2a8ccd03a2128372568e232507bd477
Sep 10 16:01:58.448197 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:01:58.448175    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3abde2_7ce3_4eeb_afdf_610976782c38.slice/crio-702a4faf0b11051e5d67a6d0e44a2dce9494229beece6070b86178f9e2def4d2 WatchSource:0}: Error finding container 702a4faf0b11051e5d67a6d0e44a2dce9494229beece6070b86178f9e2def4d2: Status 404 returned error can't find the container with id 702a4faf0b11051e5d67a6d0e44a2dce9494229beece6070b86178f9e2def4d2
Sep 10 16:01:58.559878 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.559839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:01:58.560053 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.560013    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 16:01:58.560117 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.560092    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret podName:7921cd1d-ec59-489d-944d-57030a1fd6ed nodeName:}" failed. No retries permitted until 2026-09-10 16:01:59.560069893 +0000 UTC m=+3.972156090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret") pod "global-pull-secret-syncer-5jnrv" (UID: "7921cd1d-ec59-489d-944d-57030a1fd6ed") : object "kube-system"/"original-pull-secret" not registered
Sep 10 16:01:58.661057 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.661018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:01:58.661252 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.661159    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 16:01:58.661252 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.661224    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs podName:29d23217-e4bd-450d-afcd-032930e26933 nodeName:}" failed. No retries permitted until 2026-09-10 16:01:59.661210024 +0000 UTC m=+4.073296213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs") pod "network-metrics-daemon-pvd2k" (UID: "29d23217-e4bd-450d-afcd-032930e26933") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 16:01:58.761895 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:58.761857    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn96t\" (UniqueName: \"kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t\") pod \"network-check-target-4xw78\" (UID: \"e0f1b108-be29-48e0-abd0-26469f0ecfe0\") " pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:01:58.762081 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.762051    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 16:01:58.762081 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.762076    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 16:01:58.762203 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.762091    2562 projected.go:196] Error preparing data for projected volume kube-api-access-sn96t for pod openshift-network-diagnostics/network-check-target-4xw78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 16:01:58.762203 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:58.762161    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t podName:e0f1b108-be29-48e0-abd0-26469f0ecfe0 nodeName:}" failed. No retries permitted until 2026-09-10 16:01:59.762139657 +0000 UTC m=+4.174225860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sn96t" (UniqueName: "kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t") pod "network-check-target-4xw78" (UID: "e0f1b108-be29-48e0-abd0-26469f0ecfe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 16:01:59.000927 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.000874    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:56:58 +0000 UTC" deadline="2028-04-26 13:02:16.850170637 +0000 UTC"
Sep 10 16:01:59.000927 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.000917    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14253h0m17.849258764s"
Sep 10 16:01:59.064770 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.064643    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:01:59.064935 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:59.064773    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:01:59.064935 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.064843    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:01:59.065050 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:59.064982    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:01:59.077152 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.077118    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx87" event={"ID":"8d3abde2-7ce3-4eeb-afdf-610976782c38","Type":"ContainerStarted","Data":"702a4faf0b11051e5d67a6d0e44a2dce9494229beece6070b86178f9e2def4d2"}
Sep 10 16:01:59.078538 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.078505    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-469b9" event={"ID":"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83","Type":"ContainerStarted","Data":"121aa23459923bf01c91772735aff1b6d2a8ccd03a2128372568e232507bd477"}
Sep 10 16:01:59.079861 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.079832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7" event={"ID":"58a644eb-7a5b-416c-a0f8-fbfe442b373e","Type":"ContainerStarted","Data":"fc6fd5b100a1d120b6d6946d462b2b17ffd80902dd946bb94e357fd30db63eb1"}
Sep 10 16:01:59.081249 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.081226    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dwt9d" event={"ID":"fd09ccc9-f489-4f26-9bb0-823dc02b483a","Type":"ContainerStarted","Data":"afd5f116c1e92c56541e76160c20f992f17232b6128f67ceb46eca06b875bfa6"}
Sep 10 16:01:59.082580 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.082549    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-695sv" event={"ID":"e9286b05-9412-43dc-89c0-9ef8b198a429","Type":"ContainerStarted","Data":"cc445673735bbe534750fc14920d0fe536bc1cccdcee241ed7a67fd72cd94c30"}
Sep 10 16:01:59.083830 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.083794    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9pp69" event={"ID":"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa","Type":"ContainerStarted","Data":"7d5bfd72f10dfc58b6100efb3f5f7cf5ce741cb723e41b4876a05cbb593a86c1"}
Sep 10 16:01:59.085104 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.085073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4srmx" event={"ID":"6378f58d-bf7e-465c-b526-706f539d2469","Type":"ContainerStarted","Data":"fab587367ad39ec0c66e14f5848c39e8e021c5a1b20a09e2186950218ee2a993"}
Sep 10 16:01:59.086371 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.086346    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p28gs" event={"ID":"7cf110d0-37d7-44fb-a5c0-2e717f5286e1","Type":"ContainerStarted","Data":"fd5b90ca5a41396b31cc2488a14e0991dfc12d01d4acac3bfdcd8f9cd1c42c5d"}
Sep 10 16:01:59.567670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.567624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:01:59.567869 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:59.567807    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 16:01:59.567944 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:59.567876    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret podName:7921cd1d-ec59-489d-944d-57030a1fd6ed nodeName:}" failed. No retries permitted until 2026-09-10 16:02:01.567855405 +0000 UTC m=+5.979941609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret") pod "global-pull-secret-syncer-5jnrv" (UID: "7921cd1d-ec59-489d-944d-57030a1fd6ed") : object "kube-system"/"original-pull-secret" not registered
Sep 10 16:01:59.668341 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.668288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:01:59.668536 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:59.668445    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 16:01:59.668536 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:59.668522    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs podName:29d23217-e4bd-450d-afcd-032930e26933 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:01.66850067 +0000 UTC m=+6.080586877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs") pod "network-metrics-daemon-pvd2k" (UID: "29d23217-e4bd-450d-afcd-032930e26933") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 16:01:59.769330 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:01:59.769284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn96t\" (UniqueName: \"kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t\") pod \"network-check-target-4xw78\" (UID: \"e0f1b108-be29-48e0-abd0-26469f0ecfe0\") " pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:01:59.769529 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:59.769481    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 16:01:59.769529 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:59.769501    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 16:01:59.769529 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:59.769514    2562 projected.go:196] Error preparing data for projected volume kube-api-access-sn96t for pod openshift-network-diagnostics/network-check-target-4xw78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 16:01:59.769711 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:01:59.769576    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t podName:e0f1b108-be29-48e0-abd0-26469f0ecfe0 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:01.769556185 +0000 UTC m=+6.181642401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sn96t" (UniqueName: "kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t") pod "network-check-target-4xw78" (UID: "e0f1b108-be29-48e0-abd0-26469f0ecfe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 16:02:00.001356 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:00.001310    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:56:58 +0000 UTC" deadline="2028-03-27 19:01:34.106369945 +0000 UTC"
Sep 10 16:02:00.001356 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:00.001345    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13538h59m34.105029238s"
Sep 10 16:02:00.078980 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:00.077852    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:00.078980 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:00.078033    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:00.102564 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:00.102528    2562 generic.go:356] "Generic (PLEG): container finished" podID="8737f89cceb63fd2f10ea539aa22dbf1" containerID="876484918a95299dc656bc61f5375e3f290566ad987b44f246b81e35fbd36af8" exitCode=0
Sep 10 16:02:00.102749 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:00.102618    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal" event={"ID":"8737f89cceb63fd2f10ea539aa22dbf1","Type":"ContainerDied","Data":"876484918a95299dc656bc61f5375e3f290566ad987b44f246b81e35fbd36af8"}
Sep 10 16:02:00.106796 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:00.106743    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-43.ec2.internal" event={"ID":"1c0a1ff402e4c440e263b451c0fbfb11","Type":"ContainerStarted","Data":"08f4f219b7f5df70469343c5ee4cf68957b356e39d713ce5e831a7f03b6c8f02"}
Sep 10 16:02:01.064448 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:01.064153    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:01.064921 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:01.064172    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:01.064921 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:01.064530    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:01.064921 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:01.064629    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:01.120875 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:01.120782    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal" event={"ID":"8737f89cceb63fd2f10ea539aa22dbf1","Type":"ContainerStarted","Data":"9cc4c6515901d1819332e9d63baba6143abddc3d91b5733316700c6073dfb112"}
Sep 10 16:02:01.140325 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:01.139925    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-43.ec2.internal" podStartSLOduration=4.139904597 podStartE2EDuration="4.139904597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:00.142104475 +0000 UTC m=+4.554190688" watchObservedRunningTime="2026-09-10 16:02:01.139904597 +0000 UTC m=+5.551990808"
Sep 10 16:02:01.590748 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:01.590695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:01.590951 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:01.590882    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 16:02:01.590951 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:01.590942    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret podName:7921cd1d-ec59-489d-944d-57030a1fd6ed nodeName:}" failed. No retries permitted until 2026-09-10 16:02:05.590924949 +0000 UTC m=+10.003011143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret") pod "global-pull-secret-syncer-5jnrv" (UID: "7921cd1d-ec59-489d-944d-57030a1fd6ed") : object "kube-system"/"original-pull-secret" not registered
Sep 10 16:02:01.691929 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:01.691307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:01.691929 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:01.691524    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 16:02:01.691929 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:01.691585    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs podName:29d23217-e4bd-450d-afcd-032930e26933 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:05.691567328 +0000 UTC m=+10.103653518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs") pod "network-metrics-daemon-pvd2k" (UID: "29d23217-e4bd-450d-afcd-032930e26933") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 16:02:01.792757 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:01.792382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn96t\" (UniqueName: \"kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t\") pod \"network-check-target-4xw78\" (UID: \"e0f1b108-be29-48e0-abd0-26469f0ecfe0\") " pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:01.792757 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:01.792569    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 16:02:01.792757 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:01.792587    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 16:02:01.792757 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:01.792600    2562 projected.go:196] Error preparing data for projected volume kube-api-access-sn96t for pod openshift-network-diagnostics/network-check-target-4xw78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 16:02:01.792757 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:01.792655    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t podName:e0f1b108-be29-48e0-abd0-26469f0ecfe0 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:05.792637121 +0000 UTC m=+10.204723328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sn96t" (UniqueName: "kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t") pod "network-check-target-4xw78" (UID: "e0f1b108-be29-48e0-abd0-26469f0ecfe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 16:02:02.066128 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:02.066095    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:02.066604 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:02.066240    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:03.065149 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:03.064831    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:03.065149 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:03.064881    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:03.065149 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:03.064973    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:03.065149 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:03.065070    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:04.065880 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:04.065845    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:04.066318 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:04.066001    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:05.064931 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:05.064899    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:05.065104 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:05.065026    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:05.065104 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:05.065061    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:05.065243 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:05.065189    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:05.623494 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:05.623433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:05.623970 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:05.623555    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 16:02:05.623970 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:05.623627    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret podName:7921cd1d-ec59-489d-944d-57030a1fd6ed nodeName:}" failed. No retries permitted until 2026-09-10 16:02:13.623606182 +0000 UTC m=+18.035692388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret") pod "global-pull-secret-syncer-5jnrv" (UID: "7921cd1d-ec59-489d-944d-57030a1fd6ed") : object "kube-system"/"original-pull-secret" not registered
Sep 10 16:02:05.725078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:05.724518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:05.725078 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:05.724666    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 16:02:05.725078 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:05.724741    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs podName:29d23217-e4bd-450d-afcd-032930e26933 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:13.724706513 +0000 UTC m=+18.136792707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs") pod "network-metrics-daemon-pvd2k" (UID: "29d23217-e4bd-450d-afcd-032930e26933") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 16:02:05.825101 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:05.825064    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn96t\" (UniqueName: \"kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t\") pod \"network-check-target-4xw78\" (UID: \"e0f1b108-be29-48e0-abd0-26469f0ecfe0\") " pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:05.825288 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:05.825214    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 16:02:05.825288 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:05.825230    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 16:02:05.825288 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:05.825243    2562 projected.go:196] Error preparing data for projected volume kube-api-access-sn96t for pod openshift-network-diagnostics/network-check-target-4xw78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 16:02:05.825454 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:05.825295    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t podName:e0f1b108-be29-48e0-abd0-26469f0ecfe0 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:13.825279347 +0000 UTC m=+18.237365551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sn96t" (UniqueName: "kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t") pod "network-check-target-4xw78" (UID: "e0f1b108-be29-48e0-abd0-26469f0ecfe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 16:02:06.066063 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:06.066030    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:06.066211 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:06.066141    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:07.064505 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:07.064472    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:07.064934 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:07.064596    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:07.064934 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:07.064773    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:07.064934 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:07.064887    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:08.064604 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:08.064571    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:08.065064 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:08.064702    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:09.064736 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:09.064702    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:09.065203 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:09.064707    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:09.065203 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:09.064947    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:09.065203 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:09.064815    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:10.068187 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:10.068159    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:10.068627 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:10.068265    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:11.064284 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:11.064246    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:11.064446 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:11.064297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:11.064446 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:11.064380    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:11.064547 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:11.064508    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:12.064788 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:12.064758    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:12.065141 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:12.064871    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:13.064402 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:13.064373    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:13.064631 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:13.064376    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:13.064631 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:13.064475    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:13.064631 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:13.064590    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:13.673943 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:13.673914    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:13.674333 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:13.674057    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 16:02:13.674333 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:13.674125    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret podName:7921cd1d-ec59-489d-944d-57030a1fd6ed nodeName:}" failed. No retries permitted until 2026-09-10 16:02:29.674102814 +0000 UTC m=+34.086189023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret") pod "global-pull-secret-syncer-5jnrv" (UID: "7921cd1d-ec59-489d-944d-57030a1fd6ed") : object "kube-system"/"original-pull-secret" not registered
Sep 10 16:02:13.774809 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:13.774780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:13.774989 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:13.774869    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 16:02:13.774989 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:13.774926    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs podName:29d23217-e4bd-450d-afcd-032930e26933 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:29.774909909 +0000 UTC m=+34.186996096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs") pod "network-metrics-daemon-pvd2k" (UID: "29d23217-e4bd-450d-afcd-032930e26933") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 16:02:13.875194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:13.875161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn96t\" (UniqueName: \"kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t\") pod \"network-check-target-4xw78\" (UID: \"e0f1b108-be29-48e0-abd0-26469f0ecfe0\") " pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:13.875376 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:13.875286    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 16:02:13.875376 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:13.875309    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 16:02:13.875376 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:13.875319    2562 projected.go:196] Error preparing data for projected volume kube-api-access-sn96t for pod openshift-network-diagnostics/network-check-target-4xw78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 16:02:13.875376 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:13.875367    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t podName:e0f1b108-be29-48e0-abd0-26469f0ecfe0 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:29.875351751 +0000 UTC m=+34.287437957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sn96t" (UniqueName: "kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t") pod "network-check-target-4xw78" (UID: "e0f1b108-be29-48e0-abd0-26469f0ecfe0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 16:02:14.064612 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:14.064578    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:14.064800 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:14.064709    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:15.064498 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:15.064460    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:15.064950 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:15.064609    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:15.064950 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:15.064667    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:15.064950 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:15.064805    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:16.069082 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:16.069059    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:16.069443 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:16.069176    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:16.152479 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:16.152451    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dwt9d" event={"ID":"fd09ccc9-f489-4f26-9bb0-823dc02b483a","Type":"ContainerStarted","Data":"f93d93b570c9c29c3e890342926858e3190a9c4097ab89eb892422a330972f37"}
Sep 10 16:02:16.154273 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:16.154249    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-695sv" event={"ID":"e9286b05-9412-43dc-89c0-9ef8b198a429","Type":"ContainerStarted","Data":"bf49879b42a6ca8f7f82dad90a02e4d35c6d843eb07ee68386bf1a3d2613fa13"}
Sep 10 16:02:16.175675 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:16.175635    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-43.ec2.internal" podStartSLOduration=19.175620113 podStartE2EDuration="19.175620113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:01.140383721 +0000 UTC m=+5.552469960" watchObservedRunningTime="2026-09-10 16:02:16.175620113 +0000 UTC m=+20.587706314"
Sep 10 16:02:16.175900 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:16.175876    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dwt9d" podStartSLOduration=6.764914046 podStartE2EDuration="20.175869436s" totalImagesPullingTime="13.41095539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:16.175075633 +0000 UTC m=+20.587161843" watchObservedRunningTime="2026-09-10 16:02:16.175869436 +0000 UTC m=+20.587955645"
Sep 10 16:02:17.064763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.064543    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:17.064859 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.064550    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:17.064920 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:17.064861    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:17.065018 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:17.064998    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:17.159758 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.159706    2562 generic.go:356] "Generic (PLEG): container finished" podID="8d3abde2-7ce3-4eeb-afdf-610976782c38" containerID="d08db1928a9a2a112404f8cec8fa969765e6f17d70ec06544ed604d768849913" exitCode=0
Sep 10 16:02:17.160408 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.159799    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx87" event={"ID":"8d3abde2-7ce3-4eeb-afdf-610976782c38","Type":"ContainerDied","Data":"d08db1928a9a2a112404f8cec8fa969765e6f17d70ec06544ed604d768849913"}
Sep 10 16:02:17.164103 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.164081    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-469b9" event={"ID":"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83","Type":"ContainerStarted","Data":"c627e3418b83a70926a2cdd1f02544a122c14011d2ccc72e04cacd9131144606"}
Sep 10 16:02:17.164193 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.164156    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-469b9" event={"ID":"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83","Type":"ContainerStarted","Data":"cc5a0214953d2805fde2bdcfd540782368925edd924d81379c955579ca527295"}
Sep 10 16:02:17.164248 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.164206    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-469b9" event={"ID":"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83","Type":"ContainerStarted","Data":"73135cd80cbcac5b492dfaa8443580aae2e30500f92b6cfdaeb3278351c5244a"}
Sep 10 16:02:17.164310 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.164255    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-469b9" event={"ID":"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83","Type":"ContainerStarted","Data":"89f963f2d67d636d1a60033f796088f098b541ff40015ffa8577123f885b68be"}
Sep 10 16:02:17.164310 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.164302    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-469b9" event={"ID":"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83","Type":"ContainerStarted","Data":"239bc61c663a6b108ff87a0c4312fbc9034c94f5ea37eceb7fe4680a2fdb096b"}
Sep 10 16:02:17.164411 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.164348    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-469b9" event={"ID":"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83","Type":"ContainerStarted","Data":"3315f9bebfd023d04b11d74804547b50b4b6112086c6b168a862cad6eb9c9a76"}
Sep 10 16:02:17.165783 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.165759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7" event={"ID":"58a644eb-7a5b-416c-a0f8-fbfe442b373e","Type":"ContainerStarted","Data":"7e0815e04dabf81af631d9163152e7fada55e6d6e3105429519b7878d6a73118"}
Sep 10 16:02:17.167443 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.167420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9pp69" event={"ID":"e034499c-3d7b-4e4a-9d3a-cba1eda4eafa","Type":"ContainerStarted","Data":"d7cd9405efbd6df71f5e81154b7c20d488cba289c0e8cf96ef9ada5685f5fcca"}
Sep 10 16:02:17.169207 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.169182    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4srmx" event={"ID":"6378f58d-bf7e-465c-b526-706f539d2469","Type":"ContainerStarted","Data":"bc301584b78a5220c4d082fdebb5d047d69b38fe458b1c13a8f6ea4be3a94516"}
Sep 10 16:02:17.171409 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.171387    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p28gs" event={"ID":"7cf110d0-37d7-44fb-a5c0-2e717f5286e1","Type":"ContainerStarted","Data":"6026ca1ff4ebbd6e331136ccc837bdc8f23fd0f8016aaa4a3341c4c87065e5c3"}
Sep 10 16:02:17.186255 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.186214    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-695sv" podStartSLOduration=3.6717667819999997 podStartE2EDuration="21.186200858s" totalImagesPullingTime="17.514434076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:16.198718881 +0000 UTC m=+20.610805120" watchObservedRunningTime="2026-09-10 16:02:17.186200858 +0000 UTC m=+21.598287077"
Sep 10 16:02:17.203818 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.203782    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9pp69" podStartSLOduration=3.675583745 podStartE2EDuration="21.203774968s" totalImagesPullingTime="17.528191223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:17.20362403 +0000 UTC m=+21.615710239" watchObservedRunningTime="2026-09-10 16:02:17.203774968 +0000 UTC m=+21.615861188"
Sep 10 16:02:17.222524 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.222489    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4srmx" podStartSLOduration=3.694742758 podStartE2EDuration="21.222477924s" totalImagesPullingTime="17.527735166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:17.222186324 +0000 UTC m=+21.634272533" watchObservedRunningTime="2026-09-10 16:02:17.222477924 +0000 UTC m=+21.634564132"
Sep 10 16:02:17.272873 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.272828    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p28gs" podStartSLOduration=3.701315183 podStartE2EDuration="21.272816674s" totalImagesPullingTime="17.571501491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:17.243043997 +0000 UTC m=+21.655130218" watchObservedRunningTime="2026-09-10 16:02:17.272816674 +0000 UTC m=+21.684902883"
Sep 10 16:02:17.273751 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.273450    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-6st4n"]
Sep 10 16:02:17.283643 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.283621    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6st4n"
Sep 10 16:02:17.286355 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.286331    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 16:02:17.286434 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.286391    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 16:02:17.286488 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.286439    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-86fxw\""
Sep 10 16:02:17.347196 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.347020    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 16:02:17.399667 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.399645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdd45b18-7dc2-4135-b89b-2679984e2b5a-tmp-dir\") pod \"node-resolver-6st4n\" (UID: \"cdd45b18-7dc2-4135-b89b-2679984e2b5a\") " pod="openshift-dns/node-resolver-6st4n"
Sep 10 16:02:17.399779 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.399699    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4zf4\" (UniqueName: \"kubernetes.io/projected/cdd45b18-7dc2-4135-b89b-2679984e2b5a-kube-api-access-x4zf4\") pod \"node-resolver-6st4n\" (UID: \"cdd45b18-7dc2-4135-b89b-2679984e2b5a\") " pod="openshift-dns/node-resolver-6st4n"
Sep 10 16:02:17.399828 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.399810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cdd45b18-7dc2-4135-b89b-2679984e2b5a-hosts-file\") pod \"node-resolver-6st4n\" (UID: \"cdd45b18-7dc2-4135-b89b-2679984e2b5a\") " pod="openshift-dns/node-resolver-6st4n"
Sep 10 16:02:17.500888 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.500867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdd45b18-7dc2-4135-b89b-2679984e2b5a-tmp-dir\") pod \"node-resolver-6st4n\" (UID: \"cdd45b18-7dc2-4135-b89b-2679984e2b5a\") " pod="openshift-dns/node-resolver-6st4n"
Sep 10 16:02:17.500992 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.500911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4zf4\" (UniqueName: \"kubernetes.io/projected/cdd45b18-7dc2-4135-b89b-2679984e2b5a-kube-api-access-x4zf4\") pod \"node-resolver-6st4n\" (UID: \"cdd45b18-7dc2-4135-b89b-2679984e2b5a\") " pod="openshift-dns/node-resolver-6st4n"
Sep 10 16:02:17.500992 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.500942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cdd45b18-7dc2-4135-b89b-2679984e2b5a-hosts-file\") pod \"node-resolver-6st4n\" (UID: \"cdd45b18-7dc2-4135-b89b-2679984e2b5a\") " pod="openshift-dns/node-resolver-6st4n"
Sep 10 16:02:17.501093 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.501069    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cdd45b18-7dc2-4135-b89b-2679984e2b5a-hosts-file\") pod \"node-resolver-6st4n\" (UID: \"cdd45b18-7dc2-4135-b89b-2679984e2b5a\") " pod="openshift-dns/node-resolver-6st4n"
Sep 10 16:02:17.501247 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.501224    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdd45b18-7dc2-4135-b89b-2679984e2b5a-tmp-dir\") pod \"node-resolver-6st4n\" (UID: \"cdd45b18-7dc2-4135-b89b-2679984e2b5a\") " pod="openshift-dns/node-resolver-6st4n"
Sep 10 16:02:17.520037 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.519974    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4zf4\" (UniqueName: \"kubernetes.io/projected/cdd45b18-7dc2-4135-b89b-2679984e2b5a-kube-api-access-x4zf4\") pod \"node-resolver-6st4n\" (UID: \"cdd45b18-7dc2-4135-b89b-2679984e2b5a\") " pod="openshift-dns/node-resolver-6st4n"
Sep 10 16:02:17.593711 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.593658    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6st4n"
Sep 10 16:02:17.601700 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:02:17.601678    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd45b18_7dc2_4135_b89b_2679984e2b5a.slice/crio-c6ccf8c8167b5a2191ec3b4a7f2e1438cab71be4363cbe806083b8c49dcb3229 WatchSource:0}: Error finding container c6ccf8c8167b5a2191ec3b4a7f2e1438cab71be4363cbe806083b8c49dcb3229: Status 404 returned error can't find the container with id c6ccf8c8167b5a2191ec3b4a7f2e1438cab71be4363cbe806083b8c49dcb3229
Sep 10 16:02:17.990275 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.990171    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T16:02:17.347194127Z","UUID":"2fa595af-7d1c-4223-b5a8-3c44220bc57c","Handler":null,"Name":"","Endpoint":""}
Sep 10 16:02:17.992020 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.991990    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 16:02:17.992143 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:17.992025    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 16:02:18.024304 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:18.024274    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dwt9d"
Sep 10 16:02:18.024824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:18.024804    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dwt9d"
Sep 10 16:02:18.067311 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:18.067286    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:18.067436 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:18.067397    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:18.174475 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:18.174442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6st4n" event={"ID":"cdd45b18-7dc2-4135-b89b-2679984e2b5a","Type":"ContainerStarted","Data":"05a8b125f2a0d4178836e0f182b7d775d3f3332f9f1fdba9e5ef5ca1c44df2b5"}
Sep 10 16:02:18.174911 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:18.174499    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6st4n" event={"ID":"cdd45b18-7dc2-4135-b89b-2679984e2b5a","Type":"ContainerStarted","Data":"c6ccf8c8167b5a2191ec3b4a7f2e1438cab71be4363cbe806083b8c49dcb3229"}
Sep 10 16:02:18.176406 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:18.176382    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7" event={"ID":"58a644eb-7a5b-416c-a0f8-fbfe442b373e","Type":"ContainerStarted","Data":"468a2e9ce7f570a4780136ca2d6e94640e8d94c38edf6b1dd6ab4ffbc4b55bc9"}
Sep 10 16:02:18.177020 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:18.176999    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dwt9d"
Sep 10 16:02:18.177404 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:18.177385    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dwt9d"
Sep 10 16:02:18.191130 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:18.191084    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6st4n" podStartSLOduration=1.191066933 podStartE2EDuration="1.191066933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:18.190496242 +0000 UTC m=+22.602582451" watchObservedRunningTime="2026-09-10 16:02:18.191066933 +0000 UTC m=+22.603153141"
Sep 10 16:02:19.064919 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:19.064896    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:19.065044 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:19.065018    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:19.065114 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:19.065038    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:19.065285 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:19.065171    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:19.182388 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:19.182347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-469b9" event={"ID":"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83","Type":"ContainerStarted","Data":"860832dadd76763bb32a17b9a7cd343475e001dff842f99a5bff9b4e3bab2b5c"}
Sep 10 16:02:19.184803 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:19.184772    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7" event={"ID":"58a644eb-7a5b-416c-a0f8-fbfe442b373e","Type":"ContainerStarted","Data":"5789a36df5c92b5bc63ab7e4fc4740e300e1ab014cce7ca8563e6a74fed77d9c"}
Sep 10 16:02:19.203632 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:19.203587    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm6d7" podStartSLOduration=3.003432356 podStartE2EDuration="23.203574079s" totalImagesPullingTime="20.200141723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:01:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:19.203410592 +0000 UTC m=+23.615496801" watchObservedRunningTime="2026-09-10 16:02:19.203574079 +0000 UTC m=+23.615660319"
Sep 10 16:02:20.071599 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:20.071573    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:20.071792 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:20.071661    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:21.064595 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:21.064560    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:21.065044 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:21.064558    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:21.065044 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:21.064714    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:21.065044 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:21.064747    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:22.067316 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:22.067132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:22.068010 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:22.067401    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:22.192694 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:22.192648    2562 generic.go:356] "Generic (PLEG): container finished" podID="8d3abde2-7ce3-4eeb-afdf-610976782c38" containerID="a7ba9160cd4a9bb5d8bc2cb39468598361e81ce5ede166d3e3cd790ebbc9ebe6" exitCode=0
Sep 10 16:02:22.192864 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:22.192745    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx87" event={"ID":"8d3abde2-7ce3-4eeb-afdf-610976782c38","Type":"ContainerDied","Data":"a7ba9160cd4a9bb5d8bc2cb39468598361e81ce5ede166d3e3cd790ebbc9ebe6"}
Sep 10 16:02:22.198131 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:22.198104    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-469b9" event={"ID":"4ff34241-c13b-4ff9-bfd0-59aa3ce34c83","Type":"ContainerStarted","Data":"66e76951bfb03318048e0097f9ae84410d8984f0a1e696ad1c8ea12a7ac08d56"}
Sep 10 16:02:22.198399 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:22.198386    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:02:22.198477 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:22.198440    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:02:22.213424 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:22.213403    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:02:22.259290 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:22.259246    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-469b9" podStartSLOduration=8.574453216 podStartE2EDuration="26.259230569s" totalImagesPullingTime="17.684777353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:22.25792078 +0000 UTC m=+26.670006989" watchObservedRunningTime="2026-09-10 16:02:22.259230569 +0000 UTC m=+26.671316777"
Sep 10 16:02:23.064813 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:23.064777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:23.065071 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:23.064779    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:23.065071 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:23.064876    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:23.065071 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:23.064991    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:23.203290 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:23.203056    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx87" event={"ID":"8d3abde2-7ce3-4eeb-afdf-610976782c38","Type":"ContainerStarted","Data":"757c186d8a2e60904f3341f653b03d0f79e96abb062fd4e7aa94144e4846cca6"}
Sep 10 16:02:23.203643 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:23.203614    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:02:23.233207 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:23.233178    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:02:23.396366 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:23.396259    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5jnrv"]
Sep 10 16:02:23.396640 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:23.396373    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:23.396640 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:23.396465    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:23.397169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:23.397139    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pvd2k"]
Sep 10 16:02:23.397289 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:23.397265    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:23.397392 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:23.397370    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:23.399131 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:23.399107    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4xw78"]
Sep 10 16:02:23.399242 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:23.399202    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:23.399312 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:23.399287    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:24.207740 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:24.207703    2562 generic.go:356] "Generic (PLEG): container finished" podID="8d3abde2-7ce3-4eeb-afdf-610976782c38" containerID="757c186d8a2e60904f3341f653b03d0f79e96abb062fd4e7aa94144e4846cca6" exitCode=0
Sep 10 16:02:24.208137 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:24.207777    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx87" event={"ID":"8d3abde2-7ce3-4eeb-afdf-610976782c38","Type":"ContainerDied","Data":"757c186d8a2e60904f3341f653b03d0f79e96abb062fd4e7aa94144e4846cca6"}
Sep 10 16:02:24.629540 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:24.629515    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6st4n_cdd45b18-7dc2-4135-b89b-2679984e2b5a/dns-node-resolver/0.log"
Sep 10 16:02:25.064888 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:25.064857    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:25.065071 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:25.064981    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:25.065411 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:25.065391    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:25.065515 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:25.065496    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:25.065576 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:25.065552    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:25.065662 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:25.065645    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:25.213054 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:25.213015    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx87" event={"ID":"8d3abde2-7ce3-4eeb-afdf-610976782c38","Type":"ContainerStarted","Data":"aee5abfd3e429502e3e9a82c0c37960cd02882751016805f6d363398732c6789"}
Sep 10 16:02:25.619187 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:25.619160    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-695sv_e9286b05-9412-43dc-89c0-9ef8b198a429/node-ca/0.log"
Sep 10 16:02:26.217196 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:26.217162    2562 generic.go:356] "Generic (PLEG): container finished" podID="8d3abde2-7ce3-4eeb-afdf-610976782c38" containerID="aee5abfd3e429502e3e9a82c0c37960cd02882751016805f6d363398732c6789" exitCode=0
Sep 10 16:02:26.217567 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:26.217235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx87" event={"ID":"8d3abde2-7ce3-4eeb-afdf-610976782c38","Type":"ContainerDied","Data":"aee5abfd3e429502e3e9a82c0c37960cd02882751016805f6d363398732c6789"}
Sep 10 16:02:27.064313 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:27.064278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:27.064313 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:27.064310    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:27.064532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:27.064324    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:27.064532 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:27.064410    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5jnrv" podUID="7921cd1d-ec59-489d-944d-57030a1fd6ed"
Sep 10 16:02:27.064641 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:27.064546    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xw78" podUID="e0f1b108-be29-48e0-abd0-26469f0ecfe0"
Sep 10 16:02:27.064692 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:27.064642    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvd2k" podUID="29d23217-e4bd-450d-afcd-032930e26933"
Sep 10 16:02:28.907754 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:28.907633    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-43.ec2.internal" event="NodeReady"
Sep 10 16:02:28.908227 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:28.907781    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 16:02:28.998096 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:28.998056    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r5vhs"]
Sep 10 16:02:29.014877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.014850    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xz4lx"]
Sep 10 16:02:29.014998 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.014968    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.018654 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.018630    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6s77g\""
Sep 10 16:02:29.018897 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.018879    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 16:02:29.018998 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.018895    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 16:02:29.019278 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.019256    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 16:02:29.019966 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.019946    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 16:02:29.037304 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.037273    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r5vhs"]
Sep 10 16:02:29.037400 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.037320    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xz4lx"]
Sep 10 16:02:29.037400 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.037380    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.039998 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.039983    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 16:02:29.040385 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.040369    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 16:02:29.040842 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.040829    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fqpr5\""
Sep 10 16:02:29.043477 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.043459    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xkqtd"]
Sep 10 16:02:29.066136 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.066110    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xkqtd"]
Sep 10 16:02:29.066229 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.066196    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:29.066289 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.066265    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xkqtd"
Sep 10 16:02:29.066289 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.066196    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:29.066390 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.066199    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:29.069084 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.069066    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 16:02:29.069179 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.069068    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 16:02:29.069179 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.069103    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 16:02:29.069468 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.069450    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 16:02:29.069717 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.069704    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-twhfc\""
Sep 10 16:02:29.070948 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.070748    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 16:02:29.070948 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.070772    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 16:02:29.070948 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.070792    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 16:02:29.070948 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.070834    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g5gt7\""
Sep 10 16:02:29.070948 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.070838    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-swxfx\""
Sep 10 16:02:29.085275 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.084885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zgft\" (UniqueName: \"kubernetes.io/projected/6de2389b-8710-4c59-94d2-0354fe905d75-kube-api-access-4zgft\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.085275 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.085161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de2389b-8710-4c59-94d2-0354fe905d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.085275 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.085248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6de2389b-8710-4c59-94d2-0354fe905d75-crio-socket\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.089388 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.085429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de2389b-8710-4c59-94d2-0354fe905d75-data-volume\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.089388 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.085478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.186299 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.186207    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b1fd77-45a8-45ad-90fb-dba87007d949-config-volume\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.186299 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.186268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de2389b-8710-4c59-94d2-0354fe905d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.186299 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.186294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fd77-45a8-45ad-90fb-dba87007d949-tmp-dir\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.186558 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.186323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2d1b3be-a896-444d-8516-147b5e1fb599-cert\") pod \"ingress-canary-xkqtd\" (UID: \"f2d1b3be-a896-444d-8516-147b5e1fb599\") " pod="openshift-ingress-canary/ingress-canary-xkqtd"
Sep 10 16:02:29.186558 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.186347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.186558 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.186371    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 16:02:29.186558 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.186375    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6de2389b-8710-4c59-94d2-0354fe905d75-crio-socket\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.186558 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.186476    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6de2389b-8710-4c59-94d2-0354fe905d75-kube-rbac-proxy-cm podName:6de2389b-8710-4c59-94d2-0354fe905d75 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:29.686452649 +0000 UTC m=+34.098538861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6de2389b-8710-4c59-94d2-0354fe905d75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r5vhs" (UID: "6de2389b-8710-4c59-94d2-0354fe905d75") : configmap "kube-rbac-proxy" not found
Sep 10 16:02:29.186819 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.186564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de2389b-8710-4c59-94d2-0354fe905d75-data-volume\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.186819 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.186588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.186819 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.186629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zgft\" (UniqueName: \"kubernetes.io/projected/6de2389b-8710-4c59-94d2-0354fe905d75-kube-api-access-4zgft\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.186819 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.186632    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6de2389b-8710-4c59-94d2-0354fe905d75-crio-socket\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.186819 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.186646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26kmx\" (UniqueName: \"kubernetes.io/projected/c6b1fd77-45a8-45ad-90fb-dba87007d949-kube-api-access-26kmx\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.186819 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.186667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvrms\" (UniqueName: \"kubernetes.io/projected/f2d1b3be-a896-444d-8516-147b5e1fb599-kube-api-access-zvrms\") pod \"ingress-canary-xkqtd\" (UID: \"f2d1b3be-a896-444d-8516-147b5e1fb599\") " pod="openshift-ingress-canary/ingress-canary-xkqtd"
Sep 10 16:02:29.187062 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.186831    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 16:02:29.187062 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.186892    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls podName:6de2389b-8710-4c59-94d2-0354fe905d75 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:29.686877545 +0000 UTC m=+34.098963747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r5vhs" (UID: "6de2389b-8710-4c59-94d2-0354fe905d75") : secret "insights-runtime-extractor-tls" not found
Sep 10 16:02:29.187325 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.187299    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de2389b-8710-4c59-94d2-0354fe905d75-data-volume\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.201522 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.201394    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zgft\" (UniqueName: \"kubernetes.io/projected/6de2389b-8710-4c59-94d2-0354fe905d75-kube-api-access-4zgft\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.287354 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.287311    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26kmx\" (UniqueName: \"kubernetes.io/projected/c6b1fd77-45a8-45ad-90fb-dba87007d949-kube-api-access-26kmx\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.287354 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.287358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvrms\" (UniqueName: \"kubernetes.io/projected/f2d1b3be-a896-444d-8516-147b5e1fb599-kube-api-access-zvrms\") pod \"ingress-canary-xkqtd\" (UID: \"f2d1b3be-a896-444d-8516-147b5e1fb599\") " pod="openshift-ingress-canary/ingress-canary-xkqtd"
Sep 10 16:02:29.287585 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.287406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b1fd77-45a8-45ad-90fb-dba87007d949-config-volume\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.287585 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.287449    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fd77-45a8-45ad-90fb-dba87007d949-tmp-dir\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.287585 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.287481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2d1b3be-a896-444d-8516-147b5e1fb599-cert\") pod \"ingress-canary-xkqtd\" (UID: \"f2d1b3be-a896-444d-8516-147b5e1fb599\") " pod="openshift-ingress-canary/ingress-canary-xkqtd"
Sep 10 16:02:29.287585 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.287502    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.287785 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.287585    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 16:02:29.287785 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.287651    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls podName:c6b1fd77-45a8-45ad-90fb-dba87007d949 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:29.787632834 +0000 UTC m=+34.199719034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls") pod "dns-default-xz4lx" (UID: "c6b1fd77-45a8-45ad-90fb-dba87007d949") : secret "dns-default-metrics-tls" not found
Sep 10 16:02:29.288034 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.288014    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b1fd77-45a8-45ad-90fb-dba87007d949-config-volume\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.288280 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.288253    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b1fd77-45a8-45ad-90fb-dba87007d949-tmp-dir\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.290338 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.290314    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2d1b3be-a896-444d-8516-147b5e1fb599-cert\") pod \"ingress-canary-xkqtd\" (UID: \"f2d1b3be-a896-444d-8516-147b5e1fb599\") " pod="openshift-ingress-canary/ingress-canary-xkqtd"
Sep 10 16:02:29.302142 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.302117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvrms\" (UniqueName: \"kubernetes.io/projected/f2d1b3be-a896-444d-8516-147b5e1fb599-kube-api-access-zvrms\") pod \"ingress-canary-xkqtd\" (UID: \"f2d1b3be-a896-444d-8516-147b5e1fb599\") " pod="openshift-ingress-canary/ingress-canary-xkqtd"
Sep 10 16:02:29.302528 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.302505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26kmx\" (UniqueName: \"kubernetes.io/projected/c6b1fd77-45a8-45ad-90fb-dba87007d949-kube-api-access-26kmx\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.382696 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.382662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xkqtd"
Sep 10 16:02:29.459913 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.459829    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-ftb4n"]
Sep 10 16:02:29.471090 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.471061    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-ftb4n"
Sep 10 16:02:29.474243 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.474217    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 10 16:02:29.475185 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.475158    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 10 16:02:29.475315 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.475171    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 10 16:02:29.475674 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.475649    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 10 16:02:29.475798 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.475669    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-t6xw9\""
Sep 10 16:02:29.480858 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.480838    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-ftb4n"]
Sep 10 16:02:29.589172 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.589139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f0b6f91a-75fb-46d0-b700-b0db1a76d2e7-signing-cabundle\") pod \"service-ca-75d99c484-ftb4n\" (UID: \"f0b6f91a-75fb-46d0-b700-b0db1a76d2e7\") " pod="openshift-service-ca/service-ca-75d99c484-ftb4n"
Sep 10 16:02:29.589345 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.589228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f0b6f91a-75fb-46d0-b700-b0db1a76d2e7-signing-key\") pod \"service-ca-75d99c484-ftb4n\" (UID: \"f0b6f91a-75fb-46d0-b700-b0db1a76d2e7\") " pod="openshift-service-ca/service-ca-75d99c484-ftb4n"
Sep 10 16:02:29.589345 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.589253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6cvn\" (UniqueName: \"kubernetes.io/projected/f0b6f91a-75fb-46d0-b700-b0db1a76d2e7-kube-api-access-p6cvn\") pod \"service-ca-75d99c484-ftb4n\" (UID: \"f0b6f91a-75fb-46d0-b700-b0db1a76d2e7\") " pod="openshift-service-ca/service-ca-75d99c484-ftb4n"
Sep 10 16:02:29.690528 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.690495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f0b6f91a-75fb-46d0-b700-b0db1a76d2e7-signing-cabundle\") pod \"service-ca-75d99c484-ftb4n\" (UID: \"f0b6f91a-75fb-46d0-b700-b0db1a76d2e7\") " pod="openshift-service-ca/service-ca-75d99c484-ftb4n"
Sep 10 16:02:29.690705 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.690672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de2389b-8710-4c59-94d2-0354fe905d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.690705 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.690697    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f0b6f91a-75fb-46d0-b700-b0db1a76d2e7-signing-key\") pod \"service-ca-75d99c484-ftb4n\" (UID: \"f0b6f91a-75fb-46d0-b700-b0db1a76d2e7\") " pod="openshift-service-ca/service-ca-75d99c484-ftb4n"
Sep 10 16:02:29.690818 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.690715    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6cvn\" (UniqueName: \"kubernetes.io/projected/f0b6f91a-75fb-46d0-b700-b0db1a76d2e7-kube-api-access-p6cvn\") pod \"service-ca-75d99c484-ftb4n\" (UID: \"f0b6f91a-75fb-46d0-b700-b0db1a76d2e7\") " pod="openshift-service-ca/service-ca-75d99c484-ftb4n"
Sep 10 16:02:29.690897 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.690878    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 16:02:29.690976 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.690965    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6de2389b-8710-4c59-94d2-0354fe905d75-kube-rbac-proxy-cm podName:6de2389b-8710-4c59-94d2-0354fe905d75 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:30.690949808 +0000 UTC m=+35.103036014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6de2389b-8710-4c59-94d2-0354fe905d75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r5vhs" (UID: "6de2389b-8710-4c59-94d2-0354fe905d75") : configmap "kube-rbac-proxy" not found
Sep 10 16:02:29.690976 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.690954    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:29.691082 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.691008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:29.691082 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.691038    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 16:02:29.691144 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.691108    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls podName:6de2389b-8710-4c59-94d2-0354fe905d75 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:30.691089439 +0000 UTC m=+35.103175647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r5vhs" (UID: "6de2389b-8710-4c59-94d2-0354fe905d75") : secret "insights-runtime-extractor-tls" not found
Sep 10 16:02:29.691330 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.691307    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f0b6f91a-75fb-46d0-b700-b0db1a76d2e7-signing-cabundle\") pod \"service-ca-75d99c484-ftb4n\" (UID: \"f0b6f91a-75fb-46d0-b700-b0db1a76d2e7\") " pod="openshift-service-ca/service-ca-75d99c484-ftb4n"
Sep 10 16:02:29.693388 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.693368    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f0b6f91a-75fb-46d0-b700-b0db1a76d2e7-signing-key\") pod \"service-ca-75d99c484-ftb4n\" (UID: \"f0b6f91a-75fb-46d0-b700-b0db1a76d2e7\") " pod="openshift-service-ca/service-ca-75d99c484-ftb4n"
Sep 10 16:02:29.693485 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.693441    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7921cd1d-ec59-489d-944d-57030a1fd6ed-original-pull-secret\") pod \"global-pull-secret-syncer-5jnrv\" (UID: \"7921cd1d-ec59-489d-944d-57030a1fd6ed\") " pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:29.703506 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.703482    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6cvn\" (UniqueName: \"kubernetes.io/projected/f0b6f91a-75fb-46d0-b700-b0db1a76d2e7-kube-api-access-p6cvn\") pod \"service-ca-75d99c484-ftb4n\" (UID: \"f0b6f91a-75fb-46d0-b700-b0db1a76d2e7\") " pod="openshift-service-ca/service-ca-75d99c484-ftb4n"
Sep 10 16:02:29.782414 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.782381    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-ftb4n"
Sep 10 16:02:29.791694 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.791666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:02:29.791849 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.791749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:29.791892 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.791847    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 16:02:29.791927 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.791915    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs podName:29d23217-e4bd-450d-afcd-032930e26933 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:01.791900908 +0000 UTC m=+66.203987101 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs") pod "network-metrics-daemon-pvd2k" (UID: "29d23217-e4bd-450d-afcd-032930e26933") : secret "metrics-daemon-secret" not found
Sep 10 16:02:29.791974 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.791847    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 16:02:29.791974 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:29.791970    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls podName:c6b1fd77-45a8-45ad-90fb-dba87007d949 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:30.791959478 +0000 UTC m=+35.204045668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls") pod "dns-default-xz4lx" (UID: "c6b1fd77-45a8-45ad-90fb-dba87007d949") : secret "dns-default-metrics-tls" not found
Sep 10 16:02:29.892370 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.892319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn96t\" (UniqueName: \"kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t\") pod \"network-check-target-4xw78\" (UID: \"e0f1b108-be29-48e0-abd0-26469f0ecfe0\") " pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:29.895316 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.895285    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn96t\" (UniqueName: \"kubernetes.io/projected/e0f1b108-be29-48e0-abd0-26469f0ecfe0-kube-api-access-sn96t\") pod \"network-check-target-4xw78\" (UID: \"e0f1b108-be29-48e0-abd0-26469f0ecfe0\") " pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:29.976128 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.976099    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5jnrv"
Sep 10 16:02:29.989288 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:29.989257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:30.704965 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:30.704022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de2389b-8710-4c59-94d2-0354fe905d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:30.704965 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:30.704097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:30.704965 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:30.704250    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 16:02:30.704965 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:30.704315    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls podName:6de2389b-8710-4c59-94d2-0354fe905d75 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:32.704294704 +0000 UTC m=+37.116380894 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r5vhs" (UID: "6de2389b-8710-4c59-94d2-0354fe905d75") : secret "insights-runtime-extractor-tls" not found
Sep 10 16:02:30.704965 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:30.704827    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 16:02:30.704965 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:30.704891    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6de2389b-8710-4c59-94d2-0354fe905d75-kube-rbac-proxy-cm podName:6de2389b-8710-4c59-94d2-0354fe905d75 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:32.704872492 +0000 UTC m=+37.116958681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6de2389b-8710-4c59-94d2-0354fe905d75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r5vhs" (UID: "6de2389b-8710-4c59-94d2-0354fe905d75") : configmap "kube-rbac-proxy" not found
Sep 10 16:02:30.805474 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:30.805432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:30.805644 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:30.805588    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 16:02:30.805687 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:30.805667    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls podName:c6b1fd77-45a8-45ad-90fb-dba87007d949 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:32.805651002 +0000 UTC m=+37.217737189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls") pod "dns-default-xz4lx" (UID: "c6b1fd77-45a8-45ad-90fb-dba87007d949") : secret "dns-default-metrics-tls" not found
Sep 10 16:02:30.928531 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:30.928434    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-ftb4n"]
Sep 10 16:02:30.929365 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:30.929339    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5jnrv"]
Sep 10 16:02:30.930542 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:30.930465    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4xw78"]
Sep 10 16:02:30.931059 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:30.931030    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xkqtd"]
Sep 10 16:02:30.935033 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:02:30.935011    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b6f91a_75fb_46d0_b700_b0db1a76d2e7.slice/crio-507856d2dcc5358908d3e870566acff9c7653d726eae746c89b08dde8f43d6a7 WatchSource:0}: Error finding container 507856d2dcc5358908d3e870566acff9c7653d726eae746c89b08dde8f43d6a7: Status 404 returned error can't find the container with id 507856d2dcc5358908d3e870566acff9c7653d726eae746c89b08dde8f43d6a7
Sep 10 16:02:30.935592 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:02:30.935570    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d1b3be_a896_444d_8516_147b5e1fb599.slice/crio-96ad09a3728d0f483e4db521f8d30a787569792ac5a12be0b54781125f4e8139 WatchSource:0}: Error finding container 96ad09a3728d0f483e4db521f8d30a787569792ac5a12be0b54781125f4e8139: Status 404 returned error can't find the container with id 96ad09a3728d0f483e4db521f8d30a787569792ac5a12be0b54781125f4e8139
Sep 10 16:02:30.936596 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:02:30.936551    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f1b108_be29_48e0_abd0_26469f0ecfe0.slice/crio-0b983465e874a1f8b6e226b819e33dedf446700813fe39b7ce7781cb24caedf9 WatchSource:0}: Error finding container 0b983465e874a1f8b6e226b819e33dedf446700813fe39b7ce7781cb24caedf9: Status 404 returned error can't find the container with id 0b983465e874a1f8b6e226b819e33dedf446700813fe39b7ce7781cb24caedf9
Sep 10 16:02:30.937085 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:02:30.936971    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7921cd1d_ec59_489d_944d_57030a1fd6ed.slice/crio-e100f48edaf81ab318ec26b937ce5c07a4d36d5dac3cc7f17eae04035809746e WatchSource:0}: Error finding container e100f48edaf81ab318ec26b937ce5c07a4d36d5dac3cc7f17eae04035809746e: Status 404 returned error can't find the container with id e100f48edaf81ab318ec26b937ce5c07a4d36d5dac3cc7f17eae04035809746e
Sep 10 16:02:31.231375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:31.231183    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-ftb4n" event={"ID":"f0b6f91a-75fb-46d0-b700-b0db1a76d2e7","Type":"ContainerStarted","Data":"507856d2dcc5358908d3e870566acff9c7653d726eae746c89b08dde8f43d6a7"}
Sep 10 16:02:31.232403 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:31.232377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xkqtd" event={"ID":"f2d1b3be-a896-444d-8516-147b5e1fb599","Type":"ContainerStarted","Data":"96ad09a3728d0f483e4db521f8d30a787569792ac5a12be0b54781125f4e8139"}
Sep 10 16:02:31.235126 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:31.235098    2562 generic.go:356] "Generic (PLEG): container finished" podID="8d3abde2-7ce3-4eeb-afdf-610976782c38" containerID="ab0e820c081667e54575c37b16c43485e3fc9b56bb3437acdfc6c092e7507fae" exitCode=0
Sep 10 16:02:31.235217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:31.235180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx87" event={"ID":"8d3abde2-7ce3-4eeb-afdf-610976782c38","Type":"ContainerDied","Data":"ab0e820c081667e54575c37b16c43485e3fc9b56bb3437acdfc6c092e7507fae"}
Sep 10 16:02:31.236324 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:31.236302    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4xw78" event={"ID":"e0f1b108-be29-48e0-abd0-26469f0ecfe0","Type":"ContainerStarted","Data":"0b983465e874a1f8b6e226b819e33dedf446700813fe39b7ce7781cb24caedf9"}
Sep 10 16:02:31.237411 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:31.237392    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5jnrv" event={"ID":"7921cd1d-ec59-489d-944d-57030a1fd6ed","Type":"ContainerStarted","Data":"e100f48edaf81ab318ec26b937ce5c07a4d36d5dac3cc7f17eae04035809746e"}
Sep 10 16:02:32.246397 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:32.246359    2562 generic.go:356] "Generic (PLEG): container finished" podID="8d3abde2-7ce3-4eeb-afdf-610976782c38" containerID="3e4c416e556b32b365e04f56bcf12b639fe023429fbf0b5d6ed0984f597d247f" exitCode=0
Sep 10 16:02:32.246871 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:32.246441    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx87" event={"ID":"8d3abde2-7ce3-4eeb-afdf-610976782c38","Type":"ContainerDied","Data":"3e4c416e556b32b365e04f56bcf12b639fe023429fbf0b5d6ed0984f597d247f"}
Sep 10 16:02:32.722578 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:32.721270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:32.722578 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:32.721368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de2389b-8710-4c59-94d2-0354fe905d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:32.722578 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:32.722017    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de2389b-8710-4c59-94d2-0354fe905d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:32.722578 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:32.722129    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 16:02:32.722578 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:32.722189    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls podName:6de2389b-8710-4c59-94d2-0354fe905d75 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:36.722171345 +0000 UTC m=+41.134257539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r5vhs" (UID: "6de2389b-8710-4c59-94d2-0354fe905d75") : secret "insights-runtime-extractor-tls" not found
Sep 10 16:02:32.823150 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:32.822700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:32.823150 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:32.822865    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 16:02:32.823150 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:32.822930    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls podName:c6b1fd77-45a8-45ad-90fb-dba87007d949 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:36.822909048 +0000 UTC m=+41.234995239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls") pod "dns-default-xz4lx" (UID: "c6b1fd77-45a8-45ad-90fb-dba87007d949") : secret "dns-default-metrics-tls" not found
Sep 10 16:02:33.256691 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:33.256655    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx87" event={"ID":"8d3abde2-7ce3-4eeb-afdf-610976782c38","Type":"ContainerStarted","Data":"26e1f6c615c00fefd73c865c2dc84f8e841a87da7d458fccc6fff664174a2f37"}
Sep 10 16:02:33.289915 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:33.289856    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2zx87" podStartSLOduration=8.876640933000001 podStartE2EDuration="37.289835998s" totalImagesPullingTime="28.413195065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:01:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:33.288228472 +0000 UTC m=+37.700314695" watchObservedRunningTime="2026-09-10 16:02:33.289835998 +0000 UTC m=+37.701922207"
Sep 10 16:02:36.750665 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:36.750619    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:36.751151 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:36.750808    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 16:02:36.751151 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:36.750912    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls podName:6de2389b-8710-4c59-94d2-0354fe905d75 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:44.750888937 +0000 UTC m=+49.162975124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r5vhs" (UID: "6de2389b-8710-4c59-94d2-0354fe905d75") : secret "insights-runtime-extractor-tls" not found
Sep 10 16:02:36.852034 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:36.851986    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:36.852194 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:36.852161    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 16:02:36.852258 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:02:36.852246    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls podName:c6b1fd77-45a8-45ad-90fb-dba87007d949 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:44.852222337 +0000 UTC m=+49.264308539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls") pod "dns-default-xz4lx" (UID: "c6b1fd77-45a8-45ad-90fb-dba87007d949") : secret "dns-default-metrics-tls" not found
Sep 10 16:02:38.270766 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:38.270715    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-ftb4n" event={"ID":"f0b6f91a-75fb-46d0-b700-b0db1a76d2e7","Type":"ContainerStarted","Data":"05db184e60c8611da19c185c252b8fef5f053b04e0eeebf82b6b68c53a9d3c81"}
Sep 10 16:02:38.272268 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:38.272234    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xkqtd" event={"ID":"f2d1b3be-a896-444d-8516-147b5e1fb599","Type":"ContainerStarted","Data":"4548dc22a24b22e53973b4a8840744f6dfbc8e4b1d543bdb5f12c7cb76661667"}
Sep 10 16:02:38.273667 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:38.273644    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4xw78" event={"ID":"e0f1b108-be29-48e0-abd0-26469f0ecfe0","Type":"ContainerStarted","Data":"eae92cda60a113df0e0ce4563ab04d39e2df8e9dcf979a6051e12c8df4cf2ef1"}
Sep 10 16:02:38.273791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:38.273699    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:02:38.275197 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:38.275176    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5jnrv" event={"ID":"7921cd1d-ec59-489d-944d-57030a1fd6ed","Type":"ContainerStarted","Data":"054d1d0860d95840b6175726e2c7d8b770c5ed1789fba412ff36204351f86969"}
Sep 10 16:02:38.293885 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:38.293839    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-ftb4n" podStartSLOduration=2.739278285 podStartE2EDuration="9.293823973s" totalImagesPullingTime="6.554545688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:38.293344317 +0000 UTC m=+42.705430525" watchObservedRunningTime="2026-09-10 16:02:38.293823973 +0000 UTC m=+42.705910194"
Sep 10 16:02:38.349166 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:38.349113    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4xw78" podStartSLOduration=35.772995755 podStartE2EDuration="42.34909644s" totalImagesPullingTime="6.576100685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:38.348122052 +0000 UTC m=+42.760208261" watchObservedRunningTime="2026-09-10 16:02:38.34909644 +0000 UTC m=+42.761182708"
Sep 10 16:02:38.368662 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:38.368615    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5jnrv" podStartSLOduration=35.781603666 podStartE2EDuration="42.368599907s" totalImagesPullingTime="6.586996241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:38.368287359 +0000 UTC m=+42.780373572" watchObservedRunningTime="2026-09-10 16:02:38.368599907 +0000 UTC m=+42.780686116"
Sep 10 16:02:38.384703 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:38.384619    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xkqtd" podStartSLOduration=2.808141245 podStartE2EDuration="9.384600376s" totalImagesPullingTime="6.576459131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:38.384203191 +0000 UTC m=+42.796289403" watchObservedRunningTime="2026-09-10 16:02:38.384600376 +0000 UTC m=+42.796686587"
Sep 10 16:02:44.811002 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:44.810959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:44.814400 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:44.814378    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de2389b-8710-4c59-94d2-0354fe905d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5vhs\" (UID: \"6de2389b-8710-4c59-94d2-0354fe905d75\") " pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:44.912301 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:44.912254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:44.914508 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:44.914474    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6b1fd77-45a8-45ad-90fb-dba87007d949-metrics-tls\") pod \"dns-default-xz4lx\" (UID: \"c6b1fd77-45a8-45ad-90fb-dba87007d949\") " pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:44.925563 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:44.925535    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r5vhs"
Sep 10 16:02:44.945772 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:44.945737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:45.232755 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:45.232646    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r5vhs"]
Sep 10 16:02:45.235470 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:02:45.235428    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de2389b_8710_4c59_94d2_0354fe905d75.slice/crio-c17d4940fcb0267e15a526d8b5ae2d97b2ce36901e741f66e20012bcd6f443a2 WatchSource:0}: Error finding container c17d4940fcb0267e15a526d8b5ae2d97b2ce36901e741f66e20012bcd6f443a2: Status 404 returned error can't find the container with id c17d4940fcb0267e15a526d8b5ae2d97b2ce36901e741f66e20012bcd6f443a2
Sep 10 16:02:45.262409 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:45.262378    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xz4lx"]
Sep 10 16:02:45.265592 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:02:45.265563    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b1fd77_45a8_45ad_90fb_dba87007d949.slice/crio-9dd09bbcc6db00daaf4d0f5a0b24db757a4324b955ded97b8f65104444a525d3 WatchSource:0}: Error finding container 9dd09bbcc6db00daaf4d0f5a0b24db757a4324b955ded97b8f65104444a525d3: Status 404 returned error can't find the container with id 9dd09bbcc6db00daaf4d0f5a0b24db757a4324b955ded97b8f65104444a525d3
Sep 10 16:02:45.294490 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:45.294448    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xz4lx" event={"ID":"c6b1fd77-45a8-45ad-90fb-dba87007d949","Type":"ContainerStarted","Data":"9dd09bbcc6db00daaf4d0f5a0b24db757a4324b955ded97b8f65104444a525d3"}
Sep 10 16:02:45.295775 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:45.295749    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r5vhs" event={"ID":"6de2389b-8710-4c59-94d2-0354fe905d75","Type":"ContainerStarted","Data":"c17d4940fcb0267e15a526d8b5ae2d97b2ce36901e741f66e20012bcd6f443a2"}
Sep 10 16:02:46.300588 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:46.300533    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r5vhs" event={"ID":"6de2389b-8710-4c59-94d2-0354fe905d75","Type":"ContainerStarted","Data":"41d004b143e7c98dd66cdb6fa13157bb2f1513e1361f4871ca4d0b77e4e04597"}
Sep 10 16:02:47.305943 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:47.305907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xz4lx" event={"ID":"c6b1fd77-45a8-45ad-90fb-dba87007d949","Type":"ContainerStarted","Data":"b4f3ddc41992e80282b9167ac66d4e7fcf5a536e78e2d5761e4ac942f2f97033"}
Sep 10 16:02:47.306371 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:47.305969    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xz4lx" event={"ID":"c6b1fd77-45a8-45ad-90fb-dba87007d949","Type":"ContainerStarted","Data":"fcb25c61fd27a17f87f7656961c99deb95207331636d5dd4ff8d4b6afad44e2f"}
Sep 10 16:02:47.306371 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:47.306046    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:47.307761 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:47.307738    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r5vhs" event={"ID":"6de2389b-8710-4c59-94d2-0354fe905d75","Type":"ContainerStarted","Data":"5debd6070d4c130d369571ea9ad1e26db2f314acfe50f0205e84a3ef9c97bb22"}
Sep 10 16:02:47.330212 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:47.330117    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xz4lx" podStartSLOduration=17.667681029 podStartE2EDuration="19.330097811s" totalImagesPullingTime="1.662416782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:47.329905303 +0000 UTC m=+51.741991512" watchObservedRunningTime="2026-09-10 16:02:47.330097811 +0000 UTC m=+51.742184021"
Sep 10 16:02:49.316582 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:49.316533    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r5vhs" event={"ID":"6de2389b-8710-4c59-94d2-0354fe905d75","Type":"ContainerStarted","Data":"354e8be35a2e7895a055c3a927bc92ac06816780c5fd5a07a4882f3e965aa051"}
Sep 10 16:02:49.341378 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:49.341323    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r5vhs" podStartSLOduration=18.386093344 podStartE2EDuration="21.34130614s" totalImagesPullingTime="2.955212796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:49.340918435 +0000 UTC m=+53.753004643" watchObservedRunningTime="2026-09-10 16:02:49.34130614 +0000 UTC m=+53.753392366"
Sep 10 16:02:53.386013 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.385979    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"]
Sep 10 16:02:53.412774 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.412747    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7"]
Sep 10 16:02:53.412930 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.412865    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:53.415943 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.415919    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 16:02:53.417342 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.417323    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 16:02:53.417464 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.417327    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 16:02:53.417464 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.417375    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 16:02:53.435636 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.435606    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"]
Sep 10 16:02:53.435823 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.435705    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7"
Sep 10 16:02:53.436190 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.436162    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7"]
Sep 10 16:02:53.439949 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.439911    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 10 16:02:53.440077 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.440040    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7xxmr\""
Sep 10 16:02:53.476464 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.476429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08751379-014f-44ac-a23c-ddc2efe74890-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-588ff99d44-6v2d7\" (UID: \"08751379-014f-44ac-a23c-ddc2efe74890\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7"
Sep 10 16:02:53.476611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.476501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/775cb164-3c38-41d7-b669-af1fc79f57de-klusterlet-config\") pod \"klusterlet-addon-workmgr-777c4c458b-8q56r\" (UID: \"775cb164-3c38-41d7-b669-af1fc79f57de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:53.476611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.476523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfcv7\" (UniqueName: \"kubernetes.io/projected/775cb164-3c38-41d7-b669-af1fc79f57de-kube-api-access-xfcv7\") pod \"klusterlet-addon-workmgr-777c4c458b-8q56r\" (UID: \"775cb164-3c38-41d7-b669-af1fc79f57de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:53.476685 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.476649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pkj7\" (UniqueName: \"kubernetes.io/projected/08751379-014f-44ac-a23c-ddc2efe74890-kube-api-access-2pkj7\") pod \"managed-serviceaccount-addon-agent-588ff99d44-6v2d7\" (UID: \"08751379-014f-44ac-a23c-ddc2efe74890\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7"
Sep 10 16:02:53.476685 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.476677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/775cb164-3c38-41d7-b669-af1fc79f57de-tmp\") pod \"klusterlet-addon-workmgr-777c4c458b-8q56r\" (UID: \"775cb164-3c38-41d7-b669-af1fc79f57de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:53.577520 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.577487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/775cb164-3c38-41d7-b669-af1fc79f57de-klusterlet-config\") pod \"klusterlet-addon-workmgr-777c4c458b-8q56r\" (UID: \"775cb164-3c38-41d7-b669-af1fc79f57de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:53.577520 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.577522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfcv7\" (UniqueName: \"kubernetes.io/projected/775cb164-3c38-41d7-b669-af1fc79f57de-kube-api-access-xfcv7\") pod \"klusterlet-addon-workmgr-777c4c458b-8q56r\" (UID: \"775cb164-3c38-41d7-b669-af1fc79f57de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:53.577806 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.577554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pkj7\" (UniqueName: \"kubernetes.io/projected/08751379-014f-44ac-a23c-ddc2efe74890-kube-api-access-2pkj7\") pod \"managed-serviceaccount-addon-agent-588ff99d44-6v2d7\" (UID: \"08751379-014f-44ac-a23c-ddc2efe74890\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7"
Sep 10 16:02:53.577806 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.577576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/775cb164-3c38-41d7-b669-af1fc79f57de-tmp\") pod \"klusterlet-addon-workmgr-777c4c458b-8q56r\" (UID: \"775cb164-3c38-41d7-b669-af1fc79f57de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:53.577806 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.577603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08751379-014f-44ac-a23c-ddc2efe74890-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-588ff99d44-6v2d7\" (UID: \"08751379-014f-44ac-a23c-ddc2efe74890\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7"
Sep 10 16:02:53.578018 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.577994    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/775cb164-3c38-41d7-b669-af1fc79f57de-tmp\") pod \"klusterlet-addon-workmgr-777c4c458b-8q56r\" (UID: \"775cb164-3c38-41d7-b669-af1fc79f57de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:53.580175 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.580142    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08751379-014f-44ac-a23c-ddc2efe74890-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-588ff99d44-6v2d7\" (UID: \"08751379-014f-44ac-a23c-ddc2efe74890\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7"
Sep 10 16:02:53.580311 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.580222    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/775cb164-3c38-41d7-b669-af1fc79f57de-klusterlet-config\") pod \"klusterlet-addon-workmgr-777c4c458b-8q56r\" (UID: \"775cb164-3c38-41d7-b669-af1fc79f57de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:53.610510 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.610473    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfcv7\" (UniqueName: \"kubernetes.io/projected/775cb164-3c38-41d7-b669-af1fc79f57de-kube-api-access-xfcv7\") pod \"klusterlet-addon-workmgr-777c4c458b-8q56r\" (UID: \"775cb164-3c38-41d7-b669-af1fc79f57de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:53.611159 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.611133    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pkj7\" (UniqueName: \"kubernetes.io/projected/08751379-014f-44ac-a23c-ddc2efe74890-kube-api-access-2pkj7\") pod \"managed-serviceaccount-addon-agent-588ff99d44-6v2d7\" (UID: \"08751379-014f-44ac-a23c-ddc2efe74890\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7"
Sep 10 16:02:53.614438 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.614404    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fd74bd6-pn6k5"]
Sep 10 16:02:53.638002 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.637928    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.638943 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.638919    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fd74bd6-pn6k5"]
Sep 10 16:02:53.641202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.641182    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 16:02:53.641452 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.641427    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nqhnk\""
Sep 10 16:02:53.641452 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.641435    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 16:02:53.641710 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.641695    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 16:02:53.647063 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.647043    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 16:02:53.678153 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.678121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bda009fa-5989-4796-9a6d-0e93e8e40d5e-registry-certificates\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.678290 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.678158    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bda009fa-5989-4796-9a6d-0e93e8e40d5e-image-registry-private-configuration\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.678290 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.678210    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bda009fa-5989-4796-9a6d-0e93e8e40d5e-ca-trust-extracted\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.678290 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.678243    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bda009fa-5989-4796-9a6d-0e93e8e40d5e-bound-sa-token\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.678393 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.678303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bda009fa-5989-4796-9a6d-0e93e8e40d5e-trusted-ca\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.678393 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.678326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97lpq\" (UniqueName: \"kubernetes.io/projected/bda009fa-5989-4796-9a6d-0e93e8e40d5e-kube-api-access-97lpq\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.678393 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.678360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda009fa-5989-4796-9a6d-0e93e8e40d5e-registry-tls\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.678393 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.678388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bda009fa-5989-4796-9a6d-0e93e8e40d5e-installation-pull-secrets\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.723241 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.723210    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:53.757701 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.757671    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7"
Sep 10 16:02:53.779134 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.779100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bda009fa-5989-4796-9a6d-0e93e8e40d5e-ca-trust-extracted\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.779306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.779144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bda009fa-5989-4796-9a6d-0e93e8e40d5e-bound-sa-token\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.779306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.779197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bda009fa-5989-4796-9a6d-0e93e8e40d5e-trusted-ca\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.779306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.779224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97lpq\" (UniqueName: \"kubernetes.io/projected/bda009fa-5989-4796-9a6d-0e93e8e40d5e-kube-api-access-97lpq\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.779306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.779246    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda009fa-5989-4796-9a6d-0e93e8e40d5e-registry-tls\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.779532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.779365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bda009fa-5989-4796-9a6d-0e93e8e40d5e-installation-pull-secrets\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.779532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.779417    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bda009fa-5989-4796-9a6d-0e93e8e40d5e-registry-certificates\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.779532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.779451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bda009fa-5989-4796-9a6d-0e93e8e40d5e-image-registry-private-configuration\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.779690 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.779542    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bda009fa-5989-4796-9a6d-0e93e8e40d5e-ca-trust-extracted\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.780239 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.780216    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bda009fa-5989-4796-9a6d-0e93e8e40d5e-registry-certificates\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.780344 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.780302    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bda009fa-5989-4796-9a6d-0e93e8e40d5e-trusted-ca\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.782423 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.782404    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda009fa-5989-4796-9a6d-0e93e8e40d5e-registry-tls\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.782423 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.782408    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bda009fa-5989-4796-9a6d-0e93e8e40d5e-image-registry-private-configuration\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.782602 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.782510    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bda009fa-5989-4796-9a6d-0e93e8e40d5e-installation-pull-secrets\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.818553 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.818522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97lpq\" (UniqueName: \"kubernetes.io/projected/bda009fa-5989-4796-9a6d-0e93e8e40d5e-kube-api-access-97lpq\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.828353 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.828324    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bda009fa-5989-4796-9a6d-0e93e8e40d5e-bound-sa-token\") pod \"image-registry-7fd74bd6-pn6k5\" (UID: \"bda009fa-5989-4796-9a6d-0e93e8e40d5e\") " pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:53.948218 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:53.948134    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:54.032990 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.032964    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"]
Sep 10 16:02:54.035884 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:02:54.035861    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775cb164_3c38_41d7_b669_af1fc79f57de.slice/crio-66a30fee4eaf49bfffb0d18333f43d8cd8c0bd53d4a22afc8b3f85031128f55b WatchSource:0}: Error finding container 66a30fee4eaf49bfffb0d18333f43d8cd8c0bd53d4a22afc8b3f85031128f55b: Status 404 returned error can't find the container with id 66a30fee4eaf49bfffb0d18333f43d8cd8c0bd53d4a22afc8b3f85031128f55b
Sep 10 16:02:54.073485 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.073454    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7"]
Sep 10 16:02:54.076929 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:02:54.076900    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08751379_014f_44ac_a23c_ddc2efe74890.slice/crio-385f159aa5378cf5621d318fb8c527e04bf325e69605a651a6a67b1359e4b6e1 WatchSource:0}: Error finding container 385f159aa5378cf5621d318fb8c527e04bf325e69605a651a6a67b1359e4b6e1: Status 404 returned error can't find the container with id 385f159aa5378cf5621d318fb8c527e04bf325e69605a651a6a67b1359e4b6e1
Sep 10 16:02:54.256532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.256498    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fd74bd6-pn6k5"]
Sep 10 16:02:54.259460 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:02:54.259432    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda009fa_5989_4796_9a6d_0e93e8e40d5e.slice/crio-475c63d64a65ff1db46811678194bc9afd7e3ecc1f9d0e55d33406d85678d0ff WatchSource:0}: Error finding container 475c63d64a65ff1db46811678194bc9afd7e3ecc1f9d0e55d33406d85678d0ff: Status 404 returned error can't find the container with id 475c63d64a65ff1db46811678194bc9afd7e3ecc1f9d0e55d33406d85678d0ff
Sep 10 16:02:54.335096 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.335059    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7" event={"ID":"08751379-014f-44ac-a23c-ddc2efe74890","Type":"ContainerStarted","Data":"385f159aa5378cf5621d318fb8c527e04bf325e69605a651a6a67b1359e4b6e1"}
Sep 10 16:02:54.336246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.336217    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r" event={"ID":"775cb164-3c38-41d7-b669-af1fc79f57de","Type":"ContainerStarted","Data":"66a30fee4eaf49bfffb0d18333f43d8cd8c0bd53d4a22afc8b3f85031128f55b"}
Sep 10 16:02:54.337708 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.337681    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5" event={"ID":"bda009fa-5989-4796-9a6d-0e93e8e40d5e","Type":"ContainerStarted","Data":"d3653e151c8a020b76c2d8ff91aa4cb762eddbbeed4a9daa923d229d6445de50"}
Sep 10 16:02:54.337831 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.337750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5" event={"ID":"bda009fa-5989-4796-9a6d-0e93e8e40d5e","Type":"ContainerStarted","Data":"475c63d64a65ff1db46811678194bc9afd7e3ecc1f9d0e55d33406d85678d0ff"}
Sep 10 16:02:54.337831 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.337782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:02:54.369349 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.369294    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5" podStartSLOduration=1.369277058 podStartE2EDuration="1.369277058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:54.36891382 +0000 UTC m=+58.781000029" watchObservedRunningTime="2026-09-10 16:02:54.369277058 +0000 UTC m=+58.781363261"
Sep 10 16:02:54.778436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.778398    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j"]
Sep 10 16:02:54.781335 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.781315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j"
Sep 10 16:02:54.784239 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.784211    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 10 16:02:54.784379 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.784357    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4kpvq\""
Sep 10 16:02:54.804426 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.804393    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j"]
Sep 10 16:02:54.888777 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.888743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60be0a0f-58f5-4243-b06c-64a0b26d40b1-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-jxp6j\" (UID: \"60be0a0f-58f5-4243-b06c-64a0b26d40b1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j"
Sep 10 16:02:54.989208 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.989173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60be0a0f-58f5-4243-b06c-64a0b26d40b1-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-jxp6j\" (UID: \"60be0a0f-58f5-4243-b06c-64a0b26d40b1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j"
Sep 10 16:02:54.991636 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:54.991604    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60be0a0f-58f5-4243-b06c-64a0b26d40b1-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-jxp6j\" (UID: \"60be0a0f-58f5-4243-b06c-64a0b26d40b1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j"
Sep 10 16:02:55.090457 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:55.090368    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j"
Sep 10 16:02:55.227713 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:55.227686    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-469b9"
Sep 10 16:02:55.443013 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:55.442919    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j"]
Sep 10 16:02:55.449557 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:02:55.449526    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60be0a0f_58f5_4243_b06c_64a0b26d40b1.slice/crio-93e5fadd138878e8dbd1fb86f15dea98048147c72424bfcbad5a6cea652be3c4 WatchSource:0}: Error finding container 93e5fadd138878e8dbd1fb86f15dea98048147c72424bfcbad5a6cea652be3c4: Status 404 returned error can't find the container with id 93e5fadd138878e8dbd1fb86f15dea98048147c72424bfcbad5a6cea652be3c4
Sep 10 16:02:56.349424 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:56.349384    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j" event={"ID":"60be0a0f-58f5-4243-b06c-64a0b26d40b1","Type":"ContainerStarted","Data":"93e5fadd138878e8dbd1fb86f15dea98048147c72424bfcbad5a6cea652be3c4"}
Sep 10 16:02:57.314037 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:57.314004    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xz4lx"
Sep 10 16:02:59.362527 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:59.362492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r" event={"ID":"775cb164-3c38-41d7-b669-af1fc79f57de","Type":"ContainerStarted","Data":"b4dc63841dc7dcc0c86c6006ea639ad62a9e442ae58aa0a58e57f669a64e3469"}
Sep 10 16:02:59.363262 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:59.363245    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:59.365641 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:59.365469    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r"
Sep 10 16:02:59.367200 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:59.367125    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j" event={"ID":"60be0a0f-58f5-4243-b06c-64a0b26d40b1","Type":"ContainerStarted","Data":"6965332c433431253878f36876ff126b0841488c259cf24678f57b203e1d8ab0"}
Sep 10 16:02:59.367380 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:59.367366    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j"
Sep 10 16:02:59.369746 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:59.369692    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7" event={"ID":"08751379-014f-44ac-a23c-ddc2efe74890","Type":"ContainerStarted","Data":"07aa338e99db2180ac41c464919b03ab47e5d44c463286a7662199b4f58c8c40"}
Sep 10 16:02:59.372628 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:59.372607    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j"
Sep 10 16:02:59.402177 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:59.402125    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-777c4c458b-8q56r" podStartSLOduration=1.224035101 podStartE2EDuration="6.402107649s" totalImagesPullingTime="5.178072548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:59.40066028 +0000 UTC m=+63.812746488" watchObservedRunningTime="2026-09-10 16:02:59.402107649 +0000 UTC m=+63.814193857"
Sep 10 16:02:59.450692 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:59.450637    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-588ff99d44-6v2d7" podStartSLOduration=1.289762456 podStartE2EDuration="6.450620681s" totalImagesPullingTime="5.160858225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:59.449677271 +0000 UTC m=+63.861763458" watchObservedRunningTime="2026-09-10 16:02:59.450620681 +0000 UTC m=+63.862706890"
Sep 10 16:02:59.479374 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:02:59.479324    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jxp6j" podStartSLOduration=1.690763988 podStartE2EDuration="5.479306277s" totalImagesPullingTime="3.788542289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:02:59.478200447 +0000 UTC m=+63.890286656" watchObservedRunningTime="2026-09-10 16:02:59.479306277 +0000 UTC m=+63.891392487"
Sep 10 16:03:01.838281 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:01.838245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:03:01.840588 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:01.840564    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29d23217-e4bd-450d-afcd-032930e26933-metrics-certs\") pod \"network-metrics-daemon-pvd2k\" (UID: \"29d23217-e4bd-450d-afcd-032930e26933\") " pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:03:02.097123 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:02.097039    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-swxfx\""
Sep 10 16:03:02.105352 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:02.105330    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvd2k"
Sep 10 16:03:02.383279 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:02.383179    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pvd2k"]
Sep 10 16:03:02.387146 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:03:02.387117    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d23217_e4bd_450d_afcd_032930e26933.slice/crio-8999fae9047ede896b589b5f9ac249396ab9f1b7420658bcdd8d46001ead4e72 WatchSource:0}: Error finding container 8999fae9047ede896b589b5f9ac249396ab9f1b7420658bcdd8d46001ead4e72: Status 404 returned error can't find the container with id 8999fae9047ede896b589b5f9ac249396ab9f1b7420658bcdd8d46001ead4e72
Sep 10 16:03:03.384666 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.384633    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pvd2k" event={"ID":"29d23217-e4bd-450d-afcd-032930e26933","Type":"ContainerStarted","Data":"8999fae9047ede896b589b5f9ac249396ab9f1b7420658bcdd8d46001ead4e72"}
Sep 10 16:03:03.548783 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.548746    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-574fb6c79-858g7"]
Sep 10 16:03:03.551117 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.551096    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.554468 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.554433    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 16:03:03.554468 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.554457    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 16:03:03.554651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.554470    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 16:03:03.555922 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.555898    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 16:03:03.556088 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.556069    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 16:03:03.556154 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.556116    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 16:03:03.556217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.556198    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2k588\""
Sep 10 16:03:03.556270 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.556226    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 16:03:03.562274 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.562218    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 16:03:03.592055 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.592020    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-574fb6c79-858g7"]
Sep 10 16:03:03.652199 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.652108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-oauth-serving-cert\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.652199 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.652172    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-service-ca\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.652407 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.652209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-trusted-ca-bundle\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.652407 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.652288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-config\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.652407 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.652349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-serving-cert\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.652407 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.652386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-oauth-config\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.652564 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.652414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwcb7\" (UniqueName: \"kubernetes.io/projected/9b7272c5-f713-4ebd-92fe-442f20d40ab8-kube-api-access-xwcb7\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.753080 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.753045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-oauth-serving-cert\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.753268 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.753092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-service-ca\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.753268 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.753202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-trusted-ca-bundle\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.753268 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.753246    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-config\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.753426 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.753288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-serving-cert\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.753426 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.753326    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-oauth-config\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.753531 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.753498    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwcb7\" (UniqueName: \"kubernetes.io/projected/9b7272c5-f713-4ebd-92fe-442f20d40ab8-kube-api-access-xwcb7\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.753960 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.753932    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-service-ca\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.753960 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.753948    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-oauth-serving-cert\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.754284 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.754263    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-config\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.754356 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.754343    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-trusted-ca-bundle\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.755810 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.755791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-oauth-config\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.755888 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.755792    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-serving-cert\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.766432 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.766402    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwcb7\" (UniqueName: \"kubernetes.io/projected/9b7272c5-f713-4ebd-92fe-442f20d40ab8-kube-api-access-xwcb7\") pod \"console-574fb6c79-858g7\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") " pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:03.861750 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:03.861701    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:04.182868 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.182795    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-574fb6c79-858g7"]
Sep 10 16:03:04.186208 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:03:04.186180    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7272c5_f713_4ebd_92fe_442f20d40ab8.slice/crio-f510d2763bd8423e05b6bb8d6a818c7572c9fa4165e42b9342a72441d01789ff WatchSource:0}: Error finding container f510d2763bd8423e05b6bb8d6a818c7572c9fa4165e42b9342a72441d01789ff: Status 404 returned error can't find the container with id f510d2763bd8423e05b6bb8d6a818c7572c9fa4165e42b9342a72441d01789ff
Sep 10 16:03:04.389499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.389463    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574fb6c79-858g7" event={"ID":"9b7272c5-f713-4ebd-92fe-442f20d40ab8","Type":"ContainerStarted","Data":"f510d2763bd8423e05b6bb8d6a818c7572c9fa4165e42b9342a72441d01789ff"}
Sep 10 16:03:04.391267 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.391245    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pvd2k" event={"ID":"29d23217-e4bd-450d-afcd-032930e26933","Type":"ContainerStarted","Data":"7d76096e496d55a9595e8ba8dd29e1b50f9cafb91b1c85d70e3ce53fe016e032"}
Sep 10 16:03:04.391369 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.391287    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pvd2k" event={"ID":"29d23217-e4bd-450d-afcd-032930e26933","Type":"ContainerStarted","Data":"f7964bbdafca32b7d83fe416bfaa56fe7472ea2b22d786d62fa654c257f7e7b1"}
Sep 10 16:03:04.453276 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.453153    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pvd2k" podStartSLOduration=67.073895535 podStartE2EDuration="1m8.453134258s" totalImagesPullingTime="1.379238723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:04.453036114 +0000 UTC m=+68.865122350" watchObservedRunningTime="2026-09-10 16:03:04.453134258 +0000 UTC m=+68.865220466"
Sep 10 16:03:04.928045 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.928002    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"]
Sep 10 16:03:04.934618 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.934595    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:04.940428 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.939891    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 10 16:03:04.940428 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.939908    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 16:03:04.940428 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.939949    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 16:03:04.940428 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.939959    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2wgn6\""
Sep 10 16:03:04.940428 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.939898    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 16:03:04.940428 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.940290    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 10 16:03:04.956381 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.956356    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"]
Sep 10 16:03:04.961717 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.961668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr2pj\" (UniqueName: \"kubernetes.io/projected/de597ceb-a080-4263-9619-96d058a4d28a-kube-api-access-lr2pj\") pod \"openshift-state-metrics-657fd6c54-c7qbk\" (UID: \"de597ceb-a080-4263-9619-96d058a4d28a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:04.962174 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.962033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de597ceb-a080-4263-9619-96d058a4d28a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-c7qbk\" (UID: \"de597ceb-a080-4263-9619-96d058a4d28a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:04.962174 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.962074    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de597ceb-a080-4263-9619-96d058a4d28a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-c7qbk\" (UID: \"de597ceb-a080-4263-9619-96d058a4d28a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:04.962174 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.962130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de597ceb-a080-4263-9619-96d058a4d28a-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-c7qbk\" (UID: \"de597ceb-a080-4263-9619-96d058a4d28a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:04.977289 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.977237    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"]
Sep 10 16:03:04.994261 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.994147    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6zjts"]
Sep 10 16:03:04.995113 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.994548    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:04.999251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.997816    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 16:03:04.999251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.997824    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 16:03:04.999251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.998137    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 16:03:04.999251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:04.998315    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dbxpp\""
Sep 10 16:03:05.008733 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.008708    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.013480 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.013269    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-75jhs\""
Sep 10 16:03:05.013480 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.013319    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 16:03:05.013803 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.013779    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 16:03:05.014019 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.014004    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 16:03:05.024396 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.023913    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"]
Sep 10 16:03:05.063620 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.063512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.063620 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.063563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.063882 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.063624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af8b7029-1676-4170-ae1e-ed61dbc568a6-sys\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.063882 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.063666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fjk2\" (UniqueName: \"kubernetes.io/projected/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-api-access-6fjk2\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.063882 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.063716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-tls\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.063882 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.063766    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.063882 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.063792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af8b7029-1676-4170-ae1e-ed61dbc568a6-root\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.063882 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.063837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr2pj\" (UniqueName: \"kubernetes.io/projected/de597ceb-a080-4263-9619-96d058a4d28a-kube-api-access-lr2pj\") pod \"openshift-state-metrics-657fd6c54-c7qbk\" (UID: \"de597ceb-a080-4263-9619-96d058a4d28a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:05.063882 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.063877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-textfile\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.064222 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.063907    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.064222 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.063939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de597ceb-a080-4263-9619-96d058a4d28a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-c7qbk\" (UID: \"de597ceb-a080-4263-9619-96d058a4d28a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:05.064222 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.063985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de597ceb-a080-4263-9619-96d058a4d28a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-c7qbk\" (UID: \"de597ceb-a080-4263-9619-96d058a4d28a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:05.064222 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.064100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-wtmp\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.064222 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.064130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4szgx\" (UniqueName: \"kubernetes.io/projected/af8b7029-1676-4170-ae1e-ed61dbc568a6-kube-api-access-4szgx\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.064222 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.064170    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af8b7029-1676-4170-ae1e-ed61dbc568a6-metrics-client-ca\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.064492 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.064224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.064492 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.064250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.064492 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.064279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.064492 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.064322    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de597ceb-a080-4263-9619-96d058a4d28a-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-c7qbk\" (UID: \"de597ceb-a080-4263-9619-96d058a4d28a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:05.065072 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.065030    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de597ceb-a080-4263-9619-96d058a4d28a-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-c7qbk\" (UID: \"de597ceb-a080-4263-9619-96d058a4d28a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:05.068132 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.068108    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de597ceb-a080-4263-9619-96d058a4d28a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-c7qbk\" (UID: \"de597ceb-a080-4263-9619-96d058a4d28a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:05.069053 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.069011    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de597ceb-a080-4263-9619-96d058a4d28a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-c7qbk\" (UID: \"de597ceb-a080-4263-9619-96d058a4d28a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:05.081680 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.081619    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr2pj\" (UniqueName: \"kubernetes.io/projected/de597ceb-a080-4263-9619-96d058a4d28a-kube-api-access-lr2pj\") pod \"openshift-state-metrics-657fd6c54-c7qbk\" (UID: \"de597ceb-a080-4263-9619-96d058a4d28a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:05.165959 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.165502    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-textfile\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.165959 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.165561    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.165959 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.165597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-wtmp\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.165959 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.165619    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4szgx\" (UniqueName: \"kubernetes.io/projected/af8b7029-1676-4170-ae1e-ed61dbc568a6-kube-api-access-4szgx\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.165959 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.165907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-textfile\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.166352 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166057    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-wtmp\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.166352 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af8b7029-1676-4170-ae1e-ed61dbc568a6-metrics-client-ca\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.166352 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.166530 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.166706 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.166706 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.166706 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.166706 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.166706 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af8b7029-1676-4170-ae1e-ed61dbc568a6-sys\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.166706 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fjk2\" (UniqueName: \"kubernetes.io/projected/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-api-access-6fjk2\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.166706 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-tls\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.166706 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166773    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af8b7029-1676-4170-ae1e-ed61dbc568a6-metrics-client-ca\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.166706 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.167259 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af8b7029-1676-4170-ae1e-ed61dbc568a6-root\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.167259 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.166931    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af8b7029-1676-4170-ae1e-ed61dbc568a6-root\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.167259 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.167209    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.167403 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.167261    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af8b7029-1676-4170-ae1e-ed61dbc568a6-sys\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.167403 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:03:05.167332    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 10 16:03:05.167403 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:03:05.167385    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-tls podName:af8b7029-1676-4170-ae1e-ed61dbc568a6 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:05.667367157 +0000 UTC m=+70.079453351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-tls") pod "node-exporter-6zjts" (UID: "af8b7029-1676-4170-ae1e-ed61dbc568a6") : secret "node-exporter-tls" not found
Sep 10 16:03:05.167858 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:03:05.167561    2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 10 16:03:05.167858 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:03:05.167599    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-tls podName:b1d066a1-6a5a-4f93-8720-9ba4bce5a675 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:05.667585989 +0000 UTC m=+70.079672188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-cvxzw" (UID: "b1d066a1-6a5a-4f93-8720-9ba4bce5a675") : secret "kube-state-metrics-tls" not found
Sep 10 16:03:05.168241 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.168196    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.168487 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.168467    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.169880 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.169852    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.170910 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.170853    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.182192 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.182126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4szgx\" (UniqueName: \"kubernetes.io/projected/af8b7029-1676-4170-ae1e-ed61dbc568a6-kube-api-access-4szgx\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.182414 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.182393    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fjk2\" (UniqueName: \"kubernetes.io/projected/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-api-access-6fjk2\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.249810 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.249771    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"
Sep 10 16:03:05.572466 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.572111    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk"]
Sep 10 16:03:05.579194 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:03:05.579082    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde597ceb_a080_4263_9619_96d058a4d28a.slice/crio-32a92ea77f08c9bc83497a89a7318c27594139656ddaac58e29b8784b026dc81 WatchSource:0}: Error finding container 32a92ea77f08c9bc83497a89a7318c27594139656ddaac58e29b8784b026dc81: Status 404 returned error can't find the container with id 32a92ea77f08c9bc83497a89a7318c27594139656ddaac58e29b8784b026dc81
Sep 10 16:03:05.672997 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.672971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-tls\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.673114 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.673062    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:05.673179 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:03:05.673173    2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 10 16:03:05.673230 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:03:05.673223    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-tls podName:b1d066a1-6a5a-4f93-8720-9ba4bce5a675 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:06.673204581 +0000 UTC m=+71.085290773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-cvxzw" (UID: "b1d066a1-6a5a-4f93-8720-9ba4bce5a675") : secret "kube-state-metrics-tls" not found
Sep 10 16:03:05.676981 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.676884    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af8b7029-1676-4170-ae1e-ed61dbc568a6-node-exporter-tls\") pod \"node-exporter-6zjts\" (UID: \"af8b7029-1676-4170-ae1e-ed61dbc568a6\") " pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.920083 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:05.919996    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6zjts"
Sep 10 16:03:05.939085 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:03:05.939050    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf8b7029_1676_4170_ae1e_ed61dbc568a6.slice/crio-3c1111ddfb6704797a2fd2fbd2a3ce9b908dd8f9848ab9e336c16b98cd5fe7f8 WatchSource:0}: Error finding container 3c1111ddfb6704797a2fd2fbd2a3ce9b908dd8f9848ab9e336c16b98cd5fe7f8: Status 404 returned error can't find the container with id 3c1111ddfb6704797a2fd2fbd2a3ce9b908dd8f9848ab9e336c16b98cd5fe7f8
Sep 10 16:03:06.402017 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:06.401977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6zjts" event={"ID":"af8b7029-1676-4170-ae1e-ed61dbc568a6","Type":"ContainerStarted","Data":"3c1111ddfb6704797a2fd2fbd2a3ce9b908dd8f9848ab9e336c16b98cd5fe7f8"}
Sep 10 16:03:06.404097 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:06.404059    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk" event={"ID":"de597ceb-a080-4263-9619-96d058a4d28a","Type":"ContainerStarted","Data":"61eda0d2ef778f29d6bcf4c4977df82d4efc7f92fe9e77d59faf2d959b5d01a3"}
Sep 10 16:03:06.404222 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:06.404127    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk" event={"ID":"de597ceb-a080-4263-9619-96d058a4d28a","Type":"ContainerStarted","Data":"72d26093ddbbd3cc0fee78955d9beb53bd5a94260d3f3d6d6ca02fd9f3911be1"}
Sep 10 16:03:06.404222 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:06.404155    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk" event={"ID":"de597ceb-a080-4263-9619-96d058a4d28a","Type":"ContainerStarted","Data":"32a92ea77f08c9bc83497a89a7318c27594139656ddaac58e29b8784b026dc81"}
Sep 10 16:03:06.682588 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:06.682512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:06.685226 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:06.685193    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1d066a1-6a5a-4f93-8720-9ba4bce5a675-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-cvxzw\" (UID: \"b1d066a1-6a5a-4f93-8720-9ba4bce5a675\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:06.806832 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:06.806786    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"
Sep 10 16:03:07.703998 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:07.703828    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw"]
Sep 10 16:03:07.765099 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:03:07.765065    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d066a1_6a5a_4f93_8720_9ba4bce5a675.slice/crio-83fb10d90f52b4c5ab0ac751a868eba11f73052ed068dba8d817454f5fa9cc4b WatchSource:0}: Error finding container 83fb10d90f52b4c5ab0ac751a868eba11f73052ed068dba8d817454f5fa9cc4b: Status 404 returned error can't find the container with id 83fb10d90f52b4c5ab0ac751a868eba11f73052ed068dba8d817454f5fa9cc4b
Sep 10 16:03:08.413679 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.413598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574fb6c79-858g7" event={"ID":"9b7272c5-f713-4ebd-92fe-442f20d40ab8","Type":"ContainerStarted","Data":"94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81"}
Sep 10 16:03:08.415327 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.415178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw" event={"ID":"b1d066a1-6a5a-4f93-8720-9ba4bce5a675","Type":"ContainerStarted","Data":"83fb10d90f52b4c5ab0ac751a868eba11f73052ed068dba8d817454f5fa9cc4b"}
Sep 10 16:03:08.447430 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.447377    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-574fb6c79-858g7" podStartSLOduration=1.5390791849999998 podStartE2EDuration="5.447360165s" totalImagesPullingTime="3.90828098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:08.445451752 +0000 UTC m=+72.857537968" watchObservedRunningTime="2026-09-10 16:03:08.447360165 +0000 UTC m=+72.859446375"
Sep 10 16:03:08.649075 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.649002    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-96dfdd9-mh559"]
Sep 10 16:03:08.669617 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.669577    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.673692 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.673353    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 10 16:03:08.673692 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.673533    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 10 16:03:08.673692 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.673582    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 10 16:03:08.673912 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.673831    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 10 16:03:08.674039 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.674018    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5dqmx\""
Sep 10 16:03:08.674383 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.674128    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9k9m3tr4s2ein\""
Sep 10 16:03:08.674383 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.674218    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 10 16:03:08.676235 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.676215    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-96dfdd9-mh559"]
Sep 10 16:03:08.698330 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.698301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfcts\" (UniqueName: \"kubernetes.io/projected/664b53ac-193f-45e1-9d2d-91e840fd6f3d-kube-api-access-vfcts\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.698422 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.698347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/664b53ac-193f-45e1-9d2d-91e840fd6f3d-metrics-client-ca\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.698422 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.698411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.698520 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.698436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-grpc-tls\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.698520 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.698467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.698520 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.698490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.698670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.698560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.698670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.698613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-tls\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.799256 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.799223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.799256 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.799260    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-grpc-tls\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.799821 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.799287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.799821 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.799317    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.799821 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.799343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.799821 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.799381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-tls\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.799821 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.799423    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfcts\" (UniqueName: \"kubernetes.io/projected/664b53ac-193f-45e1-9d2d-91e840fd6f3d-kube-api-access-vfcts\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.799821 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.799459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/664b53ac-193f-45e1-9d2d-91e840fd6f3d-metrics-client-ca\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.800290 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.800260    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/664b53ac-193f-45e1-9d2d-91e840fd6f3d-metrics-client-ca\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.802179 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.802150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-grpc-tls\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.802282 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.802188    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.802366 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.802282    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.802617 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.802594    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.802617 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.802607    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-tls\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.802804 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.802662    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/664b53ac-193f-45e1-9d2d-91e840fd6f3d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.813082 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.813056    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfcts\" (UniqueName: \"kubernetes.io/projected/664b53ac-193f-45e1-9d2d-91e840fd6f3d-kube-api-access-vfcts\") pod \"thanos-querier-96dfdd9-mh559\" (UID: \"664b53ac-193f-45e1-9d2d-91e840fd6f3d\") " pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:08.982025 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:08.981939    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:09.281484 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:09.281453    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4xw78"
Sep 10 16:03:09.421141 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:09.421103    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk" event={"ID":"de597ceb-a080-4263-9619-96d058a4d28a","Type":"ContainerStarted","Data":"840796f1e642c86eaf9a09f5318600a6996d351cec42a3e7ab5a03b6e29d60ee"}
Sep 10 16:03:09.454047 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:09.454002    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-c7qbk" podStartSLOduration=2.855976276 podStartE2EDuration="5.453986768s" totalImagesPullingTime="2.598010492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:09.453482554 +0000 UTC m=+73.865568764" watchObservedRunningTime="2026-09-10 16:03:09.453986768 +0000 UTC m=+73.866072977"
Sep 10 16:03:09.851254 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:09.851229    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-96dfdd9-mh559"]
Sep 10 16:03:09.855707 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:03:09.855681    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664b53ac_193f_45e1_9d2d_91e840fd6f3d.slice/crio-e70656d986e14ec1de2c1e2b8e5a39a0ac0873c8a4fdeca721d64965d55357ea WatchSource:0}: Error finding container e70656d986e14ec1de2c1e2b8e5a39a0ac0873c8a4fdeca721d64965d55357ea: Status 404 returned error can't find the container with id e70656d986e14ec1de2c1e2b8e5a39a0ac0873c8a4fdeca721d64965d55357ea
Sep 10 16:03:09.980553 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:09.980518    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-574fb6c79-858g7"]
Sep 10 16:03:10.199529 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.199454    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"]
Sep 10 16:03:10.214116 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.214098    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.217101 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.217060    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 16:03:10.217101 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.217099    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 16:03:10.217265 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.217085    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 16:03:10.217265 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.217184    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-q5jmq\""
Sep 10 16:03:10.217438 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.217420    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 16:03:10.217482 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.217451    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 16:03:10.223361 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.223344    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 16:03:10.230337 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.230309    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"]
Sep 10 16:03:10.312113 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.312082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61179110-f966-4765-ac14-505a99718fdc-metrics-client-ca\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.312113 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.312115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qmkt\" (UniqueName: \"kubernetes.io/projected/61179110-f966-4765-ac14-505a99718fdc-kube-api-access-8qmkt\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.312274 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.312139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61179110-f966-4765-ac14-505a99718fdc-telemeter-client-tls\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.312274 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.312184    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61179110-f966-4765-ac14-505a99718fdc-serving-certs-ca-bundle\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.312274 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.312211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61179110-f966-4765-ac14-505a99718fdc-federate-client-tls\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.312375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.312281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61179110-f966-4765-ac14-505a99718fdc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.312375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.312304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61179110-f966-4765-ac14-505a99718fdc-secret-telemeter-client\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.312375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.312323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61179110-f966-4765-ac14-505a99718fdc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.413560 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.413521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61179110-f966-4765-ac14-505a99718fdc-metrics-client-ca\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.413560 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.413560    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qmkt\" (UniqueName: \"kubernetes.io/projected/61179110-f966-4765-ac14-505a99718fdc-kube-api-access-8qmkt\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.413815 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.413767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61179110-f966-4765-ac14-505a99718fdc-telemeter-client-tls\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.413875 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.413814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61179110-f966-4765-ac14-505a99718fdc-serving-certs-ca-bundle\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.413875 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.413842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61179110-f966-4765-ac14-505a99718fdc-federate-client-tls\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.413978 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.413928    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61179110-f966-4765-ac14-505a99718fdc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.414276 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.414252    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61179110-f966-4765-ac14-505a99718fdc-secret-telemeter-client\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.414360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.414294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61179110-f966-4765-ac14-505a99718fdc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.414591 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.414565    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61179110-f966-4765-ac14-505a99718fdc-metrics-client-ca\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.414682 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.414588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61179110-f966-4765-ac14-505a99718fdc-serving-certs-ca-bundle\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.415246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.415191    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61179110-f966-4765-ac14-505a99718fdc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.417018 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.416992    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61179110-f966-4765-ac14-505a99718fdc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.417307 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.417285    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61179110-f966-4765-ac14-505a99718fdc-telemeter-client-tls\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.417775 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.417752    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61179110-f966-4765-ac14-505a99718fdc-secret-telemeter-client\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.417846 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.417807    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61179110-f966-4765-ac14-505a99718fdc-federate-client-tls\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.428884 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.428858    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw" event={"ID":"b1d066a1-6a5a-4f93-8720-9ba4bce5a675","Type":"ContainerStarted","Data":"145462196c61cd08ff912be5b9420e914ef5aca0a5e27969ca144d01b1cb0dd0"}
Sep 10 16:03:10.428990 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.428923    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw" event={"ID":"b1d066a1-6a5a-4f93-8720-9ba4bce5a675","Type":"ContainerStarted","Data":"f95b1e84c4df1b1753951647358d2211d421e98f88259de14f86f3889835872a"}
Sep 10 16:03:10.428990 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.428955    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw" event={"ID":"b1d066a1-6a5a-4f93-8720-9ba4bce5a675","Type":"ContainerStarted","Data":"e414bf96ee984188492d5d273cbccc474127fd1f7d2fddff0032c7e9ffec82f7"}
Sep 10 16:03:10.430951 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.430925    2562 generic.go:356] "Generic (PLEG): container finished" podID="af8b7029-1676-4170-ae1e-ed61dbc568a6" containerID="e992a5289613a7d716154ddb46d04ba6ec821eb53cd43579f3781199f8574030" exitCode=0
Sep 10 16:03:10.431037 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.430956    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6zjts" event={"ID":"af8b7029-1676-4170-ae1e-ed61dbc568a6","Type":"ContainerDied","Data":"e992a5289613a7d716154ddb46d04ba6ec821eb53cd43579f3781199f8574030"}
Sep 10 16:03:10.434860 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.433444    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96dfdd9-mh559" event={"ID":"664b53ac-193f-45e1-9d2d-91e840fd6f3d","Type":"ContainerStarted","Data":"e70656d986e14ec1de2c1e2b8e5a39a0ac0873c8a4fdeca721d64965d55357ea"}
Sep 10 16:03:10.448293 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.448269    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qmkt\" (UniqueName: \"kubernetes.io/projected/61179110-f966-4765-ac14-505a99718fdc-kube-api-access-8qmkt\") pod \"telemeter-client-5ff96d8c57-8kzq7\" (UID: \"61179110-f966-4765-ac14-505a99718fdc\") " pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.472264 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.472181    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvxzw" podStartSLOduration=4.688730959 podStartE2EDuration="6.472162454s" totalImagesPullingTime="1.783431495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:10.471326332 +0000 UTC m=+74.883412543" watchObservedRunningTime="2026-09-10 16:03:10.472162454 +0000 UTC m=+74.884248664"
Sep 10 16:03:10.524266 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.524240    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"
Sep 10 16:03:10.846301 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:10.846272    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7"]
Sep 10 16:03:10.849511 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:03:10.849485    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61179110_f966_4765_ac14_505a99718fdc.slice/crio-7ee3a2d0c63bb3cd517919ffe0392145ae67d69cd76b176b1d1f9fca55112c3a WatchSource:0}: Error finding container 7ee3a2d0c63bb3cd517919ffe0392145ae67d69cd76b176b1d1f9fca55112c3a: Status 404 returned error can't find the container with id 7ee3a2d0c63bb3cd517919ffe0392145ae67d69cd76b176b1d1f9fca55112c3a
Sep 10 16:03:11.439369 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:11.439335    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6zjts" event={"ID":"af8b7029-1676-4170-ae1e-ed61dbc568a6","Type":"ContainerStarted","Data":"7ec94dbdaa618bf76f4b4770608c425a163e0224aab9b00fcab49c539c8c6950"}
Sep 10 16:03:11.439824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:11.439394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6zjts" event={"ID":"af8b7029-1676-4170-ae1e-ed61dbc568a6","Type":"ContainerStarted","Data":"d800bba338b7a3f70d3615a03095efb74ce1618a46d64542b63ff319c5499583"}
Sep 10 16:03:11.440668 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:11.440639    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7" event={"ID":"61179110-f966-4765-ac14-505a99718fdc","Type":"ContainerStarted","Data":"7ee3a2d0c63bb3cd517919ffe0392145ae67d69cd76b176b1d1f9fca55112c3a"}
Sep 10 16:03:11.464427 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:11.464379    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6zjts" podStartSLOduration=3.756473587 podStartE2EDuration="7.464365691s" totalImagesPullingTime="3.606765214s" totalInitContainerRuntime="101.12689ms" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:11.462758667 +0000 UTC m=+75.874844902" watchObservedRunningTime="2026-09-10 16:03:11.464365691 +0000 UTC m=+75.876451899"
Sep 10 16:03:12.447686 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:12.447653    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96dfdd9-mh559" event={"ID":"664b53ac-193f-45e1-9d2d-91e840fd6f3d","Type":"ContainerStarted","Data":"82e0caea9b173053423c484387a64dbf975b45406fd3eb0d03c33fa02f077902"}
Sep 10 16:03:12.448053 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:12.447744    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96dfdd9-mh559" event={"ID":"664b53ac-193f-45e1-9d2d-91e840fd6f3d","Type":"ContainerStarted","Data":"95696889b02e3551863181b0f535ca11cdabac0826c41a64b072306eb8172425"}
Sep 10 16:03:13.454473 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:13.454426    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96dfdd9-mh559" event={"ID":"664b53ac-193f-45e1-9d2d-91e840fd6f3d","Type":"ContainerStarted","Data":"6cafa239781c8b662bcea1a47e9019ae97e83e71f107f4745f22e4639f6b8039"}
Sep 10 16:03:13.455986 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:13.455964    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7" event={"ID":"61179110-f966-4765-ac14-505a99718fdc","Type":"ContainerStarted","Data":"9f6dca515f56adca2197491e01318b758ab46f71254f849c4aa9cba30a12fad8"}
Sep 10 16:03:13.862219 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:13.862199    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:14.463173 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:14.463149    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96dfdd9-mh559" event={"ID":"664b53ac-193f-45e1-9d2d-91e840fd6f3d","Type":"ContainerStarted","Data":"93a09395e77790dd0d51f6bdeaa4a050174920399d2647f50ff7d7616c22cce5"}
Sep 10 16:03:14.463524 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:14.463210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96dfdd9-mh559" event={"ID":"664b53ac-193f-45e1-9d2d-91e840fd6f3d","Type":"ContainerStarted","Data":"713f436559a56a23f21754ab2330e28850d023bde5bfaa076702b74232dd9293"}
Sep 10 16:03:14.463524 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:14.463237    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96dfdd9-mh559" event={"ID":"664b53ac-193f-45e1-9d2d-91e840fd6f3d","Type":"ContainerStarted","Data":"c8e915f8b1ea711b64cf7c8018790d9fdec50e042bfcd06e7343e291e1b4fb88"}
Sep 10 16:03:14.463524 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:14.463315    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:14.491792 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:14.491710    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-96dfdd9-mh559" podStartSLOduration=2.981409935 podStartE2EDuration="6.491690535s" totalImagesPullingTime="3.5102806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:14.491410454 +0000 UTC m=+78.903496664" watchObservedRunningTime="2026-09-10 16:03:14.491690535 +0000 UTC m=+78.903776745"
Sep 10 16:03:15.348286 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:15.348259    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fd74bd6-pn6k5"
Sep 10 16:03:15.469247 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:15.469211    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7" event={"ID":"61179110-f966-4765-ac14-505a99718fdc","Type":"ContainerStarted","Data":"d38767fdf856a3111902df0dc920473814062726456a388d380bb691276dfaec"}
Sep 10 16:03:15.469750 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:15.469282    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7" event={"ID":"61179110-f966-4765-ac14-505a99718fdc","Type":"ContainerStarted","Data":"ab67309116ad27a0fee470f19faf709cee67672dce82ef208ed2760d491eaf73"}
Sep 10 16:03:15.525885 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:15.525830    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5ff96d8c57-8kzq7" podStartSLOduration=1.9943229040000001 podStartE2EDuration="5.525788251s" totalImagesPullingTime="3.531465347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:15.524751173 +0000 UTC m=+79.936837384" watchObservedRunningTime="2026-09-10 16:03:15.525788251 +0000 UTC m=+79.937874470"
Sep 10 16:03:20.474881 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:20.474698    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-96dfdd9-mh559"
Sep 10 16:03:35.457094 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.457011    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-574fb6c79-858g7" podUID="9b7272c5-f713-4ebd-92fe-442f20d40ab8" containerName="console" containerID="cri-o://94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81" gracePeriod=15
Sep 10 16:03:35.694969 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.694942    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:35.837589 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.837555    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-oauth-config\") pod \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") "
Sep 10 16:03:35.837787 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.837610    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-serving-cert\") pod \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") "
Sep 10 16:03:35.837787 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.837642    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-trusted-ca-bundle\") pod \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") "
Sep 10 16:03:35.837787 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.837665    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwcb7\" (UniqueName: \"kubernetes.io/projected/9b7272c5-f713-4ebd-92fe-442f20d40ab8-kube-api-access-xwcb7\") pod \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") "
Sep 10 16:03:35.837787 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.837681    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-config\") pod \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") "
Sep 10 16:03:35.837787 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.837713    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-service-ca\") pod \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") "
Sep 10 16:03:35.838063 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.837859    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-oauth-serving-cert\") pod \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\" (UID: \"9b7272c5-f713-4ebd-92fe-442f20d40ab8\") "
Sep 10 16:03:35.838375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.838241    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-service-ca" (OuterVolumeSpecName: "service-ca") pod "9b7272c5-f713-4ebd-92fe-442f20d40ab8" (UID: "9b7272c5-f713-4ebd-92fe-442f20d40ab8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:03:35.838375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.838197    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-config" (OuterVolumeSpecName: "console-config") pod "9b7272c5-f713-4ebd-92fe-442f20d40ab8" (UID: "9b7272c5-f713-4ebd-92fe-442f20d40ab8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:03:35.838375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.838330    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9b7272c5-f713-4ebd-92fe-442f20d40ab8" (UID: "9b7272c5-f713-4ebd-92fe-442f20d40ab8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:03:35.838375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.838342    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9b7272c5-f713-4ebd-92fe-442f20d40ab8" (UID: "9b7272c5-f713-4ebd-92fe-442f20d40ab8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:03:35.840069 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.840052    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9b7272c5-f713-4ebd-92fe-442f20d40ab8" (UID: "9b7272c5-f713-4ebd-92fe-442f20d40ab8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 16:03:35.840258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.840237    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9b7272c5-f713-4ebd-92fe-442f20d40ab8" (UID: "9b7272c5-f713-4ebd-92fe-442f20d40ab8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 16:03:35.840315 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.840264    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b7272c5-f713-4ebd-92fe-442f20d40ab8-kube-api-access-xwcb7" (OuterVolumeSpecName: "kube-api-access-xwcb7") pod "9b7272c5-f713-4ebd-92fe-442f20d40ab8" (UID: "9b7272c5-f713-4ebd-92fe-442f20d40ab8"). InnerVolumeSpecName "kube-api-access-xwcb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:03:35.939102 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.939056    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-serving-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:03:35.939102 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.939094    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-trusted-ca-bundle\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:03:35.939102 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.939104    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwcb7\" (UniqueName: \"kubernetes.io/projected/9b7272c5-f713-4ebd-92fe-442f20d40ab8-kube-api-access-xwcb7\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:03:35.939102 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.939114    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-config\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:03:35.939102 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.939123    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-service-ca\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:03:35.939387 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.939130    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b7272c5-f713-4ebd-92fe-442f20d40ab8-oauth-serving-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:03:35.939387 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:35.939139    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b7272c5-f713-4ebd-92fe-442f20d40ab8-console-oauth-config\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:03:36.547125 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:36.547089    2562 generic.go:356] "Generic (PLEG): container finished" podID="9b7272c5-f713-4ebd-92fe-442f20d40ab8" containerID="94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81" exitCode=0
Sep 10 16:03:36.547526 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:36.547134    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574fb6c79-858g7"
Sep 10 16:03:36.547526 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:36.547165    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574fb6c79-858g7" event={"ID":"9b7272c5-f713-4ebd-92fe-442f20d40ab8","Type":"ContainerDied","Data":"94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81"}
Sep 10 16:03:36.547526 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:36.547214    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574fb6c79-858g7" event={"ID":"9b7272c5-f713-4ebd-92fe-442f20d40ab8","Type":"ContainerDied","Data":"f510d2763bd8423e05b6bb8d6a818c7572c9fa4165e42b9342a72441d01789ff"}
Sep 10 16:03:36.547526 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:36.547241    2562 scope.go:117] "RemoveContainer" containerID="94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81"
Sep 10 16:03:36.555443 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:36.555420    2562 scope.go:117] "RemoveContainer" containerID="94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81"
Sep 10 16:03:36.555738 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:03:36.555700    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81\": container with ID starting with 94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81 not found: ID does not exist" containerID="94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81"
Sep 10 16:03:36.555800 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:36.555751    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81"} err="failed to get container status \"94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81\": rpc error: code = NotFound desc = could not find container \"94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81\": container with ID starting with 94bcac5491925f4adc1f5ec7317b6574996c4549a29e5234e5e49b29a5d6fa81 not found: ID does not exist"
Sep 10 16:03:36.571118 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:36.571093    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-574fb6c79-858g7"]
Sep 10 16:03:36.575266 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:36.575238    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-574fb6c79-858g7"]
Sep 10 16:03:38.070146 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:03:38.070113    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b7272c5-f713-4ebd-92fe-442f20d40ab8" path="/var/lib/kubelet/pods/9b7272c5-f713-4ebd-92fe-442f20d40ab8/volumes"
Sep 10 16:06:55.954717 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:06:55.954689    2562 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 16:08:16.111879 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.111844    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 16:08:16.112370 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.112119    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7272c5-f713-4ebd-92fe-442f20d40ab8" containerName="console"
Sep 10 16:08:16.112370 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.112131    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7272c5-f713-4ebd-92fe-442f20d40ab8" containerName="console"
Sep 10 16:08:16.112370 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.112190    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b7272c5-f713-4ebd-92fe-442f20d40ab8" containerName="console"
Sep 10 16:08:16.115473 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.115458    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.118563 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.118539    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 16:08:16.120277 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.120258    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 16:08:16.120543 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.120525    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 16:08:16.120660 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.120575    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mnng7\""
Sep 10 16:08:16.120770 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.120575    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 16:08:16.120770 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.120575    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 16:08:16.120770 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.120600    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 16:08:16.120965 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.120601    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 16:08:16.122811 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.122629    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 16:08:16.122811 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.122628    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 16:08:16.122811 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.122630    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 16:08:16.122811 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.122675    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 16:08:16.122811 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.122678    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 16:08:16.122811 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.122691    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 16:08:16.122811 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.122635    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-34ojh6k224dnc\""
Sep 10 16:08:16.127460 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.127443    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 16:08:16.130109 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.130093    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 16:08:16.140714 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.140685    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 16:08:16.234999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.234958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4f5f431-c2bb-4c99-a329-367cbdd0583d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.234999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.234996    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4f5f431-c2bb-4c99-a329-367cbdd0583d-config-out\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235237 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235237 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235032    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-config\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235237 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235074    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235237 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235237 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235236    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235671 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235671 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235466    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235671 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235671 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-web-config\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235671 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vlj8\" (UniqueName: \"kubernetes.io/projected/f4f5f431-c2bb-4c99-a329-367cbdd0583d-kube-api-access-7vlj8\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.235671 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.235569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.336698 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.336698 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336697    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.336971 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336721    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.336971 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336753    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.336971 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.336971 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.336971 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.336971 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.336971 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.336971 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-web-config\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.336971 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336931    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vlj8\" (UniqueName: \"kubernetes.io/projected/f4f5f431-c2bb-4c99-a329-367cbdd0583d-kube-api-access-7vlj8\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.336971 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337454 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.336985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4f5f431-c2bb-4c99-a329-367cbdd0583d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337454 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4f5f431-c2bb-4c99-a329-367cbdd0583d-config-out\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337454 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337454 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-config\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337454 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337454 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337454 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337454 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337454 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337243    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337926 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337523    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337926 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337564    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337926 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337703    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.337926 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337830    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.338098 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.337943    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.338615 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.338590    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.339987 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.339958    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.340155 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.340133    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.340382 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.340359    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.340532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.340510    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-config\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.341740 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.341704    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4f5f431-c2bb-4c99-a329-367cbdd0583d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.342000 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.341980    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4f5f431-c2bb-4c99-a329-367cbdd0583d-config-out\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.342148 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.342120    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-web-config\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.342251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.342228    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.342501 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.342482    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4f5f431-c2bb-4c99-a329-367cbdd0583d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.342637 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.342613    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.342902 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.342884    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.343087 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.343063    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4f5f431-c2bb-4c99-a329-367cbdd0583d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.347974 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.347953    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vlj8\" (UniqueName: \"kubernetes.io/projected/f4f5f431-c2bb-4c99-a329-367cbdd0583d-kube-api-access-7vlj8\") pod \"prometheus-k8s-0\" (UID: \"f4f5f431-c2bb-4c99-a329-367cbdd0583d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.425506 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.425419    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:08:16.708233 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:16.707971    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 16:08:16.711158 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:08:16.711116    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f5f431_c2bb_4c99_a329_367cbdd0583d.slice/crio-0790a1ae00b44dd588a17dd417722e1585cc93f750e55beda0db4838980c623a WatchSource:0}: Error finding container 0790a1ae00b44dd588a17dd417722e1585cc93f750e55beda0db4838980c623a: Status 404 returned error can't find the container with id 0790a1ae00b44dd588a17dd417722e1585cc93f750e55beda0db4838980c623a
Sep 10 16:08:17.540271 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:17.540239    2562 generic.go:356] "Generic (PLEG): container finished" podID="f4f5f431-c2bb-4c99-a329-367cbdd0583d" containerID="fceba5bf88ff3eef88cb9c33eb20a45a2fb8a2e359a5eab17cbe214a660fc6cd" exitCode=0
Sep 10 16:08:17.540649 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:17.540334    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4f5f431-c2bb-4c99-a329-367cbdd0583d","Type":"ContainerDied","Data":"fceba5bf88ff3eef88cb9c33eb20a45a2fb8a2e359a5eab17cbe214a660fc6cd"}
Sep 10 16:08:17.540649 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:17.540399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4f5f431-c2bb-4c99-a329-367cbdd0583d","Type":"ContainerStarted","Data":"0790a1ae00b44dd588a17dd417722e1585cc93f750e55beda0db4838980c623a"}
Sep 10 16:08:17.541570 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:17.541554    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 16:08:21.560519 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:21.560486    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4f5f431-c2bb-4c99-a329-367cbdd0583d","Type":"ContainerStarted","Data":"e7351326700d74462bf70cf0d4e2ee0544fee957bb184f2d55080568c35c35e8"}
Sep 10 16:08:21.560916 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:21.560557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4f5f431-c2bb-4c99-a329-367cbdd0583d","Type":"ContainerStarted","Data":"eff1bec7fb0be6bc3bff751f3fafe9519bea092df7fdf58282481f69f37a0635"}
Sep 10 16:08:21.560916 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:21.560585    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4f5f431-c2bb-4c99-a329-367cbdd0583d","Type":"ContainerStarted","Data":"3609b80dbc9b8cbbe758d847c66d964124cf5b7806ea1c7ef2c41591310b0341"}
Sep 10 16:08:21.560916 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:21.560610    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4f5f431-c2bb-4c99-a329-367cbdd0583d","Type":"ContainerStarted","Data":"74d100d0ad615f49badc68e388f0977e56eb659b8f207e90abe2fd594fbd4275"}
Sep 10 16:08:21.560916 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:21.560641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4f5f431-c2bb-4c99-a329-367cbdd0583d","Type":"ContainerStarted","Data":"7863282659de4e363cb793310bdd78c465b7640b3848268aeb67dd6f3d2d2e60"}
Sep 10 16:08:21.560916 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:21.560674    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4f5f431-c2bb-4c99-a329-367cbdd0583d","Type":"ContainerStarted","Data":"76683ad478e3927dd3fb3c4f1a2b316ad48cc960eb1fe34640a32f46cbeec47e"}
Sep 10 16:08:21.594009 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:21.593951    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.615499904 podStartE2EDuration="5.593934511s" totalImagesPullingTime="2.957623353s" totalInitContainerRuntime="20.811254ms" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:21.591174756 +0000 UTC m=+386.003260965" watchObservedRunningTime="2026-09-10 16:08:21.593934511 +0000 UTC m=+386.006020719"
Sep 10 16:08:26.426021 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:08:26.425984    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:09:16.426566 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:09:16.426523    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:09:16.445590 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:09:16.445563    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:09:16.782344 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:09:16.782317    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 16:11:48.266985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.266947    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"]
Sep 10 16:11:48.269230 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.269212    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.274739 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:11:48.274698    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" is forbidden: User \"system:node:ip-10-0-132-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-43.ec2.internal' and this object" podUID="0e459f82-7a27-401e-bb40-929b46a7c16f" pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.274867 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:11:48.274748    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-132-43.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-43.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret"
Sep 10 16:11:48.275641 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:11:48.275330    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-132-43.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-43.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret"
Sep 10 16:11:48.275641 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:11:48.275348    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-9p2dd\" is forbidden: User \"system:node:ip-10-0-132-43.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-43.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9p2dd\"" type="*v1.Secret"
Sep 10 16:11:48.275988 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.275968    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 16:11:48.276140 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.276119    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 16:11:48.377012 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.376969    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e459f82-7a27-401e-bb40-929b46a7c16f-webhook-cert\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.377182 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.377023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e459f82-7a27-401e-bb40-929b46a7c16f-manifests\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.377182 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.377098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plqhk\" (UniqueName: \"kubernetes.io/projected/0e459f82-7a27-401e-bb40-929b46a7c16f-kube-api-access-plqhk\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.377182 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.377150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e459f82-7a27-401e-bb40-929b46a7c16f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.377182 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.377175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e459f82-7a27-401e-bb40-929b46a7c16f-tmp\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.390842 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.390811    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"]
Sep 10 16:11:48.477707 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.477667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e459f82-7a27-401e-bb40-929b46a7c16f-webhook-cert\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.477904 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.477743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e459f82-7a27-401e-bb40-929b46a7c16f-manifests\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.477904 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.477792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plqhk\" (UniqueName: \"kubernetes.io/projected/0e459f82-7a27-401e-bb40-929b46a7c16f-kube-api-access-plqhk\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.477904 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.477844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e459f82-7a27-401e-bb40-929b46a7c16f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.477904 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.477876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e459f82-7a27-401e-bb40-929b46a7c16f-tmp\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.478261 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.478242    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e459f82-7a27-401e-bb40-929b46a7c16f-manifests\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.480148 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.480124    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e459f82-7a27-401e-bb40-929b46a7c16f-tmp\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:48.510385 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:48.510353    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plqhk\" (UniqueName: \"kubernetes.io/projected/0e459f82-7a27-401e-bb40-929b46a7c16f-kube-api-access-plqhk\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:49.436176 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:49.436139    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 16:11:49.476410 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:49.476380    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 16:11:49.480746 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:49.480699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e459f82-7a27-401e-bb40-929b46a7c16f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:49.480858 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:49.480776    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e459f82-7a27-401e-bb40-929b46a7c16f-webhook-cert\") pod \"opendatahub-operator-controller-manager-67779d4d4c-6wrbw\" (UID: \"0e459f82-7a27-401e-bb40-929b46a7c16f\") " pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:49.760304 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:49.760274    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9p2dd\""
Sep 10 16:11:49.779620 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:49.779589    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:50.072529 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:50.072470    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"]
Sep 10 16:11:50.074671 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:11:50.074629    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e459f82_7a27_401e_bb40_929b46a7c16f.slice/crio-556816cc630f0894cc72acb6aa2140d51def21589a5bd410bb5bd981fa4068db WatchSource:0}: Error finding container 556816cc630f0894cc72acb6aa2140d51def21589a5bd410bb5bd981fa4068db: Status 404 returned error can't find the container with id 556816cc630f0894cc72acb6aa2140d51def21589a5bd410bb5bd981fa4068db
Sep 10 16:11:50.355704 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:50.355609    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw" event={"ID":"0e459f82-7a27-401e-bb40-929b46a7c16f","Type":"ContainerStarted","Data":"556816cc630f0894cc72acb6aa2140d51def21589a5bd410bb5bd981fa4068db"}
Sep 10 16:11:53.370981 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:53.370938    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw" event={"ID":"0e459f82-7a27-401e-bb40-929b46a7c16f","Type":"ContainerStarted","Data":"03a27d6abaa2295ce3f5f591f8e5575acf7f5f63c49f1833763e40c36dbd743c"}
Sep 10 16:11:54.376134 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:54.376093    2562 generic.go:356] "Generic (PLEG): container finished" podID="0e459f82-7a27-401e-bb40-929b46a7c16f" containerID="03a27d6abaa2295ce3f5f591f8e5575acf7f5f63c49f1833763e40c36dbd743c" exitCode=0
Sep 10 16:11:54.376505 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:54.376171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw" event={"ID":"0e459f82-7a27-401e-bb40-929b46a7c16f","Type":"ContainerDied","Data":"03a27d6abaa2295ce3f5f591f8e5575acf7f5f63c49f1833763e40c36dbd743c"}
Sep 10 16:11:55.382329 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:55.382246    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw" event={"ID":"0e459f82-7a27-401e-bb40-929b46a7c16f","Type":"ContainerStarted","Data":"cf21b73555ae39493627e4864c12b74f13e986098dadaa93d041a7d33b1d525a"}
Sep 10 16:11:55.382329 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:55.382320    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:11:55.429049 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:11:55.429003    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw" podStartSLOduration=2.952226371 podStartE2EDuration="7.428985946s" totalImagesPullingTime="3.402246946s" totalInitContainerRuntime="1.074512629s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:11:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:11:55.426376189 +0000 UTC m=+599.838462399" watchObservedRunningTime="2026-09-10 16:11:55.428985946 +0000 UTC m=+599.841072155"
Sep 10 16:12:06.388979 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:06.388948    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67779d4d4c-6wrbw"
Sep 10 16:12:17.170713 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.170676    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"]
Sep 10 16:12:17.183482 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.183460    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.187250 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.187222    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"]
Sep 10 16:12:17.187767 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.187749    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 16:12:17.187996 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.187980    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nlsw9\""
Sep 10 16:12:17.188147 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.188122    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 16:12:17.188210 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.188150    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 16:12:17.188210 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.188198    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 16:12:17.188312 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.188249    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 16:12:17.325792 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.325763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb4jl\" (UniqueName: \"kubernetes.io/projected/bd730c90-54c5-452f-b33d-0b0d6a9d782f-kube-api-access-sb4jl\") pod \"lws-controller-manager-84479dc8dd-s27xz\" (UID: \"bd730c90-54c5-452f-b33d-0b0d6a9d782f\") " pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.325945 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.325812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd730c90-54c5-452f-b33d-0b0d6a9d782f-cert\") pod \"lws-controller-manager-84479dc8dd-s27xz\" (UID: \"bd730c90-54c5-452f-b33d-0b0d6a9d782f\") " pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.325945 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.325905    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd730c90-54c5-452f-b33d-0b0d6a9d782f-metrics-cert\") pod \"lws-controller-manager-84479dc8dd-s27xz\" (UID: \"bd730c90-54c5-452f-b33d-0b0d6a9d782f\") " pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.325945 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.325938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bd730c90-54c5-452f-b33d-0b0d6a9d782f-manager-config\") pod \"lws-controller-manager-84479dc8dd-s27xz\" (UID: \"bd730c90-54c5-452f-b33d-0b0d6a9d782f\") " pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.329471 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.329444    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"]
Sep 10 16:12:17.331798 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.331778    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.335769 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.335739    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 16:12:17.335769 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.335754    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 16:12:17.335944 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.335772    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 16:12:17.335944 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.335752    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8qjqb\""
Sep 10 16:12:17.349088 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.349064    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"]
Sep 10 16:12:17.426877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.426777    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.426877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.426816    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdjxq\" (UniqueName: \"kubernetes.io/projected/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-kube-api-access-sdjxq\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.426877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.426840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.426877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.426858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.427202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.426886    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.427202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.426926    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bd730c90-54c5-452f-b33d-0b0d6a9d782f-manager-config\") pod \"lws-controller-manager-84479dc8dd-s27xz\" (UID: \"bd730c90-54c5-452f-b33d-0b0d6a9d782f\") " pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.427202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.426949    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.427202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.426970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb4jl\" (UniqueName: \"kubernetes.io/projected/bd730c90-54c5-452f-b33d-0b0d6a9d782f-kube-api-access-sb4jl\") pod \"lws-controller-manager-84479dc8dd-s27xz\" (UID: \"bd730c90-54c5-452f-b33d-0b0d6a9d782f\") " pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.427202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.427026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.427202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.427072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd730c90-54c5-452f-b33d-0b0d6a9d782f-cert\") pod \"lws-controller-manager-84479dc8dd-s27xz\" (UID: \"bd730c90-54c5-452f-b33d-0b0d6a9d782f\") " pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.427202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.427154    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.427202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.427193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.427605 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.427223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd730c90-54c5-452f-b33d-0b0d6a9d782f-metrics-cert\") pod \"lws-controller-manager-84479dc8dd-s27xz\" (UID: \"bd730c90-54c5-452f-b33d-0b0d6a9d782f\") " pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.427693 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.427670    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bd730c90-54c5-452f-b33d-0b0d6a9d782f-manager-config\") pod \"lws-controller-manager-84479dc8dd-s27xz\" (UID: \"bd730c90-54c5-452f-b33d-0b0d6a9d782f\") " pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.429712 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.429686    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd730c90-54c5-452f-b33d-0b0d6a9d782f-metrics-cert\") pod \"lws-controller-manager-84479dc8dd-s27xz\" (UID: \"bd730c90-54c5-452f-b33d-0b0d6a9d782f\") " pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.429835 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.429716    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd730c90-54c5-452f-b33d-0b0d6a9d782f-cert\") pod \"lws-controller-manager-84479dc8dd-s27xz\" (UID: \"bd730c90-54c5-452f-b33d-0b0d6a9d782f\") " pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.437308 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.437282    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb4jl\" (UniqueName: \"kubernetes.io/projected/bd730c90-54c5-452f-b33d-0b0d6a9d782f-kube-api-access-sb4jl\") pod \"lws-controller-manager-84479dc8dd-s27xz\" (UID: \"bd730c90-54c5-452f-b33d-0b0d6a9d782f\") " pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.494473 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.494433    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:17.528045 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.527941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.528651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.528237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.528651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.528284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.528651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.528313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdjxq\" (UniqueName: \"kubernetes.io/projected/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-kube-api-access-sdjxq\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.528651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.528340    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.528651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.528368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.528651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.528401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.528651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.528453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.528651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.528513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.529355 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.529329    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.529765 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.529473    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.530123 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.530100    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.530232 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.530216    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.530446 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.530429    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.531315 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.531263    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.531742 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.531704    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.538258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.538229    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdjxq\" (UniqueName: \"kubernetes.io/projected/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-kube-api-access-sdjxq\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.538801 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.538779    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65ae43dd-0459-4d4c-b4b6-a5ee5d223063-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn\" (UID: \"65ae43dd-0459-4d4c-b4b6-a5ee5d223063\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.641869 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.641830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:17.769928 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.769901    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"]
Sep 10 16:12:17.774555 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:12:17.774504    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd730c90_54c5_452f_b33d_0b0d6a9d782f.slice/crio-5781b95c3a374c3735368efb1da76866171bbaefe3b20cf816ce5ebd2d10bbed WatchSource:0}: Error finding container 5781b95c3a374c3735368efb1da76866171bbaefe3b20cf816ce5ebd2d10bbed: Status 404 returned error can't find the container with id 5781b95c3a374c3735368efb1da76866171bbaefe3b20cf816ce5ebd2d10bbed
Sep 10 16:12:17.920237 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:17.920193    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"]
Sep 10 16:12:17.922462 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:12:17.922432    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ae43dd_0459_4d4c_b4b6_a5ee5d223063.slice/crio-4103226644d5158b276398a8a709b6e4ad378dae68a3a34c62ed90a3b52df0cc WatchSource:0}: Error finding container 4103226644d5158b276398a8a709b6e4ad378dae68a3a34c62ed90a3b52df0cc: Status 404 returned error can't find the container with id 4103226644d5158b276398a8a709b6e4ad378dae68a3a34c62ed90a3b52df0cc
Sep 10 16:12:18.481704 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:18.481624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn" event={"ID":"65ae43dd-0459-4d4c-b4b6-a5ee5d223063","Type":"ContainerStarted","Data":"4103226644d5158b276398a8a709b6e4ad378dae68a3a34c62ed90a3b52df0cc"}
Sep 10 16:12:18.483122 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:18.483092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz" event={"ID":"bd730c90-54c5-452f-b33d-0b0d6a9d782f","Type":"ContainerStarted","Data":"5781b95c3a374c3735368efb1da76866171bbaefe3b20cf816ce5ebd2d10bbed"}
Sep 10 16:12:20.204400 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:20.202767    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tbpc2"]
Sep 10 16:12:20.206626 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:20.206602    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2"
Sep 10 16:12:20.210419 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:20.210377    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-f2m6k\""
Sep 10 16:12:20.211166 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:20.211146    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 16:12:20.243655 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:20.243619    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tbpc2"]
Sep 10 16:12:20.357755 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:20.357701    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j2ps\" (UniqueName: \"kubernetes.io/projected/d320a264-aaef-4cae-916d-25898659ac4e-kube-api-access-6j2ps\") pod \"model-serving-api-54d89bd5fc-tbpc2\" (UID: \"d320a264-aaef-4cae-916d-25898659ac4e\") " pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2"
Sep 10 16:12:20.357934 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:20.357815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d320a264-aaef-4cae-916d-25898659ac4e-tls-certs\") pod \"model-serving-api-54d89bd5fc-tbpc2\" (UID: \"d320a264-aaef-4cae-916d-25898659ac4e\") " pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2"
Sep 10 16:12:20.459514 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:20.459421    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j2ps\" (UniqueName: \"kubernetes.io/projected/d320a264-aaef-4cae-916d-25898659ac4e-kube-api-access-6j2ps\") pod \"model-serving-api-54d89bd5fc-tbpc2\" (UID: \"d320a264-aaef-4cae-916d-25898659ac4e\") " pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2"
Sep 10 16:12:20.459514 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:20.459488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d320a264-aaef-4cae-916d-25898659ac4e-tls-certs\") pod \"model-serving-api-54d89bd5fc-tbpc2\" (UID: \"d320a264-aaef-4cae-916d-25898659ac4e\") " pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2"
Sep 10 16:12:20.462669 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:20.462636    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d320a264-aaef-4cae-916d-25898659ac4e-tls-certs\") pod \"model-serving-api-54d89bd5fc-tbpc2\" (UID: \"d320a264-aaef-4cae-916d-25898659ac4e\") " pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2"
Sep 10 16:12:20.471020 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:20.470214    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j2ps\" (UniqueName: \"kubernetes.io/projected/d320a264-aaef-4cae-916d-25898659ac4e-kube-api-access-6j2ps\") pod \"model-serving-api-54d89bd5fc-tbpc2\" (UID: \"d320a264-aaef-4cae-916d-25898659ac4e\") " pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2"
Sep 10 16:12:20.520273 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:20.520244    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2"
Sep 10 16:12:21.507376 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:21.507329    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:12:21.507786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:21.507419    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:12:21.507786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:21.507465    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:12:21.771949 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:21.771786    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tbpc2"]
Sep 10 16:12:21.774148 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:12:21.774109    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd320a264_aaef_4cae_916d_25898659ac4e.slice/crio-c103547a60b0855d16b80aa2df890f8514200269702233b8b239c8014a934d9f WatchSource:0}: Error finding container c103547a60b0855d16b80aa2df890f8514200269702233b8b239c8014a934d9f: Status 404 returned error can't find the container with id c103547a60b0855d16b80aa2df890f8514200269702233b8b239c8014a934d9f
Sep 10 16:12:22.510045 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:22.510010    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn" event={"ID":"65ae43dd-0459-4d4c-b4b6-a5ee5d223063","Type":"ContainerStarted","Data":"2543d7ed727ca613667e8341f09bbad2784391e402109e96d008b3fecdecc837"}
Sep 10 16:12:22.511211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:22.511185    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2" event={"ID":"d320a264-aaef-4cae-916d-25898659ac4e","Type":"ContainerStarted","Data":"c103547a60b0855d16b80aa2df890f8514200269702233b8b239c8014a934d9f"}
Sep 10 16:12:22.512609 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:22.512588    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz" event={"ID":"bd730c90-54c5-452f-b33d-0b0d6a9d782f","Type":"ContainerStarted","Data":"d977ce0cba4118271369ad55b636693e463a40f0b64ad20681c7226afbeb439a"}
Sep 10 16:12:22.512734 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:22.512710    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:22.535372 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:22.535312    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn" podStartSLOduration=1.953381495 podStartE2EDuration="5.535293309s" totalImagesPullingTime="3.581911814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:12:22.534092502 +0000 UTC m=+626.946178715" watchObservedRunningTime="2026-09-10 16:12:22.535293309 +0000 UTC m=+626.947379523"
Sep 10 16:12:22.556716 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:22.556655    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz" podStartSLOduration=1.829695671 podStartE2EDuration="5.556636093s" totalImagesPullingTime="3.726940422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:12:22.554533627 +0000 UTC m=+626.966619861" watchObservedRunningTime="2026-09-10 16:12:22.556636093 +0000 UTC m=+626.968722305"
Sep 10 16:12:22.642060 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:22.642019    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:22.651354 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:22.651228    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:23.516804 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:23.516719    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:23.517939 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:23.517915    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn"
Sep 10 16:12:24.523532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:24.523454    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2" event={"ID":"d320a264-aaef-4cae-916d-25898659ac4e","Type":"ContainerStarted","Data":"ed94a5d5ad5a6b0c7ef641274c8ac9eb5e8f1f5f557e55e987135a0fde9daaf5"}
Sep 10 16:12:24.545917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:24.545868    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2" podStartSLOduration=2.061573088 podStartE2EDuration="4.545851534s" totalImagesPullingTime="2.484278446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:12:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:12:24.544176486 +0000 UTC m=+628.956262696" watchObservedRunningTime="2026-09-10 16:12:24.545851534 +0000 UTC m=+628.957937743"
Sep 10 16:12:25.527832 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:25.527803    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2"
Sep 10 16:12:30.202863 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.202824    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"]
Sep 10 16:12:30.209438 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.209410    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"
Sep 10 16:12:30.213075 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.213052    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 16:12:30.213464 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.213443    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dg672\""
Sep 10 16:12:30.223607 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.223584    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"]
Sep 10 16:12:30.348387 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.348343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecaebd23-c06e-4713-a5d6-8539f4838e3a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jmsm6\" (UID: \"ecaebd23-c06e-4713-a5d6-8539f4838e3a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"
Sep 10 16:12:30.348570 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.348508    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9xn4\" (UniqueName: \"kubernetes.io/projected/ecaebd23-c06e-4713-a5d6-8539f4838e3a-kube-api-access-s9xn4\") pod \"llmisvc-controller-manager-777c6bd7d5-jmsm6\" (UID: \"ecaebd23-c06e-4713-a5d6-8539f4838e3a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"
Sep 10 16:12:30.449503 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.449465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9xn4\" (UniqueName: \"kubernetes.io/projected/ecaebd23-c06e-4713-a5d6-8539f4838e3a-kube-api-access-s9xn4\") pod \"llmisvc-controller-manager-777c6bd7d5-jmsm6\" (UID: \"ecaebd23-c06e-4713-a5d6-8539f4838e3a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"
Sep 10 16:12:30.449672 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.449528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecaebd23-c06e-4713-a5d6-8539f4838e3a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jmsm6\" (UID: \"ecaebd23-c06e-4713-a5d6-8539f4838e3a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"
Sep 10 16:12:30.451964 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.451944    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecaebd23-c06e-4713-a5d6-8539f4838e3a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jmsm6\" (UID: \"ecaebd23-c06e-4713-a5d6-8539f4838e3a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"
Sep 10 16:12:30.466073 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.466025    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9xn4\" (UniqueName: \"kubernetes.io/projected/ecaebd23-c06e-4713-a5d6-8539f4838e3a-kube-api-access-s9xn4\") pod \"llmisvc-controller-manager-777c6bd7d5-jmsm6\" (UID: \"ecaebd23-c06e-4713-a5d6-8539f4838e3a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"
Sep 10 16:12:30.519911 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.519863    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"
Sep 10 16:12:30.858983 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:30.858859    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"]
Sep 10 16:12:30.861682 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:12:30.861656    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podecaebd23_c06e_4713_a5d6_8539f4838e3a.slice/crio-c2b4246079a6f62331369d1741b334f625abd77055ecdec6501bf80095cacf74 WatchSource:0}: Error finding container c2b4246079a6f62331369d1741b334f625abd77055ecdec6501bf80095cacf74: Status 404 returned error can't find the container with id c2b4246079a6f62331369d1741b334f625abd77055ecdec6501bf80095cacf74
Sep 10 16:12:31.554922 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:31.554884    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6" event={"ID":"ecaebd23-c06e-4713-a5d6-8539f4838e3a","Type":"ContainerStarted","Data":"c2b4246079a6f62331369d1741b334f625abd77055ecdec6501bf80095cacf74"}
Sep 10 16:12:33.519702 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:33.519666    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84479dc8dd-s27xz"
Sep 10 16:12:34.579464 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:34.579425    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6" event={"ID":"ecaebd23-c06e-4713-a5d6-8539f4838e3a","Type":"ContainerStarted","Data":"99a93f0a6d5996335847642f9ecfdbe3aec955bdf09766c84a0cd88538053073"}
Sep 10 16:12:34.579878 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:34.579504    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"
Sep 10 16:12:34.622555 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:34.622496    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6" podStartSLOduration=1.807918192 podStartE2EDuration="4.622480345s" totalImagesPullingTime="2.814562153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:12:34.620721513 +0000 UTC m=+639.032807719" watchObservedRunningTime="2026-09-10 16:12:34.622480345 +0000 UTC m=+639.034566554"
Sep 10 16:12:36.535788 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:12:36.535757    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tbpc2"
Sep 10 16:13:05.586409 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:05.586377    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmsm6"
Sep 10 16:13:20.980427 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.980391    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58c444bd8-jwfrf"]
Sep 10 16:13:20.983735 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.983704    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:20.986871 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.986846    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 16:13:20.988213 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.988193    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 16:13:20.988293 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.988230    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 16:13:20.989225 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.989207    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 16:13:20.989326 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.989250    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2k588\""
Sep 10 16:13:20.989575 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.989550    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 16:13:20.989659 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.989603    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 16:13:20.989659 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.989565    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 16:13:20.992605 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.992587    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 16:13:20.995084 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.995067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac5a647c-40da-4b91-a524-6050e26bf720-console-serving-cert\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:20.995167 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.995104    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5a647c-40da-4b91-a524-6050e26bf720-service-ca\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:20.995167 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.995121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac5a647c-40da-4b91-a524-6050e26bf720-console-config\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:20.995247 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.995223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac5a647c-40da-4b91-a524-6050e26bf720-trusted-ca-bundle\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:20.995299 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.995251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac5a647c-40da-4b91-a524-6050e26bf720-console-oauth-config\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:20.995299 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.995273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac5a647c-40da-4b91-a524-6050e26bf720-oauth-serving-cert\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:20.995372 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.995321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frspt\" (UniqueName: \"kubernetes.io/projected/ac5a647c-40da-4b91-a524-6050e26bf720-kube-api-access-frspt\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:20.999296 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:20.999274    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c444bd8-jwfrf"]
Sep 10 16:13:21.096044 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.096001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac5a647c-40da-4b91-a524-6050e26bf720-oauth-serving-cert\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.096044 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.096045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frspt\" (UniqueName: \"kubernetes.io/projected/ac5a647c-40da-4b91-a524-6050e26bf720-kube-api-access-frspt\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.096279 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.096074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac5a647c-40da-4b91-a524-6050e26bf720-console-serving-cert\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.096279 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.096114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5a647c-40da-4b91-a524-6050e26bf720-service-ca\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.096279 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.096140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac5a647c-40da-4b91-a524-6050e26bf720-console-config\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.096279 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.096229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac5a647c-40da-4b91-a524-6050e26bf720-trusted-ca-bundle\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.096279 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.096273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac5a647c-40da-4b91-a524-6050e26bf720-console-oauth-config\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.096880 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.096856    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac5a647c-40da-4b91-a524-6050e26bf720-oauth-serving-cert\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.097001 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.096923    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5a647c-40da-4b91-a524-6050e26bf720-service-ca\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.097001 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.096960    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac5a647c-40da-4b91-a524-6050e26bf720-console-config\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.097083 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.097033    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac5a647c-40da-4b91-a524-6050e26bf720-trusted-ca-bundle\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.098607 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.098586    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac5a647c-40da-4b91-a524-6050e26bf720-console-oauth-config\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.098787 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.098770    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac5a647c-40da-4b91-a524-6050e26bf720-console-serving-cert\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.106483 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.106463    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frspt\" (UniqueName: \"kubernetes.io/projected/ac5a647c-40da-4b91-a524-6050e26bf720-kube-api-access-frspt\") pod \"console-58c444bd8-jwfrf\" (UID: \"ac5a647c-40da-4b91-a524-6050e26bf720\") " pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.294119 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.294083    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:21.582876 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.582840    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c444bd8-jwfrf"]
Sep 10 16:13:21.585690 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:13:21.585659    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5a647c_40da_4b91_a524_6050e26bf720.slice/crio-97a43415c3c6f1db7a260ef98a61352242c32d57817a694b0932db840de7c5c2 WatchSource:0}: Error finding container 97a43415c3c6f1db7a260ef98a61352242c32d57817a694b0932db840de7c5c2: Status 404 returned error can't find the container with id 97a43415c3c6f1db7a260ef98a61352242c32d57817a694b0932db840de7c5c2
Sep 10 16:13:21.791655 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.791620    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c444bd8-jwfrf" event={"ID":"ac5a647c-40da-4b91-a524-6050e26bf720","Type":"ContainerStarted","Data":"8e63bb455c0111ee773b4102fd448681adf1858e3b59916d967998981c61ba5e"}
Sep 10 16:13:21.791850 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.791667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c444bd8-jwfrf" event={"ID":"ac5a647c-40da-4b91-a524-6050e26bf720","Type":"ContainerStarted","Data":"97a43415c3c6f1db7a260ef98a61352242c32d57817a694b0932db840de7c5c2"}
Sep 10 16:13:21.815511 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:21.815459    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58c444bd8-jwfrf" podStartSLOduration=1.815442504 podStartE2EDuration="1.815442504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:13:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:13:21.813870276 +0000 UTC m=+686.225956506" watchObservedRunningTime="2026-09-10 16:13:21.815442504 +0000 UTC m=+686.227528713"
Sep 10 16:13:31.294714 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:31.294676    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:31.295119 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:31.294760    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:31.299397 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:31.299375    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:31.839328 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:31.839300    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58c444bd8-jwfrf"
Sep 10 16:13:42.681835 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:42.681793    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp"]
Sep 10 16:13:42.685858 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:42.685835    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp"
Sep 10 16:13:42.688873 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:42.688847    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 16:13:42.688991 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:42.688848    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 16:13:42.688991 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:42.688917    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xq4zr\""
Sep 10 16:13:42.688991 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:42.688848    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 16:13:42.699088 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:42.699066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp"]
Sep 10 16:13:42.798397 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:42.798361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc585\" (UniqueName: \"kubernetes.io/projected/0e62c407-7a27-4c24-821b-13dd1cc056f5-kube-api-access-pc585\") pod \"dns-operator-controller-manager-7b84cd7c9c-t5xjp\" (UID: \"0e62c407-7a27-4c24-821b-13dd1cc056f5\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp"
Sep 10 16:13:42.899694 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:42.899656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc585\" (UniqueName: \"kubernetes.io/projected/0e62c407-7a27-4c24-821b-13dd1cc056f5-kube-api-access-pc585\") pod \"dns-operator-controller-manager-7b84cd7c9c-t5xjp\" (UID: \"0e62c407-7a27-4c24-821b-13dd1cc056f5\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp"
Sep 10 16:13:42.910563 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:42.910536    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc585\" (UniqueName: \"kubernetes.io/projected/0e62c407-7a27-4c24-821b-13dd1cc056f5-kube-api-access-pc585\") pod \"dns-operator-controller-manager-7b84cd7c9c-t5xjp\" (UID: \"0e62c407-7a27-4c24-821b-13dd1cc056f5\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp"
Sep 10 16:13:42.996644 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:42.996608    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp"
Sep 10 16:13:43.280519 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:43.280484    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp"]
Sep 10 16:13:43.282141 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:13:43.282114    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e62c407_7a27_4c24_821b_13dd1cc056f5.slice/crio-7ce80f84fac5003d6a444e3eb773a66eac9da15810c310eae3784f453a6e5f02 WatchSource:0}: Error finding container 7ce80f84fac5003d6a444e3eb773a66eac9da15810c310eae3784f453a6e5f02: Status 404 returned error can't find the container with id 7ce80f84fac5003d6a444e3eb773a66eac9da15810c310eae3784f453a6e5f02
Sep 10 16:13:43.287899 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:43.287873    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 16:13:43.892823 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:43.892788    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp" event={"ID":"0e62c407-7a27-4c24-821b-13dd1cc056f5","Type":"ContainerStarted","Data":"7ce80f84fac5003d6a444e3eb773a66eac9da15810c310eae3784f453a6e5f02"}
Sep 10 16:13:45.852251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:45.852215    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hnx5s"]
Sep 10 16:13:45.855831 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:45.855810    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hnx5s"
Sep 10 16:13:45.858991 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:45.858961    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bz2kj\""
Sep 10 16:13:45.874000 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:45.873974    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hnx5s"]
Sep 10 16:13:45.925828 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:45.925798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v74jw\" (UniqueName: \"kubernetes.io/projected/5cf686b9-aa42-4710-8529-eac2dd96f232-kube-api-access-v74jw\") pod \"authorino-operator-76b478bd78-hnx5s\" (UID: \"5cf686b9-aa42-4710-8529-eac2dd96f232\") " pod="kuadrant-system/authorino-operator-76b478bd78-hnx5s"
Sep 10 16:13:46.026330 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:46.026291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v74jw\" (UniqueName: \"kubernetes.io/projected/5cf686b9-aa42-4710-8529-eac2dd96f232-kube-api-access-v74jw\") pod \"authorino-operator-76b478bd78-hnx5s\" (UID: \"5cf686b9-aa42-4710-8529-eac2dd96f232\") " pod="kuadrant-system/authorino-operator-76b478bd78-hnx5s"
Sep 10 16:13:46.041790 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:46.041758    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v74jw\" (UniqueName: \"kubernetes.io/projected/5cf686b9-aa42-4710-8529-eac2dd96f232-kube-api-access-v74jw\") pod \"authorino-operator-76b478bd78-hnx5s\" (UID: \"5cf686b9-aa42-4710-8529-eac2dd96f232\") " pod="kuadrant-system/authorino-operator-76b478bd78-hnx5s"
Sep 10 16:13:46.167502 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:46.167436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hnx5s"
Sep 10 16:13:46.459988 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:46.459955    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hnx5s"]
Sep 10 16:13:46.460572 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:13:46.460549    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf686b9_aa42_4710_8529_eac2dd96f232.slice/crio-b8bacb56084abf41bca8d424f3ed67a21361785904c6612bd4f1555466d762df WatchSource:0}: Error finding container b8bacb56084abf41bca8d424f3ed67a21361785904c6612bd4f1555466d762df: Status 404 returned error can't find the container with id b8bacb56084abf41bca8d424f3ed67a21361785904c6612bd4f1555466d762df
Sep 10 16:13:46.911031 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:46.910994    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hnx5s" event={"ID":"5cf686b9-aa42-4710-8529-eac2dd96f232","Type":"ContainerStarted","Data":"b8bacb56084abf41bca8d424f3ed67a21361785904c6612bd4f1555466d762df"}
Sep 10 16:13:46.912681 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:46.912650    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp" event={"ID":"0e62c407-7a27-4c24-821b-13dd1cc056f5","Type":"ContainerStarted","Data":"da830e18f8b1268658f7684ec13cb064e0f51a4eb8bd670721b6065ebbb4f453"}
Sep 10 16:13:46.912812 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:46.912719    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp"
Sep 10 16:13:46.947823 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:46.947776    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp" podStartSLOduration=2.377254841 podStartE2EDuration="4.947761458s" totalImagesPullingTime="2.570506617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:13:46.94453463 +0000 UTC m=+711.356620882" watchObservedRunningTime="2026-09-10 16:13:46.947761458 +0000 UTC m=+711.359847678"
Sep 10 16:13:48.924219 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:48.924183    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hnx5s" event={"ID":"5cf686b9-aa42-4710-8529-eac2dd96f232","Type":"ContainerStarted","Data":"b3e059381e259edcd8a97118332d8de930a52cc510185a96679e2e8042ea6a0f"}
Sep 10 16:13:48.924624 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:48.924285    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-hnx5s"
Sep 10 16:13:48.956359 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:48.956302    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-hnx5s" podStartSLOduration=2.50129118 podStartE2EDuration="3.956282054s" totalImagesPullingTime="1.454990874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:13:48.954348772 +0000 UTC m=+713.366434995" watchObservedRunningTime="2026-09-10 16:13:48.956282054 +0000 UTC m=+713.368368263"
Sep 10 16:13:57.920350 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:57.920318    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t5xjp"
Sep 10 16:13:59.931010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:13:59.930981    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-hnx5s"
Sep 10 16:14:00.507797 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:00.507761    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"]
Sep 10 16:14:00.511311 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:00.511291    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"
Sep 10 16:14:00.515012 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:00.514995    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n4rkc\""
Sep 10 16:14:00.532298 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:00.532268    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"]
Sep 10 16:14:00.561838 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:00.561800    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fbe1932-3de0-42e5-af7a-642469a6b78e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-52z8f\" (UID: \"0fbe1932-3de0-42e5-af7a-642469a6b78e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"
Sep 10 16:14:00.562063 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:00.561858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhp6h\" (UniqueName: \"kubernetes.io/projected/0fbe1932-3de0-42e5-af7a-642469a6b78e-kube-api-access-jhp6h\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-52z8f\" (UID: \"0fbe1932-3de0-42e5-af7a-642469a6b78e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"
Sep 10 16:14:00.663202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:00.663161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fbe1932-3de0-42e5-af7a-642469a6b78e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-52z8f\" (UID: \"0fbe1932-3de0-42e5-af7a-642469a6b78e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"
Sep 10 16:14:00.663376 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:00.663225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhp6h\" (UniqueName: \"kubernetes.io/projected/0fbe1932-3de0-42e5-af7a-642469a6b78e-kube-api-access-jhp6h\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-52z8f\" (UID: \"0fbe1932-3de0-42e5-af7a-642469a6b78e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"
Sep 10 16:14:00.663543 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:00.663524    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fbe1932-3de0-42e5-af7a-642469a6b78e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-52z8f\" (UID: \"0fbe1932-3de0-42e5-af7a-642469a6b78e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"
Sep 10 16:14:00.701430 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:00.701402    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhp6h\" (UniqueName: \"kubernetes.io/projected/0fbe1932-3de0-42e5-af7a-642469a6b78e-kube-api-access-jhp6h\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-52z8f\" (UID: \"0fbe1932-3de0-42e5-af7a-642469a6b78e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"
Sep 10 16:14:00.822304 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:00.822218    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"
Sep 10 16:14:01.111347 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.111321    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"]
Sep 10 16:14:01.114509 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:14:01.114482    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fbe1932_3de0_42e5_af7a_642469a6b78e.slice/crio-282691bc05997c578d5f542c9f4b824ceb2a632afad267696ed29e977c678b8a WatchSource:0}: Error finding container 282691bc05997c578d5f542c9f4b824ceb2a632afad267696ed29e977c678b8a: Status 404 returned error can't find the container with id 282691bc05997c578d5f542c9f4b824ceb2a632afad267696ed29e977c678b8a
Sep 10 16:14:01.322789 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.322750    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"]
Sep 10 16:14:01.328572 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.328538    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"]
Sep 10 16:14:01.379282 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.379207    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"]
Sep 10 16:14:01.384366 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.384341    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"
Sep 10 16:14:01.430225 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.430191    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"]
Sep 10 16:14:01.468849 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.468813    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24bb6104-b87d-439a-be90-b8a285ebd9d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-sllk7\" (UID: \"24bb6104-b87d-439a-be90-b8a285ebd9d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"
Sep 10 16:14:01.468849 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.468849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fffg5\" (UniqueName: \"kubernetes.io/projected/24bb6104-b87d-439a-be90-b8a285ebd9d7-kube-api-access-fffg5\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-sllk7\" (UID: \"24bb6104-b87d-439a-be90-b8a285ebd9d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"
Sep 10 16:14:01.570241 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.570204    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24bb6104-b87d-439a-be90-b8a285ebd9d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-sllk7\" (UID: \"24bb6104-b87d-439a-be90-b8a285ebd9d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"
Sep 10 16:14:01.570423 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.570245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fffg5\" (UniqueName: \"kubernetes.io/projected/24bb6104-b87d-439a-be90-b8a285ebd9d7-kube-api-access-fffg5\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-sllk7\" (UID: \"24bb6104-b87d-439a-be90-b8a285ebd9d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"
Sep 10 16:14:01.570687 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.570666    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24bb6104-b87d-439a-be90-b8a285ebd9d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-sllk7\" (UID: \"24bb6104-b87d-439a-be90-b8a285ebd9d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"
Sep 10 16:14:01.588470 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.588446    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fffg5\" (UniqueName: \"kubernetes.io/projected/24bb6104-b87d-439a-be90-b8a285ebd9d7-kube-api-access-fffg5\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-sllk7\" (UID: \"24bb6104-b87d-439a-be90-b8a285ebd9d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"
Sep 10 16:14:01.695073 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:01.694985    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"
Sep 10 16:14:02.034004 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:02.033960    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"]
Sep 10 16:14:02.034167 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:14:02.034149    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24bb6104_b87d_439a_be90_b8a285ebd9d7.slice/crio-e8ec7184647fb9e10cd8cc571df28ba82ca0ad4a48bb76eef318cd026c6bbb8b WatchSource:0}: Error finding container e8ec7184647fb9e10cd8cc571df28ba82ca0ad4a48bb76eef318cd026c6bbb8b: Status 404 returned error can't find the container with id e8ec7184647fb9e10cd8cc571df28ba82ca0ad4a48bb76eef318cd026c6bbb8b
Sep 10 16:14:02.992309 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:02.992257    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7" event={"ID":"24bb6104-b87d-439a-be90-b8a285ebd9d7","Type":"ContainerStarted","Data":"e8ec7184647fb9e10cd8cc571df28ba82ca0ad4a48bb76eef318cd026c6bbb8b"}
Sep 10 16:14:06.010394 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:06.010351    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f" podUID="0fbe1932-3de0-42e5-af7a-642469a6b78e" containerName="manager" containerID="cri-o://ea3a9cbeadad636b0591e08e53095e0609e8b9fbe1c52a46cea5922448d0139e" gracePeriod=2
Sep 10 16:14:06.012149 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:06.012121    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7" event={"ID":"24bb6104-b87d-439a-be90-b8a285ebd9d7","Type":"ContainerStarted","Data":"bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a"}
Sep 10 16:14:06.012279 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:06.012198    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"
Sep 10 16:14:06.062590 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:06.062533    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7" podStartSLOduration=1.738409609 podStartE2EDuration="5.062516237s" totalImagesPullingTime="3.324106628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:14:06.062344099 +0000 UTC m=+730.474430308" watchObservedRunningTime="2026-09-10 16:14:06.062516237 +0000 UTC m=+730.474602445"
Sep 10 16:14:06.246364 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:06.246337    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"
Sep 10 16:14:06.312793 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:06.312686    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhp6h\" (UniqueName: \"kubernetes.io/projected/0fbe1932-3de0-42e5-af7a-642469a6b78e-kube-api-access-jhp6h\") pod \"0fbe1932-3de0-42e5-af7a-642469a6b78e\" (UID: \"0fbe1932-3de0-42e5-af7a-642469a6b78e\") "
Sep 10 16:14:06.312793 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:06.312785    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fbe1932-3de0-42e5-af7a-642469a6b78e-extensions-socket-volume\") pod \"0fbe1932-3de0-42e5-af7a-642469a6b78e\" (UID: \"0fbe1932-3de0-42e5-af7a-642469a6b78e\") "
Sep 10 16:14:06.313082 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:06.313045    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fbe1932-3de0-42e5-af7a-642469a6b78e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0fbe1932-3de0-42e5-af7a-642469a6b78e" (UID: "0fbe1932-3de0-42e5-af7a-642469a6b78e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:14:06.314844 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:06.314823    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fbe1932-3de0-42e5-af7a-642469a6b78e-kube-api-access-jhp6h" (OuterVolumeSpecName: "kube-api-access-jhp6h") pod "0fbe1932-3de0-42e5-af7a-642469a6b78e" (UID: "0fbe1932-3de0-42e5-af7a-642469a6b78e"). InnerVolumeSpecName "kube-api-access-jhp6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:14:06.414333 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:06.414306    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhp6h\" (UniqueName: \"kubernetes.io/projected/0fbe1932-3de0-42e5-af7a-642469a6b78e-kube-api-access-jhp6h\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:14:06.414333 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:06.414330    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fbe1932-3de0-42e5-af7a-642469a6b78e-extensions-socket-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:14:07.018441 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:07.018405    2562 generic.go:356] "Generic (PLEG): container finished" podID="0fbe1932-3de0-42e5-af7a-642469a6b78e" containerID="ea3a9cbeadad636b0591e08e53095e0609e8b9fbe1c52a46cea5922448d0139e" exitCode=2
Sep 10 16:14:07.018896 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:07.018445    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"
Sep 10 16:14:07.018896 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:07.018507    2562 scope.go:117] "RemoveContainer" containerID="ea3a9cbeadad636b0591e08e53095e0609e8b9fbe1c52a46cea5922448d0139e"
Sep 10 16:14:07.022465 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:14:07.022440    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-52z8f\" is forbidden: User \"system:node:ip-10-0-132-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-43.ec2.internal' and this object" podUID="0fbe1932-3de0-42e5-af7a-642469a6b78e" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"
Sep 10 16:14:07.027536 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:07.027507    2562 scope.go:117] "RemoveContainer" containerID="ea3a9cbeadad636b0591e08e53095e0609e8b9fbe1c52a46cea5922448d0139e"
Sep 10 16:14:07.027822 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:14:07.027788    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea3a9cbeadad636b0591e08e53095e0609e8b9fbe1c52a46cea5922448d0139e\": container with ID starting with ea3a9cbeadad636b0591e08e53095e0609e8b9fbe1c52a46cea5922448d0139e not found: ID does not exist" containerID="ea3a9cbeadad636b0591e08e53095e0609e8b9fbe1c52a46cea5922448d0139e"
Sep 10 16:14:07.027890 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:07.027829    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea3a9cbeadad636b0591e08e53095e0609e8b9fbe1c52a46cea5922448d0139e"} err="failed to get container status \"ea3a9cbeadad636b0591e08e53095e0609e8b9fbe1c52a46cea5922448d0139e\": rpc error: code = NotFound desc = could not find container \"ea3a9cbeadad636b0591e08e53095e0609e8b9fbe1c52a46cea5922448d0139e\": container with ID starting with ea3a9cbeadad636b0591e08e53095e0609e8b9fbe1c52a46cea5922448d0139e not found: ID does not exist"
Sep 10 16:14:07.029394 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:14:07.029375    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-52z8f\" is forbidden: User \"system:node:ip-10-0-132-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-43.ec2.internal' and this object" podUID="0fbe1932-3de0-42e5-af7a-642469a6b78e" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-52z8f"
Sep 10 16:14:08.070005 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:08.069968    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fbe1932-3de0-42e5-af7a-642469a6b78e" path="/var/lib/kubelet/pods/0fbe1932-3de0-42e5-af7a-642469a6b78e/volumes"
Sep 10 16:14:17.021292 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:17.021257    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"
Sep 10 16:14:29.550931 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:29.550896    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"]
Sep 10 16:14:29.551550 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:29.551141    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7" podUID="24bb6104-b87d-439a-be90-b8a285ebd9d7" containerName="manager" containerID="cri-o://bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a" gracePeriod=10
Sep 10 16:14:29.798056 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:29.798029    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"
Sep 10 16:14:29.930861 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:29.930785    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24bb6104-b87d-439a-be90-b8a285ebd9d7-extensions-socket-volume\") pod \"24bb6104-b87d-439a-be90-b8a285ebd9d7\" (UID: \"24bb6104-b87d-439a-be90-b8a285ebd9d7\") "
Sep 10 16:14:29.930861 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:29.930835    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fffg5\" (UniqueName: \"kubernetes.io/projected/24bb6104-b87d-439a-be90-b8a285ebd9d7-kube-api-access-fffg5\") pod \"24bb6104-b87d-439a-be90-b8a285ebd9d7\" (UID: \"24bb6104-b87d-439a-be90-b8a285ebd9d7\") "
Sep 10 16:14:29.931319 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:29.931295    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24bb6104-b87d-439a-be90-b8a285ebd9d7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "24bb6104-b87d-439a-be90-b8a285ebd9d7" (UID: "24bb6104-b87d-439a-be90-b8a285ebd9d7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:14:29.932900 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:29.932881    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24bb6104-b87d-439a-be90-b8a285ebd9d7-kube-api-access-fffg5" (OuterVolumeSpecName: "kube-api-access-fffg5") pod "24bb6104-b87d-439a-be90-b8a285ebd9d7" (UID: "24bb6104-b87d-439a-be90-b8a285ebd9d7"). InnerVolumeSpecName "kube-api-access-fffg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:14:30.032080 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:30.032043    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24bb6104-b87d-439a-be90-b8a285ebd9d7-extensions-socket-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:14:30.032080 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:30.032074    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fffg5\" (UniqueName: \"kubernetes.io/projected/24bb6104-b87d-439a-be90-b8a285ebd9d7-kube-api-access-fffg5\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:14:30.133287 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:30.133254    2562 generic.go:356] "Generic (PLEG): container finished" podID="24bb6104-b87d-439a-be90-b8a285ebd9d7" containerID="bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a" exitCode=0
Sep 10 16:14:30.133443 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:30.133295    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"
Sep 10 16:14:30.133443 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:30.133337    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7" event={"ID":"24bb6104-b87d-439a-be90-b8a285ebd9d7","Type":"ContainerDied","Data":"bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a"}
Sep 10 16:14:30.133443 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:30.133386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7" event={"ID":"24bb6104-b87d-439a-be90-b8a285ebd9d7","Type":"ContainerDied","Data":"e8ec7184647fb9e10cd8cc571df28ba82ca0ad4a48bb76eef318cd026c6bbb8b"}
Sep 10 16:14:30.133443 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:30.133409    2562 scope.go:117] "RemoveContainer" containerID="bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a"
Sep 10 16:14:30.143391 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:30.143372    2562 scope.go:117] "RemoveContainer" containerID="bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a"
Sep 10 16:14:30.143659 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:14:30.143636    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a\": container with ID starting with bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a not found: ID does not exist" containerID="bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a"
Sep 10 16:14:30.143751 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:30.143670    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a"} err="failed to get container status \"bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a\": rpc error: code = NotFound desc = could not find container \"bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a\": container with ID starting with bc9c5035bdf7dcf14f5f533edfe9df6ed0254ec7792b19b43e553b6dde0a157a not found: ID does not exist"
Sep 10 16:14:30.155100 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:30.155076    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"]
Sep 10 16:14:30.164705 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:30.164687    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-sllk7"]
Sep 10 16:14:32.070796 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:32.070752    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24bb6104-b87d-439a-be90-b8a285ebd9d7" path="/var/lib/kubelet/pods/24bb6104-b87d-439a-be90-b8a285ebd9d7/volumes"
Sep 10 16:14:33.955434 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:33.955401    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"]
Sep 10 16:14:33.955965 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:33.955945    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fbe1932-3de0-42e5-af7a-642469a6b78e" containerName="manager"
Sep 10 16:14:33.956043 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:33.955968    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fbe1932-3de0-42e5-af7a-642469a6b78e" containerName="manager"
Sep 10 16:14:33.956043 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:33.956004    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24bb6104-b87d-439a-be90-b8a285ebd9d7" containerName="manager"
Sep 10 16:14:33.956043 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:33.956013    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="24bb6104-b87d-439a-be90-b8a285ebd9d7" containerName="manager"
Sep 10 16:14:33.956185 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:33.956111    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="24bb6104-b87d-439a-be90-b8a285ebd9d7" containerName="manager"
Sep 10 16:14:33.956185 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:33.956124    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fbe1932-3de0-42e5-af7a-642469a6b78e" containerName="manager"
Sep 10 16:14:33.958902 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:33.958882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:33.963009 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:33.962990    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bcwp8\""
Sep 10 16:14:33.991802 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:33.991773    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"]
Sep 10 16:14:34.067456 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.067427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppbj5\" (UniqueName: \"kubernetes.io/projected/3b7a2202-f718-48b7-b442-9aaafae35418-kube-api-access-ppbj5\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.067650 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.067475    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-workload-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.067650 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.067527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b7a2202-f718-48b7-b442-9aaafae35418-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.067650 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.067555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-credential-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.067650 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.067580    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b7a2202-f718-48b7-b442-9aaafae35418-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.067650 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.067597    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-workload-certs\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.067650 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.067617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-istio-data\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.067977 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.067667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-istio-envoy\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.067977 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.067685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b7a2202-f718-48b7-b442-9aaafae35418-istio-token\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.168306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.168268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-workload-certs\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.168306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.168312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-istio-data\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.168561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.168397    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-istio-envoy\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.168561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.168435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b7a2202-f718-48b7-b442-9aaafae35418-istio-token\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.168561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.168484    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppbj5\" (UniqueName: \"kubernetes.io/projected/3b7a2202-f718-48b7-b442-9aaafae35418-kube-api-access-ppbj5\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.168561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.168552    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-workload-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.168810 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.168593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b7a2202-f718-48b7-b442-9aaafae35418-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.168810 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.168628    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-credential-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.168810 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.168671    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b7a2202-f718-48b7-b442-9aaafae35418-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.168810 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.168680    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-istio-data\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.168810 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.168714    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-workload-certs\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.168990 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.168966    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-workload-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.169105 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.169083    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-credential-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.169289 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.169269    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b7a2202-f718-48b7-b442-9aaafae35418-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.170828 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.170800    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b7a2202-f718-48b7-b442-9aaafae35418-istio-envoy\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.171093 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.171074    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b7a2202-f718-48b7-b442-9aaafae35418-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.179210 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.179190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b7a2202-f718-48b7-b442-9aaafae35418-istio-token\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.179297 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.179269    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppbj5\" (UniqueName: \"kubernetes.io/projected/3b7a2202-f718-48b7-b442-9aaafae35418-kube-api-access-ppbj5\") pod \"maas-default-gateway-openshift-default-c747fcbf8-mgrr2\" (UID: \"3b7a2202-f718-48b7-b442-9aaafae35418\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.269604 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.269561    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:34.551853 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.551827    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"]
Sep 10 16:14:34.553530 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:14:34.553507    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7a2202_f718_48b7_b442_9aaafae35418.slice/crio-2a89770c600ba87d4191897081536692dd8975fdda8601e11a120a9c65064b31 WatchSource:0}: Error finding container 2a89770c600ba87d4191897081536692dd8975fdda8601e11a120a9c65064b31: Status 404 returned error can't find the container with id 2a89770c600ba87d4191897081536692dd8975fdda8601e11a120a9c65064b31
Sep 10 16:14:34.555552 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.555516    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:14:34.555642 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.555595    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:14:34.555701 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:34.555638    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:14:35.159144 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:35.159108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2" event={"ID":"3b7a2202-f718-48b7-b442-9aaafae35418","Type":"ContainerStarted","Data":"bb7f053905af8e3d4d2b41134cfbc7b3222e792787b6c782a62331abf3f4820f"}
Sep 10 16:14:35.159534 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:35.159157    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2" event={"ID":"3b7a2202-f718-48b7-b442-9aaafae35418","Type":"ContainerStarted","Data":"2a89770c600ba87d4191897081536692dd8975fdda8601e11a120a9c65064b31"}
Sep 10 16:14:35.187356 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:35.187305    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2" podStartSLOduration=2.187287896 podStartE2EDuration="2.187287896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:14:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:14:35.185344543 +0000 UTC m=+759.597430755" watchObservedRunningTime="2026-09-10 16:14:35.187287896 +0000 UTC m=+759.599374106"
Sep 10 16:14:35.270656 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:35.270616    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:35.275217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:35.275189    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:36.164312 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:36.164279    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:36.165504 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:36.165480    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:14:47.038971 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.038932    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x4nt5"]
Sep 10 16:14:47.041655 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.041633    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-x4nt5"
Sep 10 16:14:47.053009 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.052988    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 16:14:47.053221 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.053204    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qlltw\""
Sep 10 16:14:47.064479 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.064453    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x4nt5"]
Sep 10 16:14:47.079025 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.078991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3491d07-97c8-428c-a09a-a8e799fb9438-config-file\") pod \"limitador-limitador-8588749977-x4nt5\" (UID: \"a3491d07-97c8-428c-a09a-a8e799fb9438\") " pod="kuadrant-system/limitador-limitador-8588749977-x4nt5"
Sep 10 16:14:47.079197 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.079047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27766\" (UniqueName: \"kubernetes.io/projected/a3491d07-97c8-428c-a09a-a8e799fb9438-kube-api-access-27766\") pod \"limitador-limitador-8588749977-x4nt5\" (UID: \"a3491d07-97c8-428c-a09a-a8e799fb9438\") " pod="kuadrant-system/limitador-limitador-8588749977-x4nt5"
Sep 10 16:14:47.121011 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.120982    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x4nt5"]
Sep 10 16:14:47.179626 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.179592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3491d07-97c8-428c-a09a-a8e799fb9438-config-file\") pod \"limitador-limitador-8588749977-x4nt5\" (UID: \"a3491d07-97c8-428c-a09a-a8e799fb9438\") " pod="kuadrant-system/limitador-limitador-8588749977-x4nt5"
Sep 10 16:14:47.179844 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.179642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27766\" (UniqueName: \"kubernetes.io/projected/a3491d07-97c8-428c-a09a-a8e799fb9438-kube-api-access-27766\") pod \"limitador-limitador-8588749977-x4nt5\" (UID: \"a3491d07-97c8-428c-a09a-a8e799fb9438\") " pod="kuadrant-system/limitador-limitador-8588749977-x4nt5"
Sep 10 16:14:47.180254 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.180235    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3491d07-97c8-428c-a09a-a8e799fb9438-config-file\") pod \"limitador-limitador-8588749977-x4nt5\" (UID: \"a3491d07-97c8-428c-a09a-a8e799fb9438\") " pod="kuadrant-system/limitador-limitador-8588749977-x4nt5"
Sep 10 16:14:47.214099 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.214066    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27766\" (UniqueName: \"kubernetes.io/projected/a3491d07-97c8-428c-a09a-a8e799fb9438-kube-api-access-27766\") pod \"limitador-limitador-8588749977-x4nt5\" (UID: \"a3491d07-97c8-428c-a09a-a8e799fb9438\") " pod="kuadrant-system/limitador-limitador-8588749977-x4nt5"
Sep 10 16:14:47.352038 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.351947    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-x4nt5"
Sep 10 16:14:47.631780 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:47.631754    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x4nt5"]
Sep 10 16:14:47.633751 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:14:47.633705    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3491d07_97c8_428c_a09a_a8e799fb9438.slice/crio-30430d20e67cf8d37df90a22ab198a47a2623471d016d8152d9664839e3046b7 WatchSource:0}: Error finding container 30430d20e67cf8d37df90a22ab198a47a2623471d016d8152d9664839e3046b7: Status 404 returned error can't find the container with id 30430d20e67cf8d37df90a22ab198a47a2623471d016d8152d9664839e3046b7
Sep 10 16:14:48.226301 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:48.226263    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-x4nt5" event={"ID":"a3491d07-97c8-428c-a09a-a8e799fb9438","Type":"ContainerStarted","Data":"30430d20e67cf8d37df90a22ab198a47a2623471d016d8152d9664839e3046b7"}
Sep 10 16:14:49.232769 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:49.232670    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-x4nt5" event={"ID":"a3491d07-97c8-428c-a09a-a8e799fb9438","Type":"ContainerStarted","Data":"044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922"}
Sep 10 16:14:49.233118 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:49.232805    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-x4nt5"
Sep 10 16:14:49.272983 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:14:49.272931    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-x4nt5" podStartSLOduration=1.143130386 podStartE2EDuration="2.272915208s" totalImagesPullingTime="1.129784822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:14:49.27120246 +0000 UTC m=+773.683288670" watchObservedRunningTime="2026-09-10 16:14:49.272915208 +0000 UTC m=+773.685001416"
Sep 10 16:15:00.237737 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:00.237700    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-x4nt5"
Sep 10 16:15:00.707684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:00.707644    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x4nt5"]
Sep 10 16:15:00.707880 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:00.707848    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-x4nt5" podUID="a3491d07-97c8-428c-a09a-a8e799fb9438" containerName="limitador" containerID="cri-o://044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922" gracePeriod=30
Sep 10 16:15:01.249581 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.249552    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-x4nt5"
Sep 10 16:15:01.294128 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.294039    2562 generic.go:356] "Generic (PLEG): container finished" podID="a3491d07-97c8-428c-a09a-a8e799fb9438" containerID="044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922" exitCode=0
Sep 10 16:15:01.294128 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.294097    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-x4nt5"
Sep 10 16:15:01.294128 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.294114    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-x4nt5" event={"ID":"a3491d07-97c8-428c-a09a-a8e799fb9438","Type":"ContainerDied","Data":"044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922"}
Sep 10 16:15:01.294383 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.294180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-x4nt5" event={"ID":"a3491d07-97c8-428c-a09a-a8e799fb9438","Type":"ContainerDied","Data":"30430d20e67cf8d37df90a22ab198a47a2623471d016d8152d9664839e3046b7"}
Sep 10 16:15:01.294383 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.294201    2562 scope.go:117] "RemoveContainer" containerID="044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922"
Sep 10 16:15:01.302621 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.302603    2562 scope.go:117] "RemoveContainer" containerID="044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922"
Sep 10 16:15:01.302867 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:15:01.302850    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922\": container with ID starting with 044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922 not found: ID does not exist" containerID="044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922"
Sep 10 16:15:01.302919 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.302875    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922"} err="failed to get container status \"044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922\": rpc error: code = NotFound desc = could not find container \"044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922\": container with ID starting with 044a586b59eb4891eadbce581e9f4bfad026ca5cfef78ff917962e65208dd922 not found: ID does not exist"
Sep 10 16:15:01.310309 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.310286    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3491d07-97c8-428c-a09a-a8e799fb9438-config-file\") pod \"a3491d07-97c8-428c-a09a-a8e799fb9438\" (UID: \"a3491d07-97c8-428c-a09a-a8e799fb9438\") "
Sep 10 16:15:01.310391 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.310339    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27766\" (UniqueName: \"kubernetes.io/projected/a3491d07-97c8-428c-a09a-a8e799fb9438-kube-api-access-27766\") pod \"a3491d07-97c8-428c-a09a-a8e799fb9438\" (UID: \"a3491d07-97c8-428c-a09a-a8e799fb9438\") "
Sep 10 16:15:01.310670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.310652    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3491d07-97c8-428c-a09a-a8e799fb9438-config-file" (OuterVolumeSpecName: "config-file") pod "a3491d07-97c8-428c-a09a-a8e799fb9438" (UID: "a3491d07-97c8-428c-a09a-a8e799fb9438"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:15:01.312389 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.312368    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3491d07-97c8-428c-a09a-a8e799fb9438-kube-api-access-27766" (OuterVolumeSpecName: "kube-api-access-27766") pod "a3491d07-97c8-428c-a09a-a8e799fb9438" (UID: "a3491d07-97c8-428c-a09a-a8e799fb9438"). InnerVolumeSpecName "kube-api-access-27766". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:15:01.411131 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.411090    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3491d07-97c8-428c-a09a-a8e799fb9438-config-file\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:15:01.411131 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.411124    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27766\" (UniqueName: \"kubernetes.io/projected/a3491d07-97c8-428c-a09a-a8e799fb9438-kube-api-access-27766\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:15:01.618497 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.618469    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x4nt5"]
Sep 10 16:15:01.623928 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:01.623907    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x4nt5"]
Sep 10 16:15:02.070533 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:02.070499    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3491d07-97c8-428c-a09a-a8e799fb9438" path="/var/lib/kubelet/pods/a3491d07-97c8-428c-a09a-a8e799fb9438/volumes"
Sep 10 16:15:03.240334 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.240302    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"]
Sep 10 16:15:03.240735 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.240670    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3491d07-97c8-428c-a09a-a8e799fb9438" containerName="limitador"
Sep 10 16:15:03.240735 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.240680    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3491d07-97c8-428c-a09a-a8e799fb9438" containerName="limitador"
Sep 10 16:15:03.240827 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.240777    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3491d07-97c8-428c-a09a-a8e799fb9438" containerName="limitador"
Sep 10 16:15:03.245450 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.245430    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"
Sep 10 16:15:03.251796 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.251769    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 16:15:03.252441 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.252420    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-65lbq\""
Sep 10 16:15:03.252702 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.252681    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 16:15:03.253025 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.253011    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 16:15:03.256821 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.256800    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"]
Sep 10 16:15:03.327563 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.327528    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3198681d-c5b8-4a6f-b154-4128d7bf2c97-data\") pod \"postgres-69fb4594cf-ctf45\" (UID: \"3198681d-c5b8-4a6f-b154-4128d7bf2c97\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"
Sep 10 16:15:03.327754 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.327573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lr8q\" (UniqueName: \"kubernetes.io/projected/3198681d-c5b8-4a6f-b154-4128d7bf2c97-kube-api-access-9lr8q\") pod \"postgres-69fb4594cf-ctf45\" (UID: \"3198681d-c5b8-4a6f-b154-4128d7bf2c97\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"
Sep 10 16:15:03.429074 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.429032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3198681d-c5b8-4a6f-b154-4128d7bf2c97-data\") pod \"postgres-69fb4594cf-ctf45\" (UID: \"3198681d-c5b8-4a6f-b154-4128d7bf2c97\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"
Sep 10 16:15:03.429242 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.429087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lr8q\" (UniqueName: \"kubernetes.io/projected/3198681d-c5b8-4a6f-b154-4128d7bf2c97-kube-api-access-9lr8q\") pod \"postgres-69fb4594cf-ctf45\" (UID: \"3198681d-c5b8-4a6f-b154-4128d7bf2c97\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"
Sep 10 16:15:03.429417 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.429396    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3198681d-c5b8-4a6f-b154-4128d7bf2c97-data\") pod \"postgres-69fb4594cf-ctf45\" (UID: \"3198681d-c5b8-4a6f-b154-4128d7bf2c97\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"
Sep 10 16:15:03.439558 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.439530    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lr8q\" (UniqueName: \"kubernetes.io/projected/3198681d-c5b8-4a6f-b154-4128d7bf2c97-kube-api-access-9lr8q\") pod \"postgres-69fb4594cf-ctf45\" (UID: \"3198681d-c5b8-4a6f-b154-4128d7bf2c97\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"
Sep 10 16:15:03.556505 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.556415    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"
Sep 10 16:15:03.830390 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:03.830366    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"]
Sep 10 16:15:03.831490 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:15:03.831460    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3198681d_c5b8_4a6f_b154_4128d7bf2c97.slice/crio-6277f6908b12e5c9456157b702ff2f7c7df5637ba1f96c7377de3efed3093279 WatchSource:0}: Error finding container 6277f6908b12e5c9456157b702ff2f7c7df5637ba1f96c7377de3efed3093279: Status 404 returned error can't find the container with id 6277f6908b12e5c9456157b702ff2f7c7df5637ba1f96c7377de3efed3093279
Sep 10 16:15:04.309699 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:04.309662    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45" event={"ID":"3198681d-c5b8-4a6f-b154-4128d7bf2c97","Type":"ContainerStarted","Data":"6277f6908b12e5c9456157b702ff2f7c7df5637ba1f96c7377de3efed3093279"}
Sep 10 16:15:09.339257 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:09.339220    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45" event={"ID":"3198681d-c5b8-4a6f-b154-4128d7bf2c97","Type":"ContainerStarted","Data":"e6335fe4789aa536586f52196a586c7c1925426750b4956b63a08917b6323c2a"}
Sep 10 16:15:09.339628 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:09.339352    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"
Sep 10 16:15:09.358474 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:09.358421    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45" podStartSLOduration=1.452936539 podStartE2EDuration="6.358404969s" totalImagesPullingTime="4.90546843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:15:09.356624178 +0000 UTC m=+793.768710387" watchObservedRunningTime="2026-09-10 16:15:09.358404969 +0000 UTC m=+793.770491218"
Sep 10 16:15:15.372940 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:15.372908    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ctf45"
Sep 10 16:15:16.320677 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.320644    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75f9698788-9s9jf"]
Sep 10 16:15:16.331252 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.331222    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f9698788-9s9jf"
Sep 10 16:15:16.332939 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.332914    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75f9698788-9s9jf"]
Sep 10 16:15:16.335098 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.335073    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 10 16:15:16.335205 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.335132    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-h5k2r\""
Sep 10 16:15:16.452375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.452341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5shw5\" (UniqueName: \"kubernetes.io/projected/25d8cea1-3001-4699-b59f-04c1dd145da7-kube-api-access-5shw5\") pod \"authorino-75f9698788-9s9jf\" (UID: \"25d8cea1-3001-4699-b59f-04c1dd145da7\") " pod="kuadrant-system/authorino-75f9698788-9s9jf"
Sep 10 16:15:16.452779 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.452485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/25d8cea1-3001-4699-b59f-04c1dd145da7-tls-cert\") pod \"authorino-75f9698788-9s9jf\" (UID: \"25d8cea1-3001-4699-b59f-04c1dd145da7\") " pod="kuadrant-system/authorino-75f9698788-9s9jf"
Sep 10 16:15:16.553559 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.553512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/25d8cea1-3001-4699-b59f-04c1dd145da7-tls-cert\") pod \"authorino-75f9698788-9s9jf\" (UID: \"25d8cea1-3001-4699-b59f-04c1dd145da7\") " pod="kuadrant-system/authorino-75f9698788-9s9jf"
Sep 10 16:15:16.553751 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.553569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5shw5\" (UniqueName: \"kubernetes.io/projected/25d8cea1-3001-4699-b59f-04c1dd145da7-kube-api-access-5shw5\") pod \"authorino-75f9698788-9s9jf\" (UID: \"25d8cea1-3001-4699-b59f-04c1dd145da7\") " pod="kuadrant-system/authorino-75f9698788-9s9jf"
Sep 10 16:15:16.556062 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.556034    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/25d8cea1-3001-4699-b59f-04c1dd145da7-tls-cert\") pod \"authorino-75f9698788-9s9jf\" (UID: \"25d8cea1-3001-4699-b59f-04c1dd145da7\") " pod="kuadrant-system/authorino-75f9698788-9s9jf"
Sep 10 16:15:16.568101 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.568080    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5shw5\" (UniqueName: \"kubernetes.io/projected/25d8cea1-3001-4699-b59f-04c1dd145da7-kube-api-access-5shw5\") pod \"authorino-75f9698788-9s9jf\" (UID: \"25d8cea1-3001-4699-b59f-04c1dd145da7\") " pod="kuadrant-system/authorino-75f9698788-9s9jf"
Sep 10 16:15:16.642159 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.642083    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f9698788-9s9jf"
Sep 10 16:15:16.971938 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:16.971584    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75f9698788-9s9jf"]
Sep 10 16:15:17.381074 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:17.381040    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f9698788-9s9jf" event={"ID":"25d8cea1-3001-4699-b59f-04c1dd145da7","Type":"ContainerStarted","Data":"d4aa7d71b3f1db27658abe15baff7ffd3860e3a82c56b7a3131a18ad75203598"}
Sep 10 16:15:19.392981 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:19.392942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f9698788-9s9jf" event={"ID":"25d8cea1-3001-4699-b59f-04c1dd145da7","Type":"ContainerStarted","Data":"3aa752c307bb37114dcfc966d5ec3078a1343886a95539c8e61075cab31749b3"}
Sep 10 16:15:19.412069 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:15:19.412016    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75f9698788-9s9jf" podStartSLOduration=1.778264435 podStartE2EDuration="3.412001755s" totalImagesPullingTime="1.63373732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:15:19.410790004 +0000 UTC m=+803.822876230" watchObservedRunningTime="2026-09-10 16:15:19.412001755 +0000 UTC m=+803.824087965"
Sep 10 16:16:02.727618 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:02.727579    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"]
Sep 10 16:16:02.730684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:02.730667    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"
Sep 10 16:16:02.734214 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:02.734190    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fnm9l\""
Sep 10 16:16:02.734337 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:02.734310    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 16:16:02.749154 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:02.749119    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"]
Sep 10 16:16:02.874984 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:02.874936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d636c127-261a-43cd-8a07-1ba705891fd4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-qc9mc\" (UID: \"d636c127-261a-43cd-8a07-1ba705891fd4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"
Sep 10 16:16:02.874984 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:02.874978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7tzn\" (UniqueName: \"kubernetes.io/projected/d636c127-261a-43cd-8a07-1ba705891fd4-kube-api-access-k7tzn\") pod \"payload-pre-processing-59fbc47bf8-qc9mc\" (UID: \"d636c127-261a-43cd-8a07-1ba705891fd4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"
Sep 10 16:16:02.975604 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:02.975568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d636c127-261a-43cd-8a07-1ba705891fd4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-qc9mc\" (UID: \"d636c127-261a-43cd-8a07-1ba705891fd4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"
Sep 10 16:16:02.975604 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:02.975607    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7tzn\" (UniqueName: \"kubernetes.io/projected/d636c127-261a-43cd-8a07-1ba705891fd4-kube-api-access-k7tzn\") pod \"payload-pre-processing-59fbc47bf8-qc9mc\" (UID: \"d636c127-261a-43cd-8a07-1ba705891fd4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"
Sep 10 16:16:02.976279 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:02.976258    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d636c127-261a-43cd-8a07-1ba705891fd4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-qc9mc\" (UID: \"d636c127-261a-43cd-8a07-1ba705891fd4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"
Sep 10 16:16:02.988870 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:02.988845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7tzn\" (UniqueName: \"kubernetes.io/projected/d636c127-261a-43cd-8a07-1ba705891fd4-kube-api-access-k7tzn\") pod \"payload-pre-processing-59fbc47bf8-qc9mc\" (UID: \"d636c127-261a-43cd-8a07-1ba705891fd4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"
Sep 10 16:16:03.041313 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:03.041271    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"
Sep 10 16:16:03.333709 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:03.333617    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"]
Sep 10 16:16:03.337641 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:16:03.337612    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd636c127_261a_43cd_8a07_1ba705891fd4.slice/crio-e0c044bd707b2d2cc053cd03977aed6ee0154c7f023eb8c778690671e5a1e185 WatchSource:0}: Error finding container e0c044bd707b2d2cc053cd03977aed6ee0154c7f023eb8c778690671e5a1e185: Status 404 returned error can't find the container with id e0c044bd707b2d2cc053cd03977aed6ee0154c7f023eb8c778690671e5a1e185
Sep 10 16:16:03.606238 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:03.606153    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc" event={"ID":"d636c127-261a-43cd-8a07-1ba705891fd4","Type":"ContainerStarted","Data":"e0c044bd707b2d2cc053cd03977aed6ee0154c7f023eb8c778690671e5a1e185"}
Sep 10 16:16:06.624272 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:06.624233    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc" event={"ID":"d636c127-261a-43cd-8a07-1ba705891fd4","Type":"ContainerStarted","Data":"62d161b26e1278afffdd07be2151a6569fc6c3f5851a9c82c51ba0631064bb38"}
Sep 10 16:16:06.624671 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:06.624355    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"
Sep 10 16:16:12.654070 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:12.654033    2562 generic.go:356] "Generic (PLEG): container finished" podID="3b7a2202-f718-48b7-b442-9aaafae35418" containerID="bb7f053905af8e3d4d2b41134cfbc7b3222e792787b6c782a62331abf3f4820f" exitCode=0
Sep 10 16:16:12.654604 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:12.654112    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2" event={"ID":"3b7a2202-f718-48b7-b442-9aaafae35418","Type":"ContainerDied","Data":"bb7f053905af8e3d4d2b41134cfbc7b3222e792787b6c782a62331abf3f4820f"}
Sep 10 16:16:12.654676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:12.654638    2562 scope.go:117] "RemoveContainer" containerID="bb7f053905af8e3d4d2b41134cfbc7b3222e792787b6c782a62331abf3f4820f"
Sep 10 16:16:12.655682 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:12.655653    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:16:12.655752 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:12.655721    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:16:12.655794 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:12.655770    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:16:12.685509 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:12.685459    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc" podStartSLOduration=7.856850113 podStartE2EDuration="10.685443503s" totalImagesPullingTime="2.82859339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:16:06.667566742 +0000 UTC m=+851.079652947" watchObservedRunningTime="2026-09-10 16:16:12.685443503 +0000 UTC m=+857.097529717"
Sep 10 16:16:13.665799 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:13.664882    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2" event={"ID":"3b7a2202-f718-48b7-b442-9aaafae35418","Type":"ContainerStarted","Data":"e704b7f86a8f56b63be2f75e2b708e4eedc7813d56c0d663f5c96d8b7f489a68"}
Sep 10 16:16:14.269994 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:14.269954    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:16:14.270186 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:14.270161    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-mgrr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 10 16:16:14.270235 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:14.270211    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2" podUID="3b7a2202-f718-48b7-b442-9aaafae35418" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 10 16:16:15.270423 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:15.270378    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-mgrr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 10 16:16:15.270921 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:15.270444    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2" podUID="3b7a2202-f718-48b7-b442-9aaafae35418" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 10 16:16:16.270822 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:16.270784    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-mgrr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 10 16:16:16.271309 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:16.270846    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2" podUID="3b7a2202-f718-48b7-b442-9aaafae35418" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 10 16:16:17.270472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:17.270432    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-mgrr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 10 16:16:17.270656 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:17.270507    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2" podUID="3b7a2202-f718-48b7-b442-9aaafae35418" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 10 16:16:17.630979 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:17.630889    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-qc9mc"
Sep 10 16:16:18.270667 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:18.270620    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-mgrr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 10 16:16:18.270882 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:18.270714    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2" podUID="3b7a2202-f718-48b7-b442-9aaafae35418" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 10 16:16:19.273798 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:19.273766    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:16:19.274371 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:19.274021    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:16:19.274820 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:19.274803    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-mgrr2"
Sep 10 16:16:23.012084 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.012046    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"]
Sep 10 16:16:23.015769 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.015747    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.020023 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.020001    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 16:16:23.020143 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.020004    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 16:16:23.020143 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.020045    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 16:16:23.020143 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.020061    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wz694\""
Sep 10 16:16:23.031552 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.031517    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"]
Sep 10 16:16:23.068180 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.068148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df5fb673-2832-44e9-90ce-9e4470129325-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.068349 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.068188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df5fb673-2832-44e9-90ce-9e4470129325-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.068349 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.068213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df5fb673-2832-44e9-90ce-9e4470129325-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.068349 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.068276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df5fb673-2832-44e9-90ce-9e4470129325-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.068349 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.068321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td4kw\" (UniqueName: \"kubernetes.io/projected/df5fb673-2832-44e9-90ce-9e4470129325-kube-api-access-td4kw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.068349 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.068343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df5fb673-2832-44e9-90ce-9e4470129325-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.169181 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.169144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df5fb673-2832-44e9-90ce-9e4470129325-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.169364 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.169194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df5fb673-2832-44e9-90ce-9e4470129325-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.169364 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.169234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td4kw\" (UniqueName: \"kubernetes.io/projected/df5fb673-2832-44e9-90ce-9e4470129325-kube-api-access-td4kw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.169364 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.169271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df5fb673-2832-44e9-90ce-9e4470129325-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.169533 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.169382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df5fb673-2832-44e9-90ce-9e4470129325-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.169533 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.169420    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df5fb673-2832-44e9-90ce-9e4470129325-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.169637 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.169616    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df5fb673-2832-44e9-90ce-9e4470129325-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.169800 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.169768    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df5fb673-2832-44e9-90ce-9e4470129325-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.169951 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.169901    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df5fb673-2832-44e9-90ce-9e4470129325-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.172062 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.172037    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df5fb673-2832-44e9-90ce-9e4470129325-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.172288 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.172258    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df5fb673-2832-44e9-90ce-9e4470129325-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.179703 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.179677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td4kw\" (UniqueName: \"kubernetes.io/projected/df5fb673-2832-44e9-90ce-9e4470129325-kube-api-access-td4kw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g\" (UID: \"df5fb673-2832-44e9-90ce-9e4470129325\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.326303 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.326208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:23.599561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.599530    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"]
Sep 10 16:16:23.602184 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:16:23.602149    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf5fb673_2832_44e9_90ce_9e4470129325.slice/crio-5307d63ae989568504999de79ea34a609d1242ce2bce3ebffcea1e8be585a739 WatchSource:0}: Error finding container 5307d63ae989568504999de79ea34a609d1242ce2bce3ebffcea1e8be585a739: Status 404 returned error can't find the container with id 5307d63ae989568504999de79ea34a609d1242ce2bce3ebffcea1e8be585a739
Sep 10 16:16:23.717502 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:23.717455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g" event={"ID":"df5fb673-2832-44e9-90ce-9e4470129325","Type":"ContainerStarted","Data":"5307d63ae989568504999de79ea34a609d1242ce2bce3ebffcea1e8be585a739"}
Sep 10 16:16:25.728034 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:25.727997    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g" event={"ID":"df5fb673-2832-44e9-90ce-9e4470129325","Type":"ContainerStarted","Data":"fc747fa0466a4b72a974b6527391062580939bea48293461de0eb88ab6705cb4"}
Sep 10 16:16:25.753346 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:25.753295    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g" podStartSLOduration=2.63893374 podStartE2EDuration="3.753277022s" totalImagesPullingTime="1.114343282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:16:25.750531613 +0000 UTC m=+870.162617822" watchObservedRunningTime="2026-09-10 16:16:25.753277022 +0000 UTC m=+870.165363272"
Sep 10 16:16:33.326603 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:33.326561    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:33.327101 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:33.326627    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:33.339094 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:33.339065    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:33.779169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:33.779133    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g"
Sep 10 16:16:50.632024 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.631931    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"]
Sep 10 16:16:50.635620 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.635597    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.640415 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.640390    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 10 16:16:50.657003 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.656972    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"]
Sep 10 16:16:50.727758 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.727702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb434d6b-fb5a-4913-8733-e9647fca7dcd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.727954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.727764    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb434d6b-fb5a-4913-8733-e9647fca7dcd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.727954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.727821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kttgf\" (UniqueName: \"kubernetes.io/projected/fb434d6b-fb5a-4913-8733-e9647fca7dcd-kube-api-access-kttgf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.727954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.727847    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb434d6b-fb5a-4913-8733-e9647fca7dcd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.727954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.727925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb434d6b-fb5a-4913-8733-e9647fca7dcd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.728113 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.727979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb434d6b-fb5a-4913-8733-e9647fca7dcd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.828940 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.828899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb434d6b-fb5a-4913-8733-e9647fca7dcd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.828940 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.828942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb434d6b-fb5a-4913-8733-e9647fca7dcd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.829198 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.828973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kttgf\" (UniqueName: \"kubernetes.io/projected/fb434d6b-fb5a-4913-8733-e9647fca7dcd-kube-api-access-kttgf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.829198 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.829000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb434d6b-fb5a-4913-8733-e9647fca7dcd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.829198 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.829031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb434d6b-fb5a-4913-8733-e9647fca7dcd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.829198 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.829083    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb434d6b-fb5a-4913-8733-e9647fca7dcd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.829480 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.829454    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb434d6b-fb5a-4913-8733-e9647fca7dcd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.829537 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.829467    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb434d6b-fb5a-4913-8733-e9647fca7dcd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.829601 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.829537    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb434d6b-fb5a-4913-8733-e9647fca7dcd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.831271 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.831238    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb434d6b-fb5a-4913-8733-e9647fca7dcd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.831579 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.831558    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb434d6b-fb5a-4913-8733-e9647fca7dcd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.840745 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.840708    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kttgf\" (UniqueName: \"kubernetes.io/projected/fb434d6b-fb5a-4913-8733-e9647fca7dcd-kube-api-access-kttgf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnf5b\" (UID: \"fb434d6b-fb5a-4913-8733-e9647fca7dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:50.968959 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:50.968856    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:16:51.252298 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:51.252262    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"]
Sep 10 16:16:51.255793 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:16:51.255764    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb434d6b_fb5a_4913_8733_e9647fca7dcd.slice/crio-b7b7caf5d3dba06d89880e624f266f9fde995fa17bb5b6f376172b1921d803e8 WatchSource:0}: Error finding container b7b7caf5d3dba06d89880e624f266f9fde995fa17bb5b6f376172b1921d803e8: Status 404 returned error can't find the container with id b7b7caf5d3dba06d89880e624f266f9fde995fa17bb5b6f376172b1921d803e8
Sep 10 16:16:51.859911 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:51.859819    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b" event={"ID":"fb434d6b-fb5a-4913-8733-e9647fca7dcd","Type":"ContainerStarted","Data":"0ed3098a59a471d612c2a81396b43599ccbd05910cfdb863753c6d92a2b17c98"}
Sep 10 16:16:51.859911 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:51.859874    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b" event={"ID":"fb434d6b-fb5a-4913-8733-e9647fca7dcd","Type":"ContainerStarted","Data":"b7b7caf5d3dba06d89880e624f266f9fde995fa17bb5b6f376172b1921d803e8"}
Sep 10 16:16:51.947202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:16:51.947133    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b" podStartSLOduration=1.742094588 podStartE2EDuration="1.947116187s" totalImagesPullingTime="205.021599ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:16:51.944994184 +0000 UTC m=+896.357080393" watchObservedRunningTime="2026-09-10 16:16:51.947116187 +0000 UTC m=+896.359202395"
Sep 10 16:17:00.969628 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:17:00.969574    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:17:00.970074 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:17:00.969651    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:17:00.982680 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:17:00.982650    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:17:01.921006 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:17:01.920974    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnf5b"
Sep 10 16:18:32.222683 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:32.221710    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75f9698788-9s9jf"]
Sep 10 16:18:32.223279 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:32.222819    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75f9698788-9s9jf" podUID="25d8cea1-3001-4699-b59f-04c1dd145da7" containerName="authorino" containerID="cri-o://3aa752c307bb37114dcfc966d5ec3078a1343886a95539c8e61075cab31749b3" gracePeriod=30
Sep 10 16:18:32.349691 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:32.349649    2562 generic.go:356] "Generic (PLEG): container finished" podID="25d8cea1-3001-4699-b59f-04c1dd145da7" containerID="3aa752c307bb37114dcfc966d5ec3078a1343886a95539c8e61075cab31749b3" exitCode=0
Sep 10 16:18:32.349843 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:32.349704    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f9698788-9s9jf" event={"ID":"25d8cea1-3001-4699-b59f-04c1dd145da7","Type":"ContainerDied","Data":"3aa752c307bb37114dcfc966d5ec3078a1343886a95539c8e61075cab31749b3"}
Sep 10 16:18:32.470253 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:32.470228    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f9698788-9s9jf"
Sep 10 16:18:32.626701 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:32.626654    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/25d8cea1-3001-4699-b59f-04c1dd145da7-tls-cert\") pod \"25d8cea1-3001-4699-b59f-04c1dd145da7\" (UID: \"25d8cea1-3001-4699-b59f-04c1dd145da7\") "
Sep 10 16:18:32.626898 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:32.626818    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5shw5\" (UniqueName: \"kubernetes.io/projected/25d8cea1-3001-4699-b59f-04c1dd145da7-kube-api-access-5shw5\") pod \"25d8cea1-3001-4699-b59f-04c1dd145da7\" (UID: \"25d8cea1-3001-4699-b59f-04c1dd145da7\") "
Sep 10 16:18:32.628718 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:32.628675    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25d8cea1-3001-4699-b59f-04c1dd145da7-kube-api-access-5shw5" (OuterVolumeSpecName: "kube-api-access-5shw5") pod "25d8cea1-3001-4699-b59f-04c1dd145da7" (UID: "25d8cea1-3001-4699-b59f-04c1dd145da7"). InnerVolumeSpecName "kube-api-access-5shw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:18:32.636993 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:32.636967    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25d8cea1-3001-4699-b59f-04c1dd145da7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "25d8cea1-3001-4699-b59f-04c1dd145da7" (UID: "25d8cea1-3001-4699-b59f-04c1dd145da7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 16:18:32.727826 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:32.727790    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/25d8cea1-3001-4699-b59f-04c1dd145da7-tls-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:18:32.727826 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:32.727823    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5shw5\" (UniqueName: \"kubernetes.io/projected/25d8cea1-3001-4699-b59f-04c1dd145da7-kube-api-access-5shw5\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:18:33.355704 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:33.355672    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75f9698788-9s9jf"
Sep 10 16:18:33.356164 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:33.355709    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75f9698788-9s9jf" event={"ID":"25d8cea1-3001-4699-b59f-04c1dd145da7","Type":"ContainerDied","Data":"d4aa7d71b3f1db27658abe15baff7ffd3860e3a82c56b7a3131a18ad75203598"}
Sep 10 16:18:33.356164 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:33.355781    2562 scope.go:117] "RemoveContainer" containerID="3aa752c307bb37114dcfc966d5ec3078a1343886a95539c8e61075cab31749b3"
Sep 10 16:18:33.386420 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:33.386388    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75f9698788-9s9jf"]
Sep 10 16:18:33.390627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:33.390599    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75f9698788-9s9jf"]
Sep 10 16:18:34.070425 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:34.070391    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25d8cea1-3001-4699-b59f-04c1dd145da7" path="/var/lib/kubelet/pods/25d8cea1-3001-4699-b59f-04c1dd145da7/volumes"
Sep 10 16:18:50.580992 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.580961    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"]
Sep 10 16:18:50.581421 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.581350    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d8cea1-3001-4699-b59f-04c1dd145da7" containerName="authorino"
Sep 10 16:18:50.581421 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.581361    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d8cea1-3001-4699-b59f-04c1dd145da7" containerName="authorino"
Sep 10 16:18:50.581421 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.581423    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="25d8cea1-3001-4699-b59f-04c1dd145da7" containerName="authorino"
Sep 10 16:18:50.584315 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.584293    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.587609 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.587589    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-37c805-openshift-default-dockercfg-b59wd\""
Sep 10 16:18:50.604254 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.604226    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-credential-socket\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.604402 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.604292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htn59\" (UniqueName: \"kubernetes.io/projected/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-kube-api-access-htn59\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.604402 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.604317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-data\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.604402 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.604352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istiod-ca-cert\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.604402 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.604383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-token\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.604609 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.604396    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"]
Sep 10 16:18:50.604609 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.604456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-podinfo\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.604609 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.604555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-workload-certs\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.604609 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.604588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-envoy\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.604797 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.604623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-workload-socket\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.705324 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.705288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htn59\" (UniqueName: \"kubernetes.io/projected/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-kube-api-access-htn59\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.705324 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.705329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-data\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.705569 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.705436    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istiod-ca-cert\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.705569 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.705458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-token\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.705569 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.705487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-podinfo\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.705569 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.705559    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-workload-certs\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.705803 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.705589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-envoy\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.705803 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.705623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-workload-socket\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.705803 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.705655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-credential-socket\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.705996 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.705967    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-data\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.706059 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.706022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-workload-certs\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.706109 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.706062    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-credential-socket\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.706254 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.706227    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-workload-socket\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.706380 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.706285    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istiod-ca-cert\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.708088 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.708069    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-envoy\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.708364 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.708344    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-podinfo\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.715299 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.715256    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-token\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.717127 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.717104    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htn59\" (UniqueName: \"kubernetes.io/projected/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-kube-api-access-htn59\") pod \"e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") " pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:50.895443 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:50.895353    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:51.205270 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:51.205204    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"]
Sep 10 16:18:51.207572 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:18:51.207533    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e7e7dd7_b9e2_4b6d_bf39_32068aa236b0.slice/crio-13db80a0429c2e3a30184dd3cfaf53a89ed791e721251cf8a17b61639d1f69f8 WatchSource:0}: Error finding container 13db80a0429c2e3a30184dd3cfaf53a89ed791e721251cf8a17b61639d1f69f8: Status 404 returned error can't find the container with id 13db80a0429c2e3a30184dd3cfaf53a89ed791e721251cf8a17b61639d1f69f8
Sep 10 16:18:51.209692 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:51.209650    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:18:51.209792 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:51.209743    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:18:51.209792 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:51.209781    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:18:51.451120 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:51.451081    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" event={"ID":"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0","Type":"ContainerStarted","Data":"409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f"}
Sep 10 16:18:51.451301 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:51.451140    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" event={"ID":"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0","Type":"ContainerStarted","Data":"13db80a0429c2e3a30184dd3cfaf53a89ed791e721251cf8a17b61639d1f69f8"}
Sep 10 16:18:51.493980 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:51.493927    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" podStartSLOduration=1.493905839 podStartE2EDuration="1.493905839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:18:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:18:51.491920315 +0000 UTC m=+1015.904006524" watchObservedRunningTime="2026-09-10 16:18:51.493905839 +0000 UTC m=+1015.905992049"
Sep 10 16:18:51.895674 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:51.895588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:52.901255 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:52.901224    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:53.461638 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:53.461599    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:53.462488 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:53.462468    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:18:54.736344 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:54.736305    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7474-792bc2"]
Sep 10 16:18:54.739399 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:54.739377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7474-792bc2"
Sep 10 16:18:54.742381 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:54.742354    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8f29h\""
Sep 10 16:18:54.750642 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:54.750617    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7474-792bc2"]
Sep 10 16:18:54.849236 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:54.849190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktrsv\" (UniqueName: \"kubernetes.io/projected/01a0b7d5-cb23-4283-beb1-dbf7c1f3a006-kube-api-access-ktrsv\") pod \"test-curl-7474-792bc2\" (UID: \"01a0b7d5-cb23-4283-beb1-dbf7c1f3a006\") " pod="opendatahub/test-curl-7474-792bc2"
Sep 10 16:18:54.950678 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:54.950640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktrsv\" (UniqueName: \"kubernetes.io/projected/01a0b7d5-cb23-4283-beb1-dbf7c1f3a006-kube-api-access-ktrsv\") pod \"test-curl-7474-792bc2\" (UID: \"01a0b7d5-cb23-4283-beb1-dbf7c1f3a006\") " pod="opendatahub/test-curl-7474-792bc2"
Sep 10 16:18:54.962316 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:54.962289    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktrsv\" (UniqueName: \"kubernetes.io/projected/01a0b7d5-cb23-4283-beb1-dbf7c1f3a006-kube-api-access-ktrsv\") pod \"test-curl-7474-792bc2\" (UID: \"01a0b7d5-cb23-4283-beb1-dbf7c1f3a006\") " pod="opendatahub/test-curl-7474-792bc2"
Sep 10 16:18:55.050257 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.050215    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7474-792bc2"
Sep 10 16:18:55.335015 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.334986    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7474-792bc2"]
Sep 10 16:18:55.336530 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:18:55.336507    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01a0b7d5_cb23_4283_beb1_dbf7c1f3a006.slice/crio-db6a6f3209def649ac50938cb3e148483ee5ea3835ad23890f990eb02967b402 WatchSource:0}: Error finding container db6a6f3209def649ac50938cb3e148483ee5ea3835ad23890f990eb02967b402: Status 404 returned error can't find the container with id db6a6f3209def649ac50938cb3e148483ee5ea3835ad23890f990eb02967b402
Sep 10 16:18:55.338941 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.338924    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 16:18:55.397629 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.397600    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"]
Sep 10 16:18:55.400834 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.400814    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"
Sep 10 16:18:55.403889 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.403861    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-37c805\""
Sep 10 16:18:55.414518 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.414482    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"]
Sep 10 16:18:55.454963 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.454918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/841cb63d-1d2f-4056-ab6a-a645ac56ab67-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf\" (UID: \"841cb63d-1d2f-4056-ab6a-a645ac56ab67\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"
Sep 10 16:18:55.455126 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.455078    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kghcl\" (UniqueName: \"kubernetes.io/projected/841cb63d-1d2f-4056-ab6a-a645ac56ab67-kube-api-access-kghcl\") pod \"payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf\" (UID: \"841cb63d-1d2f-4056-ab6a-a645ac56ab67\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"
Sep 10 16:18:55.472495 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.472463    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7474-792bc2" event={"ID":"01a0b7d5-cb23-4283-beb1-dbf7c1f3a006","Type":"ContainerStarted","Data":"db6a6f3209def649ac50938cb3e148483ee5ea3835ad23890f990eb02967b402"}
Sep 10 16:18:55.556225 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.556180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kghcl\" (UniqueName: \"kubernetes.io/projected/841cb63d-1d2f-4056-ab6a-a645ac56ab67-kube-api-access-kghcl\") pod \"payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf\" (UID: \"841cb63d-1d2f-4056-ab6a-a645ac56ab67\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"
Sep 10 16:18:55.556425 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.556256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/841cb63d-1d2f-4056-ab6a-a645ac56ab67-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf\" (UID: \"841cb63d-1d2f-4056-ab6a-a645ac56ab67\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"
Sep 10 16:18:55.557135 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.557101    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/841cb63d-1d2f-4056-ab6a-a645ac56ab67-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf\" (UID: \"841cb63d-1d2f-4056-ab6a-a645ac56ab67\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"
Sep 10 16:18:55.572487 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.572453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kghcl\" (UniqueName: \"kubernetes.io/projected/841cb63d-1d2f-4056-ab6a-a645ac56ab67-kube-api-access-kghcl\") pod \"payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf\" (UID: \"841cb63d-1d2f-4056-ab6a-a645ac56ab67\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"
Sep 10 16:18:55.712084 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.711992    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"
Sep 10 16:18:55.992342 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:55.992130    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"]
Sep 10 16:18:56.481297 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:56.481194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf" event={"ID":"841cb63d-1d2f-4056-ab6a-a645ac56ab67","Type":"ContainerStarted","Data":"6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5"}
Sep 10 16:18:56.481297 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:56.481263    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf" event={"ID":"841cb63d-1d2f-4056-ab6a-a645ac56ab67","Type":"ContainerStarted","Data":"dcad0033d9e026eb2b116f1e91c4d7e38d28c12316b02dc1b51ebea4725cbbcc"}
Sep 10 16:18:56.481544 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:56.481309    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"
Sep 10 16:18:56.503746 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:56.503671    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf" podStartSLOduration=1.503655019 podStartE2EDuration="1.503655019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:18:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:18:56.502932584 +0000 UTC m=+1020.915018794" watchObservedRunningTime="2026-09-10 16:18:56.503655019 +0000 UTC m=+1020.915741228"
Sep 10 16:18:57.488106 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:57.488072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7474-792bc2" event={"ID":"01a0b7d5-cb23-4283-beb1-dbf7c1f3a006","Type":"ContainerStarted","Data":"43933a6d1dd0731f7f5bb53e54c1d5d7d038c6ef6191348350bcb6fb107ec715"}
Sep 10 16:18:57.513139 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:57.513086    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7474-792bc2" podStartSLOduration=1.445984115 podStartE2EDuration="3.51306808s" totalImagesPullingTime="2.067083965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:18:57.512349084 +0000 UTC m=+1021.924435293" watchObservedRunningTime="2026-09-10 16:18:57.51306808 +0000 UTC m=+1021.925154290"
Sep 10 16:18:58.188064 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:58.187975    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7474-792bc2"]
Sep 10 16:18:58.190966 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:58.190931    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7474-792bc2"]
Sep 10 16:18:58.493462 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:18:58.493432    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7474-792bc2" container="test-curl-7474-792bc2"
Sep 10 16:18:59.125519 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.125481    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"]
Sep 10 16:18:59.126148 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.126130    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01a0b7d5-cb23-4283-beb1-dbf7c1f3a006" containerName="test-curl-7474-792bc2"
Sep 10 16:18:59.126199 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.126151    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="01a0b7d5-cb23-4283-beb1-dbf7c1f3a006" containerName="test-curl-7474-792bc2"
Sep 10 16:18:59.126287 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.126276    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="01a0b7d5-cb23-4283-beb1-dbf7c1f3a006" containerName="test-curl-7474-792bc2"
Sep 10 16:18:59.129864 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.129836    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.135680 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.135649    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-1596ac-openshift-default-dockercfg-8864h\""
Sep 10 16:18:59.150070 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.150040    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"]
Sep 10 16:18:59.198640 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.198602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-workload-socket\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.199008 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.198972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00cb1278-23ae-4587-94ce-d53409e9489a-istio-podinfo\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.199117 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.199022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00cb1278-23ae-4587-94ce-d53409e9489a-istio-token\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.199117 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.199088    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-istio-envoy\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.199217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.199166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-credential-socket\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.199217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.199192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-workload-certs\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.199686 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.199221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00cb1278-23ae-4587-94ce-d53409e9489a-istiod-ca-cert\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.199686 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.199246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm4sr\" (UniqueName: \"kubernetes.io/projected/00cb1278-23ae-4587-94ce-d53409e9489a-kube-api-access-bm4sr\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.199686 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.199293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-istio-data\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.299805 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.299774    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00cb1278-23ae-4587-94ce-d53409e9489a-istio-token\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.299975 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.299827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-istio-envoy\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.299975 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.299874    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-credential-socket\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.299975 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.299890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-workload-certs\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.299975 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.299907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00cb1278-23ae-4587-94ce-d53409e9489a-istiod-ca-cert\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.299975 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.299923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm4sr\" (UniqueName: \"kubernetes.io/projected/00cb1278-23ae-4587-94ce-d53409e9489a-kube-api-access-bm4sr\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.299975 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.299951    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-istio-data\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.300340 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.300314    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-workload-socket\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.300417 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.300356    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-credential-socket\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.300417 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.300393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00cb1278-23ae-4587-94ce-d53409e9489a-istio-podinfo\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.300528 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.300489    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-workload-certs\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.300738 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.300703    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00cb1278-23ae-4587-94ce-d53409e9489a-istiod-ca-cert\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.300793 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.300769    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-workload-socket\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.300906 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.300888    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-istio-data\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.302323 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.302304    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-istio-envoy\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.302614 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.302597    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00cb1278-23ae-4587-94ce-d53409e9489a-istio-podinfo\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.310127 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.310099    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00cb1278-23ae-4587-94ce-d53409e9489a-istio-token\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.310476 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.310449    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm4sr\" (UniqueName: \"kubernetes.io/projected/00cb1278-23ae-4587-94ce-d53409e9489a-kube-api-access-bm4sr\") pod \"e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") " pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.443125 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.443023    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:18:59.499287 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.499224    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7474-792bc2" podUID="01a0b7d5-cb23-4283-beb1-dbf7c1f3a006" containerName="test-curl-7474-792bc2" containerID="cri-o://43933a6d1dd0731f7f5bb53e54c1d5d7d038c6ef6191348350bcb6fb107ec715" gracePeriod=2
Sep 10 16:18:59.503212 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:18:59.502875    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7474-792bc2\" is forbidden: User \"system:node:ip-10-0-132-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-43.ec2.internal' and this object" podUID="01a0b7d5-cb23-4283-beb1-dbf7c1f3a006" pod="opendatahub/test-curl-7474-792bc2"
Sep 10 16:18:59.734867 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.734844    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"]
Sep 10 16:18:59.736971 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:18:59.736938    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00cb1278_23ae_4587_94ce_d53409e9489a.slice/crio-a95b72483b144cfbe2fe43e7e1b7f2819bae93060dceb9f3a0dd164c754f0946 WatchSource:0}: Error finding container a95b72483b144cfbe2fe43e7e1b7f2819bae93060dceb9f3a0dd164c754f0946: Status 404 returned error can't find the container with id a95b72483b144cfbe2fe43e7e1b7f2819bae93060dceb9f3a0dd164c754f0946
Sep 10 16:18:59.739218 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.739161    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:18:59.739310 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.739251    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:18:59.739310 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:18:59.739283    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:00.506302 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.506265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" event={"ID":"00cb1278-23ae-4587-94ce-d53409e9489a","Type":"ContainerStarted","Data":"532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5"}
Sep 10 16:19:00.506674 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.506324    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" event={"ID":"00cb1278-23ae-4587-94ce-d53409e9489a","Type":"ContainerStarted","Data":"a95b72483b144cfbe2fe43e7e1b7f2819bae93060dceb9f3a0dd164c754f0946"}
Sep 10 16:19:00.540112 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.540057    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" podStartSLOduration=1.5400398320000002 podStartE2EDuration="1.540039832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:18:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:19:00.536713546 +0000 UTC m=+1024.948799755" watchObservedRunningTime="2026-09-10 16:19:00.540039832 +0000 UTC m=+1024.952126041"
Sep 10 16:19:00.766970 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.766894    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"]
Sep 10 16:19:00.769718 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.769697    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:00.773625 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.773602    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fefaa7ab-openshift-default-dockercfg-xvpmc\""
Sep 10 16:19:00.788876 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.788849    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"]
Sep 10 16:19:00.914821 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.914790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-credential-socket\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:00.914969 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.914858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-workload-certs\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:00.914969 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.914949    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-token\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:00.915065 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.915000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmp5b\" (UniqueName: \"kubernetes.io/projected/d16c92f2-6c07-4825-8c35-a075a21363dc-kube-api-access-rmp5b\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:00.915065 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.915049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-workload-socket\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:00.915129 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.915075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-data\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:00.915129 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.915118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-podinfo\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:00.915194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.915138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-envoy\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:00.915194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:00.915173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d16c92f2-6c07-4825-8c35-a075a21363dc-istiod-ca-cert\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.016463 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.016428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-credential-socket\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.016665 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.016494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-workload-certs\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.016665 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.016519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-token\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.016665 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.016544    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmp5b\" (UniqueName: \"kubernetes.io/projected/d16c92f2-6c07-4825-8c35-a075a21363dc-kube-api-access-rmp5b\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.016665 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.016561    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-workload-socket\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.016665 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.016580    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-data\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.016963 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.016785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-podinfo\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.016963 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.016827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-envoy\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.016963 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.016859    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d16c92f2-6c07-4825-8c35-a075a21363dc-istiod-ca-cert\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.016963 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.016958    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-data\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.017186 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.017000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-workload-certs\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.017186 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.017059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-credential-socket\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.017186 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.017093    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-workload-socket\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.017477 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.017455    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d16c92f2-6c07-4825-8c35-a075a21363dc-istiod-ca-cert\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.019090 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.019073    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-envoy\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.019202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.019182    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-podinfo\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.026398 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.026378    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-token\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.026535 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.026513    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmp5b\" (UniqueName: \"kubernetes.io/projected/d16c92f2-6c07-4825-8c35-a075a21363dc-kube-api-access-rmp5b\") pod \"e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") " pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.081176 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.081140    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:01.367402 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.367363    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"]
Sep 10 16:19:01.369600 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:19:01.369576    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16c92f2_6c07_4825_8c35_a075a21363dc.slice/crio-d4433e4f41280ac9f990ffd20b53d3c377fef09e7c782c70f467ae20f8b7d649 WatchSource:0}: Error finding container d4433e4f41280ac9f990ffd20b53d3c377fef09e7c782c70f467ae20f8b7d649: Status 404 returned error can't find the container with id d4433e4f41280ac9f990ffd20b53d3c377fef09e7c782c70f467ae20f8b7d649
Sep 10 16:19:01.372010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.371966    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:01.372090 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.372062    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:01.372126 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.372109    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:01.444163 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.444113    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:19:01.450321 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.450296    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:19:01.514362 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.514327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" event={"ID":"d16c92f2-6c07-4825-8c35-a075a21363dc","Type":"ContainerStarted","Data":"7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d"}
Sep 10 16:19:01.514783 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.514394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" event={"ID":"d16c92f2-6c07-4825-8c35-a075a21363dc","Type":"ContainerStarted","Data":"d4433e4f41280ac9f990ffd20b53d3c377fef09e7c782c70f467ae20f8b7d649"}
Sep 10 16:19:01.514783 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.514740    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:19:01.515708 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.515686    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:19:01.540116 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.540059    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" podStartSLOduration=1.540042438 podStartE2EDuration="1.540042438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:19:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:19:01.53762107 +0000 UTC m=+1025.949707272" watchObservedRunningTime="2026-09-10 16:19:01.540042438 +0000 UTC m=+1025.952128647"
Sep 10 16:19:01.710159 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.710135    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7474-792bc2"
Sep 10 16:19:01.826909 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.826872    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktrsv\" (UniqueName: \"kubernetes.io/projected/01a0b7d5-cb23-4283-beb1-dbf7c1f3a006-kube-api-access-ktrsv\") pod \"01a0b7d5-cb23-4283-beb1-dbf7c1f3a006\" (UID: \"01a0b7d5-cb23-4283-beb1-dbf7c1f3a006\") "
Sep 10 16:19:01.829045 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.829022    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01a0b7d5-cb23-4283-beb1-dbf7c1f3a006-kube-api-access-ktrsv" (OuterVolumeSpecName: "kube-api-access-ktrsv") pod "01a0b7d5-cb23-4283-beb1-dbf7c1f3a006" (UID: "01a0b7d5-cb23-4283-beb1-dbf7c1f3a006"). InnerVolumeSpecName "kube-api-access-ktrsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:19:01.928571 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:01.928483    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktrsv\" (UniqueName: \"kubernetes.io/projected/01a0b7d5-cb23-4283-beb1-dbf7c1f3a006-kube-api-access-ktrsv\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:02.071876 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:02.071840    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01a0b7d5-cb23-4283-beb1-dbf7c1f3a006" path="/var/lib/kubelet/pods/01a0b7d5-cb23-4283-beb1-dbf7c1f3a006/volumes"
Sep 10 16:19:02.081868 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:02.081842    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:02.088495 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:02.088471    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:02.521813 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:02.521780    2562 generic.go:356] "Generic (PLEG): container finished" podID="01a0b7d5-cb23-4283-beb1-dbf7c1f3a006" containerID="43933a6d1dd0731f7f5bb53e54c1d5d7d038c6ef6191348350bcb6fb107ec715" exitCode=137
Sep 10 16:19:02.522244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:02.521823    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7474-792bc2"
Sep 10 16:19:02.522244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:02.521888    2562 scope.go:117] "RemoveContainer" containerID="43933a6d1dd0731f7f5bb53e54c1d5d7d038c6ef6191348350bcb6fb107ec715"
Sep 10 16:19:02.522244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:02.522133    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:02.523456 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:02.523293    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:02.530800 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:02.530780    2562 scope.go:117] "RemoveContainer" containerID="43933a6d1dd0731f7f5bb53e54c1d5d7d038c6ef6191348350bcb6fb107ec715"
Sep 10 16:19:02.531099 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:19:02.531081    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43933a6d1dd0731f7f5bb53e54c1d5d7d038c6ef6191348350bcb6fb107ec715\": container with ID starting with 43933a6d1dd0731f7f5bb53e54c1d5d7d038c6ef6191348350bcb6fb107ec715 not found: ID does not exist" containerID="43933a6d1dd0731f7f5bb53e54c1d5d7d038c6ef6191348350bcb6fb107ec715"
Sep 10 16:19:02.531152 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:02.531109    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43933a6d1dd0731f7f5bb53e54c1d5d7d038c6ef6191348350bcb6fb107ec715"} err="failed to get container status \"43933a6d1dd0731f7f5bb53e54c1d5d7d038c6ef6191348350bcb6fb107ec715\": rpc error: code = NotFound desc = could not find container \"43933a6d1dd0731f7f5bb53e54c1d5d7d038c6ef6191348350bcb6fb107ec715\": container with ID starting with 43933a6d1dd0731f7f5bb53e54c1d5d7d038c6ef6191348350bcb6fb107ec715 not found: ID does not exist"
Sep 10 16:19:05.634239 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:05.634197    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"]
Sep 10 16:19:05.637812 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:05.637779    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"
Sep 10 16:19:05.640764 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:05.640734    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-fefaa7ab\""
Sep 10 16:19:05.653404 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:05.653370    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"]
Sep 10 16:19:05.786142 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:05.786095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a92f9c61-0461-4af3-8605-fc14be0c90d7-plugins-config-volume\") pod \"payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj\" (UID: \"a92f9c61-0461-4af3-8605-fc14be0c90d7\") " pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"
Sep 10 16:19:05.786362 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:05.786195    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnjnl\" (UniqueName: \"kubernetes.io/projected/a92f9c61-0461-4af3-8605-fc14be0c90d7-kube-api-access-dnjnl\") pod \"payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj\" (UID: \"a92f9c61-0461-4af3-8605-fc14be0c90d7\") " pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"
Sep 10 16:19:05.887792 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:05.887697    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjnl\" (UniqueName: \"kubernetes.io/projected/a92f9c61-0461-4af3-8605-fc14be0c90d7-kube-api-access-dnjnl\") pod \"payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj\" (UID: \"a92f9c61-0461-4af3-8605-fc14be0c90d7\") " pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"
Sep 10 16:19:05.887970 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:05.887843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a92f9c61-0461-4af3-8605-fc14be0c90d7-plugins-config-volume\") pod \"payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj\" (UID: \"a92f9c61-0461-4af3-8605-fc14be0c90d7\") " pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"
Sep 10 16:19:05.888485 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:05.888464    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a92f9c61-0461-4af3-8605-fc14be0c90d7-plugins-config-volume\") pod \"payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj\" (UID: \"a92f9c61-0461-4af3-8605-fc14be0c90d7\") " pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"
Sep 10 16:19:05.897056 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:05.897033    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnjnl\" (UniqueName: \"kubernetes.io/projected/a92f9c61-0461-4af3-8605-fc14be0c90d7-kube-api-access-dnjnl\") pod \"payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj\" (UID: \"a92f9c61-0461-4af3-8605-fc14be0c90d7\") " pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"
Sep 10 16:19:05.953466 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:05.953428    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"
Sep 10 16:19:06.237991 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:06.237944    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"]
Sep 10 16:19:06.240763 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:19:06.240720    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda92f9c61_0461_4af3_8605_fc14be0c90d7.slice/crio-361f470662c53342b7b437a7b2512cd19faa025c4f24933d6cda041129b69508 WatchSource:0}: Error finding container 361f470662c53342b7b437a7b2512cd19faa025c4f24933d6cda041129b69508: Status 404 returned error can't find the container with id 361f470662c53342b7b437a7b2512cd19faa025c4f24933d6cda041129b69508
Sep 10 16:19:06.546027 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:06.545983    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj" event={"ID":"a92f9c61-0461-4af3-8605-fc14be0c90d7","Type":"ContainerStarted","Data":"435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6"}
Sep 10 16:19:06.546247 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:06.546054    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj" event={"ID":"a92f9c61-0461-4af3-8605-fc14be0c90d7","Type":"ContainerStarted","Data":"361f470662c53342b7b437a7b2512cd19faa025c4f24933d6cda041129b69508"}
Sep 10 16:19:06.546928 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:06.546902    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"
Sep 10 16:19:06.569335 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:06.569267    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj" podStartSLOduration=1.5692325249999999 podStartE2EDuration="1.569232525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:19:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:19:06.567567256 +0000 UTC m=+1030.979653462" watchObservedRunningTime="2026-09-10 16:19:06.569232525 +0000 UTC m=+1030.981318751"
Sep 10 16:19:07.490500 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:07.490470    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"
Sep 10 16:19:09.504898 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:09.504856    2562 patch_prober.go:28] interesting pod/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 16:19:09.505360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:09.504927    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 16:19:11.582343 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:11.582297    2562 generic.go:356] "Generic (PLEG): container finished" podID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerID="409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f" exitCode=0
Sep 10 16:19:11.582927 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:11.582479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" event={"ID":"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0","Type":"ContainerDied","Data":"409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f"}
Sep 10 16:19:11.583251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:11.583075    2562 scope.go:117] "RemoveContainer" containerID="409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f"
Sep 10 16:19:11.585053 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:11.585011    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:11.585154 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:11.585105    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:11.585154 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:11.585149    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:12.592747 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:12.592366    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" event={"ID":"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0","Type":"ContainerStarted","Data":"b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347"}
Sep 10 16:19:12.895581 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:12.895468    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:19:12.895962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:12.895930    2562 patch_prober.go:28] interesting pod/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 10 16:19:12.896070 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:12.895994    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 10 16:19:13.896175 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:13.896138    2562 patch_prober.go:28] interesting pod/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 10 16:19:13.896908 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:13.896854    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 10 16:19:14.895825 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:14.895784    2562 patch_prober.go:28] interesting pod/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 10 16:19:14.896130 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:14.896097    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 10 16:19:15.896685 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:15.896644    2562 patch_prober.go:28] interesting pod/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 10 16:19:15.897300 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:15.897264    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 10 16:19:16.896183 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:16.896135    2562 patch_prober.go:28] interesting pod/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 10 16:19:16.896402 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:16.896205    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 10 16:19:17.557325 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:17.556913    2562 patch_prober.go:28] interesting pod/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 16:19:17.557325 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:17.556988    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 16:19:17.898636 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:17.896464    2562 patch_prober.go:28] interesting pod/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 10 16:19:17.898636 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:17.896521    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 10 16:19:18.563931 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:18.563876    2562 patch_prober.go:28] interesting pod/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 16:19:18.564410 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:18.563963    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 16:19:18.564482 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:18.564463    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"
Sep 10 16:19:18.901023 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:18.900928    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:19:18.901520 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:18.901490    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:19:18.902318 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:18.902297    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:19:19.012656 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.012358    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"]
Sep 10 16:19:19.019390 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.019360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.023570 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.023541    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e22c72-openshift-default-dockercfg-spj5w\""
Sep 10 16:19:19.037902 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.037857    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"]
Sep 10 16:19:19.084225 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.084190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-credential-socket\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.084419 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.084239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-data\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.084419 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.084288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-token\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.084419 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.084380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-podinfo\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.084419 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.084409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h62lm\" (UniqueName: \"kubernetes.io/projected/e9a67318-10bd-4607-a2b1-be4627ac01e4-kube-api-access-h62lm\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.084594 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.084469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-workload-socket\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.084594 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.084542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9a67318-10bd-4607-a2b1-be4627ac01e4-istiod-ca-cert\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.084594 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.084580    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-envoy\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.084687 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.084614    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-workload-certs\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.185412 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.185297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-data\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.185412 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.185386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-token\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.185651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.185445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-podinfo\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.185651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.185472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h62lm\" (UniqueName: \"kubernetes.io/projected/e9a67318-10bd-4607-a2b1-be4627ac01e4-kube-api-access-h62lm\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.185651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.185530    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-workload-socket\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.185651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.185586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9a67318-10bd-4607-a2b1-be4627ac01e4-istiod-ca-cert\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.185651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.185612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-envoy\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.185944 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.185654    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-workload-certs\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.185944 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.185744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-credential-socket\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.185944 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.185770    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-data\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.186402 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.186382    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-workload-certs\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.186517 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.186495    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-workload-socket\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.186589 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.186483    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9a67318-10bd-4607-a2b1-be4627ac01e4-istiod-ca-cert\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.186776 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.186751    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-credential-socket\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.188991 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.188937    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-envoy\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.189104 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.189066    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-podinfo\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.195220 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.195174    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-token\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.195826 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.195807    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h62lm\" (UniqueName: \"kubernetes.io/projected/e9a67318-10bd-4607-a2b1-be4627ac01e4-kube-api-access-h62lm\") pod \"e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") " pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.336452 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.336409    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:19.684305 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.684179    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"]
Sep 10 16:19:19.692877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.691703    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:19.692877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.691816    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:19.692877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:19.691861    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:20.650873 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.650837    2562 generic.go:356] "Generic (PLEG): container finished" podID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerID="7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d" exitCode=0
Sep 10 16:19:20.651085 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.650906    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" event={"ID":"d16c92f2-6c07-4825-8c35-a075a21363dc","Type":"ContainerDied","Data":"7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d"}
Sep 10 16:19:20.651439 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.651416    2562 scope.go:117] "RemoveContainer" containerID="7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d"
Sep 10 16:19:20.652640 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.652607    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:20.652764 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.652693    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:20.652764 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.652696    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" event={"ID":"e9a67318-10bd-4607-a2b1-be4627ac01e4","Type":"ContainerStarted","Data":"52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540"}
Sep 10 16:19:20.652889 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.652764    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:20.652889 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.652786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" event={"ID":"e9a67318-10bd-4607-a2b1-be4627ac01e4","Type":"ContainerStarted","Data":"84189427fa6a1cb64a4f74685f8b08d084245de9148fd6084c824b4fae037044"}
Sep 10 16:19:20.654392 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.654373    2562 generic.go:356] "Generic (PLEG): container finished" podID="00cb1278-23ae-4587-94ce-d53409e9489a" containerID="532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5" exitCode=0
Sep 10 16:19:20.654492 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.654417    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" event={"ID":"00cb1278-23ae-4587-94ce-d53409e9489a","Type":"ContainerDied","Data":"532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5"}
Sep 10 16:19:20.654894 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.654875    2562 scope.go:117] "RemoveContainer" containerID="532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5"
Sep 10 16:19:20.657307 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.656804    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:20.657307 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.656886    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:20.657307 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.656935    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:20.749349 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:20.749295    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" podStartSLOduration=2.7492784930000003 podStartE2EDuration="2.749278493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:19:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:19:20.745563301 +0000 UTC m=+1045.157649533" watchObservedRunningTime="2026-09-10 16:19:20.749278493 +0000 UTC m=+1045.161364701"
Sep 10 16:19:21.336814 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:21.336755    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:21.346340 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:21.346309    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:21.670065 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:21.669959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" event={"ID":"00cb1278-23ae-4587-94ce-d53409e9489a","Type":"ContainerStarted","Data":"bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02"}
Sep 10 16:19:21.673755 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:21.673705    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" event={"ID":"d16c92f2-6c07-4825-8c35-a075a21363dc","Type":"ContainerStarted","Data":"4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3"}
Sep 10 16:19:21.677497 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:21.677471    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:21.686233 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:21.686201    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:22.082424 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:22.082385    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:22.082936 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:22.082515    2562 patch_prober.go:28] interesting pod/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 10 16:19:22.082936 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:22.082580    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 10 16:19:22.444472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:22.444366    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:19:22.444655 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:22.444506    2562 patch_prober.go:28] interesting pod/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 16:19:22.444655 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:22.444567    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 16:19:23.082118 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:23.082074    2562 patch_prober.go:28] interesting pod/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 10 16:19:23.082428 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:23.082392    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 10 16:19:23.444898 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:23.444342    2562 patch_prober.go:28] interesting pod/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 16:19:23.444898 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:23.444419    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 16:19:24.082917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:24.082872    2562 patch_prober.go:28] interesting pod/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 10 16:19:24.083125 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:24.082941    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 10 16:19:24.444370 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:24.444279    2562 patch_prober.go:28] interesting pod/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 16:19:24.444632 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:24.444603    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 16:19:25.082224 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:25.082176    2562 patch_prober.go:28] interesting pod/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 10 16:19:25.082718 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:25.082250    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 10 16:19:25.444425 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:25.444325    2562 patch_prober.go:28] interesting pod/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 16:19:25.444668 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:25.444638    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 16:19:26.082220 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:26.082177    2562 patch_prober.go:28] interesting pod/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 10 16:19:26.082761 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:26.082250    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 10 16:19:26.444082 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:26.443990    2562 patch_prober.go:28] interesting pod/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 16:19:26.444343 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:26.444311    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 16:19:27.091162 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:27.091128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:27.092195 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:27.092135    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:27.093196 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:27.093178    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:27.448380 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:27.448304    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:19:27.448614 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:27.448586    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:19:27.449378 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:27.449359    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:19:33.523641 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:33.523605    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb"]
Sep 10 16:19:33.526471 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:33.526453    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb"
Sep 10 16:19:33.530817 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:33.530797    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l2dj2\""
Sep 10 16:19:33.536366 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:33.536338    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb"]
Sep 10 16:19:33.657398 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:33.657338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2846d6-eebb-4de0-b951-f05cbbd3f39f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb\" (UID: \"7c2846d6-eebb-4de0-b951-f05cbbd3f39f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb"
Sep 10 16:19:33.758215 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:33.758174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2846d6-eebb-4de0-b951-f05cbbd3f39f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb\" (UID: \"7c2846d6-eebb-4de0-b951-f05cbbd3f39f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb"
Sep 10 16:19:33.759135 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:33.759099    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2846d6-eebb-4de0-b951-f05cbbd3f39f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb\" (UID: \"7c2846d6-eebb-4de0-b951-f05cbbd3f39f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb"
Sep 10 16:19:33.838261 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:33.838173    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb"
Sep 10 16:19:34.132965 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:19:34.132928    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2846d6_eebb_4de0_b951_f05cbbd3f39f.slice/crio-9098cb2f80fee01a7170f219e0cc1f83c4afa391e5359d83bf04e033547954f4 WatchSource:0}: Error finding container 9098cb2f80fee01a7170f219e0cc1f83c4afa391e5359d83bf04e033547954f4: Status 404 returned error can't find the container with id 9098cb2f80fee01a7170f219e0cc1f83c4afa391e5359d83bf04e033547954f4
Sep 10 16:19:34.133800 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:34.133778    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb"]
Sep 10 16:19:34.772581 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:34.772536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb" event={"ID":"7c2846d6-eebb-4de0-b951-f05cbbd3f39f","Type":"ContainerStarted","Data":"9098cb2f80fee01a7170f219e0cc1f83c4afa391e5359d83bf04e033547954f4"}
Sep 10 16:19:36.785525 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:36.785484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb" event={"ID":"7c2846d6-eebb-4de0-b951-f05cbbd3f39f","Type":"ContainerStarted","Data":"39b15be8025f33d47ded4b36a9a6ef89caf5ebb581b8e6c38e1c929294bb9851"}
Sep 10 16:19:36.809861 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:36.809808    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb" podStartSLOduration=1.6682024100000001 podStartE2EDuration="3.809789698s" totalImagesPullingTime="2.141587288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:19:36.807613806 +0000 UTC m=+1061.219700015" watchObservedRunningTime="2026-09-10 16:19:36.809789698 +0000 UTC m=+1061.221875906"
Sep 10 16:19:37.061227 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:37.061197    2562 patch_prober.go:28] interesting pod/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": read tcp 10.134.0.2:40178->10.134.0.43:15021: read: connection reset by peer" start-of-body=
Sep 10 16:19:37.061418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:37.061259    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": read tcp 10.134.0.2:40178->10.134.0.43:15021: read: connection reset by peer"
Sep 10 16:19:37.792458 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:37.792420    2562 generic.go:356] "Generic (PLEG): container finished" podID="7c2846d6-eebb-4de0-b951-f05cbbd3f39f" containerID="39b15be8025f33d47ded4b36a9a6ef89caf5ebb581b8e6c38e1c929294bb9851" exitCode=0
Sep 10 16:19:37.792898 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:37.792492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb" event={"ID":"7c2846d6-eebb-4de0-b951-f05cbbd3f39f","Type":"ContainerDied","Data":"39b15be8025f33d47ded4b36a9a6ef89caf5ebb581b8e6c38e1c929294bb9851"}
Sep 10 16:19:37.794275 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:37.794250    2562 generic.go:356] "Generic (PLEG): container finished" podID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerID="52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540" exitCode=0
Sep 10 16:19:37.794405 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:37.794293    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" event={"ID":"e9a67318-10bd-4607-a2b1-be4627ac01e4","Type":"ContainerDied","Data":"52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540"}
Sep 10 16:19:37.794759 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:37.794742    2562 scope.go:117] "RemoveContainer" containerID="52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540"
Sep 10 16:19:37.795877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:37.795845    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:37.795959 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:37.795916    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:37.795959 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:37.795951    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:38.804235 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:38.804198    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" event={"ID":"e9a67318-10bd-4607-a2b1-be4627ac01e4","Type":"ContainerStarted","Data":"3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57"}
Sep 10 16:19:39.003744 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:39.003698    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb"
Sep 10 16:19:39.117832 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:39.117347    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2846d6-eebb-4de0-b951-f05cbbd3f39f-maas-api-service-ca\") pod \"7c2846d6-eebb-4de0-b951-f05cbbd3f39f\" (UID: \"7c2846d6-eebb-4de0-b951-f05cbbd3f39f\") "
Sep 10 16:19:39.117976 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:39.117947    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c2846d6-eebb-4de0-b951-f05cbbd3f39f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7c2846d6-eebb-4de0-b951-f05cbbd3f39f" (UID: "7c2846d6-eebb-4de0-b951-f05cbbd3f39f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:19:39.218369 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:39.218325    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2846d6-eebb-4de0-b951-f05cbbd3f39f-maas-api-service-ca\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:39.336945 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:39.336905    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:39.337156 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:39.337132    2562 patch_prober.go:28] interesting pod/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 10 16:19:39.337205 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:39.337183    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 10 16:19:39.811117 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:39.811086    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb"
Sep 10 16:19:39.811499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:39.811132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb" event={"ID":"7c2846d6-eebb-4de0-b951-f05cbbd3f39f","Type":"ContainerDied","Data":"9098cb2f80fee01a7170f219e0cc1f83c4afa391e5359d83bf04e033547954f4"}
Sep 10 16:19:39.811499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:39.811182    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9098cb2f80fee01a7170f219e0cc1f83c4afa391e5359d83bf04e033547954f4"
Sep 10 16:19:40.337077 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:40.337037    2562 patch_prober.go:28] interesting pod/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 10 16:19:40.337239 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:40.337096    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 10 16:19:41.337195 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:41.337153    2562 patch_prober.go:28] interesting pod/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 10 16:19:41.337611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:41.337218    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 10 16:19:42.337754 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:42.337695    2562 patch_prober.go:28] interesting pod/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 10 16:19:42.338128 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:42.337781    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 10 16:19:43.337382 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:43.337340    2562 patch_prober.go:28] interesting pod/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 10 16:19:43.337563 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:43.337407    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 10 16:19:44.340914 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:44.340881    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:44.341306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:44.341141    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:44.341947 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:44.341924    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:19:45.906996 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:45.906957    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"]
Sep 10 16:19:45.907499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:45.907273    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj" podUID="a92f9c61-0461-4af3-8605-fc14be0c90d7" containerName="payload-processing" containerID="cri-o://435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6" gracePeriod=30
Sep 10 16:19:46.182477 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.182449    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"
Sep 10 16:19:46.279515 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.279484    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb"]
Sep 10 16:19:46.284116 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.284092    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fefaa7ab-tr6wb"]
Sep 10 16:19:46.293262 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.293242    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a92f9c61-0461-4af3-8605-fc14be0c90d7-plugins-config-volume\") pod \"a92f9c61-0461-4af3-8605-fc14be0c90d7\" (UID: \"a92f9c61-0461-4af3-8605-fc14be0c90d7\") "
Sep 10 16:19:46.293362 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.293315    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnjnl\" (UniqueName: \"kubernetes.io/projected/a92f9c61-0461-4af3-8605-fc14be0c90d7-kube-api-access-dnjnl\") pod \"a92f9c61-0461-4af3-8605-fc14be0c90d7\" (UID: \"a92f9c61-0461-4af3-8605-fc14be0c90d7\") "
Sep 10 16:19:46.293643 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.293621    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a92f9c61-0461-4af3-8605-fc14be0c90d7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a92f9c61-0461-4af3-8605-fc14be0c90d7" (UID: "a92f9c61-0461-4af3-8605-fc14be0c90d7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:19:46.295522 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.295498    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a92f9c61-0461-4af3-8605-fc14be0c90d7-kube-api-access-dnjnl" (OuterVolumeSpecName: "kube-api-access-dnjnl") pod "a92f9c61-0461-4af3-8605-fc14be0c90d7" (UID: "a92f9c61-0461-4af3-8605-fc14be0c90d7"). InnerVolumeSpecName "kube-api-access-dnjnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:19:46.394885 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.394847    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a92f9c61-0461-4af3-8605-fc14be0c90d7-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:46.394885 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.394883    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnjnl\" (UniqueName: \"kubernetes.io/projected/a92f9c61-0461-4af3-8605-fc14be0c90d7-kube-api-access-dnjnl\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:46.414225 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.414136    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"]
Sep 10 16:19:46.414436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.414410    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy" containerID="cri-o://4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3" gracePeriod=30
Sep 10 16:19:46.854986 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.854950    2562 generic.go:356] "Generic (PLEG): container finished" podID="a92f9c61-0461-4af3-8605-fc14be0c90d7" containerID="435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6" exitCode=0
Sep 10 16:19:46.855155 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.854997    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"
Sep 10 16:19:46.855155 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.855043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj" event={"ID":"a92f9c61-0461-4af3-8605-fc14be0c90d7","Type":"ContainerDied","Data":"435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6"}
Sep 10 16:19:46.855155 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.855096    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj" event={"ID":"a92f9c61-0461-4af3-8605-fc14be0c90d7","Type":"ContainerDied","Data":"361f470662c53342b7b437a7b2512cd19faa025c4f24933d6cda041129b69508"}
Sep 10 16:19:46.855155 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.855120    2562 scope.go:117] "RemoveContainer" containerID="435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6"
Sep 10 16:19:46.865285 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.865262    2562 scope.go:117] "RemoveContainer" containerID="435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6"
Sep 10 16:19:46.865574 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:19:46.865552    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6\": container with ID starting with 435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6 not found: ID does not exist" containerID="435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6"
Sep 10 16:19:46.865635 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.865588    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6"} err="failed to get container status \"435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6\": rpc error: code = NotFound desc = could not find container \"435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6\": container with ID starting with 435da3c590746221b0ba33db0328e45a43b2cf0b30873f4b1607a373d4ea42e6 not found: ID does not exist"
Sep 10 16:19:46.892286 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.892255    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"]
Sep 10 16:19:46.899472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:46.899442    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fefaa7ab-d5cf75977-5s5vj"]
Sep 10 16:19:47.484889 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.484851    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"]
Sep 10 16:19:47.485531 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.485514    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a92f9c61-0461-4af3-8605-fc14be0c90d7" containerName="payload-processing"
Sep 10 16:19:47.485589 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.485534    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a92f9c61-0461-4af3-8605-fc14be0c90d7" containerName="payload-processing"
Sep 10 16:19:47.485589 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.485551    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c2846d6-eebb-4de0-b951-f05cbbd3f39f" containerName="revoke-keys"
Sep 10 16:19:47.485589 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.485560    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c2846d6-eebb-4de0-b951-f05cbbd3f39f" containerName="revoke-keys"
Sep 10 16:19:47.485705 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.485662    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a92f9c61-0461-4af3-8605-fc14be0c90d7" containerName="payload-processing"
Sep 10 16:19:47.485705 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.485689    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c2846d6-eebb-4de0-b951-f05cbbd3f39f" containerName="revoke-keys"
Sep 10 16:19:47.489186 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.489165    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.492463 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.492439    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b7764c7d-gw-openshift-default-dockercfg-qsqn6\""
Sep 10 16:19:47.507668 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.507641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-workload-socket\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.507824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.507693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9cm6\" (UniqueName: \"kubernetes.io/projected/10b283da-f00a-44e4-876b-55ba780bb30b-kube-api-access-x9cm6\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.507824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.507756    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10b283da-f00a-44e4-876b-55ba780bb30b-istio-token\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.507824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.507812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-istio-envoy\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.507999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.507835    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"]
Sep 10 16:19:47.507999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.507851    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-istio-data\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.507999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.507883    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-workload-certs\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.507999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.507965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10b283da-f00a-44e4-876b-55ba780bb30b-istiod-ca-cert\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.508205 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.508156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10b283da-f00a-44e4-876b-55ba780bb30b-istio-podinfo\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.508259 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.508197    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-credential-socket\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.610994 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.609837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-workload-socket\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.610994 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.609924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9cm6\" (UniqueName: \"kubernetes.io/projected/10b283da-f00a-44e4-876b-55ba780bb30b-kube-api-access-x9cm6\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.610994 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.609978    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10b283da-f00a-44e4-876b-55ba780bb30b-istio-token\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.610994 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.610020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-istio-envoy\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.610994 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.610080    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-istio-data\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.610994 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.610127    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-workload-certs\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.610994 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.610166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10b283da-f00a-44e4-876b-55ba780bb30b-istiod-ca-cert\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.610994 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.610338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10b283da-f00a-44e4-876b-55ba780bb30b-istio-podinfo\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.610994 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.610392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-credential-socket\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.610994 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.610958    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-credential-socket\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.611654 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.611393    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-workload-socket\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.613145 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.612845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-istio-data\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.613982 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.613954    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-workload-certs\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.614094 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.614014    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10b283da-f00a-44e4-876b-55ba780bb30b-istiod-ca-cert\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.621828 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.621789    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-istio-envoy\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.622614 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.622588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10b283da-f00a-44e4-876b-55ba780bb30b-istio-podinfo\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.626819 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.626796    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10b283da-f00a-44e4-876b-55ba780bb30b-istio-token\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.627008 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.626926    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9cm6\" (UniqueName: \"kubernetes.io/projected/10b283da-f00a-44e4-876b-55ba780bb30b-kube-api-access-x9cm6\") pod \"e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") " pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:47.802145 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:47.802102    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:48.071474 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:48.071370    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c2846d6-eebb-4de0-b951-f05cbbd3f39f" path="/var/lib/kubelet/pods/7c2846d6-eebb-4de0-b951-f05cbbd3f39f/volumes"
Sep 10 16:19:48.071773 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:48.071760    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a92f9c61-0461-4af3-8605-fc14be0c90d7" path="/var/lib/kubelet/pods/a92f9c61-0461-4af3-8605-fc14be0c90d7/volumes"
Sep 10 16:19:48.084678 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:48.084655    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"]
Sep 10 16:19:48.086652 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:19:48.086621    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b283da_f00a_44e4_876b_55ba780bb30b.slice/crio-151db7d2a331f99c9018cdf68987a42f0bda92c18c4bcc88ba6a5cd6772585b2 WatchSource:0}: Error finding container 151db7d2a331f99c9018cdf68987a42f0bda92c18c4bcc88ba6a5cd6772585b2: Status 404 returned error can't find the container with id 151db7d2a331f99c9018cdf68987a42f0bda92c18c4bcc88ba6a5cd6772585b2
Sep 10 16:19:48.088892 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:48.088857    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:48.088986 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:48.088935    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:48.089047 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:48.088981    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:19:48.873338 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:48.873301    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" event={"ID":"10b283da-f00a-44e4-876b-55ba780bb30b","Type":"ContainerStarted","Data":"0b92adae2033543eadd21be94a89670369b3a37694a3e49131ec1d1903b26451"}
Sep 10 16:19:48.873770 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:48.873386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" event={"ID":"10b283da-f00a-44e4-876b-55ba780bb30b","Type":"ContainerStarted","Data":"151db7d2a331f99c9018cdf68987a42f0bda92c18c4bcc88ba6a5cd6772585b2"}
Sep 10 16:19:48.904255 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:48.904195    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" podStartSLOduration=1.904178603 podStartE2EDuration="1.904178603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:19:48.90176324 +0000 UTC m=+1073.313849476" watchObservedRunningTime="2026-09-10 16:19:48.904178603 +0000 UTC m=+1073.316264897"
Sep 10 16:19:49.803251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:49.803210    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:49.808232 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:49.808206    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:49.879594 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:49.879564    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:49.880456 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:49.880435    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:19:51.408664 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.408628    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"]
Sep 10 16:19:51.411468 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.411449    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"
Sep 10 16:19:51.414952 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.414924    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-b7764c7d-dockercfg-b7wzm\""
Sep 10 16:19:51.415083 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.414958    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-b7764c7d\""
Sep 10 16:19:51.425769 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.425716    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"]
Sep 10 16:19:51.472750 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.472537    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1de52e-7e79-4b62-a64a-583ec42570c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f\" (UID: \"dd1de52e-7e79-4b62-a64a-583ec42570c7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"
Sep 10 16:19:51.472750 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.472606    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st9gp\" (UniqueName: \"kubernetes.io/projected/dd1de52e-7e79-4b62-a64a-583ec42570c7-kube-api-access-st9gp\") pod \"payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f\" (UID: \"dd1de52e-7e79-4b62-a64a-583ec42570c7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"
Sep 10 16:19:51.574455 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.574418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1de52e-7e79-4b62-a64a-583ec42570c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f\" (UID: \"dd1de52e-7e79-4b62-a64a-583ec42570c7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"
Sep 10 16:19:51.574646 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.574471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st9gp\" (UniqueName: \"kubernetes.io/projected/dd1de52e-7e79-4b62-a64a-583ec42570c7-kube-api-access-st9gp\") pod \"payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f\" (UID: \"dd1de52e-7e79-4b62-a64a-583ec42570c7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"
Sep 10 16:19:51.575249 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.575222    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1de52e-7e79-4b62-a64a-583ec42570c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f\" (UID: \"dd1de52e-7e79-4b62-a64a-583ec42570c7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"
Sep 10 16:19:51.585250 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.585193    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st9gp\" (UniqueName: \"kubernetes.io/projected/dd1de52e-7e79-4b62-a64a-583ec42570c7-kube-api-access-st9gp\") pod \"payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f\" (UID: \"dd1de52e-7e79-4b62-a64a-583ec42570c7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"
Sep 10 16:19:51.677449 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.677418    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:51.722888 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.722857    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"
Sep 10 16:19:51.776176 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.776155    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-data\") pod \"d16c92f2-6c07-4825-8c35-a075a21363dc\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") "
Sep 10 16:19:51.776264 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.776235    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-token\") pod \"d16c92f2-6c07-4825-8c35-a075a21363dc\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") "
Sep 10 16:19:51.776325 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.776279    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-podinfo\") pod \"d16c92f2-6c07-4825-8c35-a075a21363dc\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") "
Sep 10 16:19:51.776381 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.776320    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmp5b\" (UniqueName: \"kubernetes.io/projected/d16c92f2-6c07-4825-8c35-a075a21363dc-kube-api-access-rmp5b\") pod \"d16c92f2-6c07-4825-8c35-a075a21363dc\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") "
Sep 10 16:19:51.776381 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.776369    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d16c92f2-6c07-4825-8c35-a075a21363dc-istiod-ca-cert\") pod \"d16c92f2-6c07-4825-8c35-a075a21363dc\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") "
Sep 10 16:19:51.776479 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.776397    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-workload-certs\") pod \"d16c92f2-6c07-4825-8c35-a075a21363dc\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") "
Sep 10 16:19:51.776479 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.776458    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-envoy\") pod \"d16c92f2-6c07-4825-8c35-a075a21363dc\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") "
Sep 10 16:19:51.776570 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.776532    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-workload-socket\") pod \"d16c92f2-6c07-4825-8c35-a075a21363dc\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") "
Sep 10 16:19:51.777187 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.776851    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d16c92f2-6c07-4825-8c35-a075a21363dc" (UID: "d16c92f2-6c07-4825-8c35-a075a21363dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:19:51.777187 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.776902    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "d16c92f2-6c07-4825-8c35-a075a21363dc" (UID: "d16c92f2-6c07-4825-8c35-a075a21363dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:19:51.777187 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.777122    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d16c92f2-6c07-4825-8c35-a075a21363dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d16c92f2-6c07-4825-8c35-a075a21363dc" (UID: "d16c92f2-6c07-4825-8c35-a075a21363dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:19:51.777187 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.777167    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-credential-socket\") pod \"d16c92f2-6c07-4825-8c35-a075a21363dc\" (UID: \"d16c92f2-6c07-4825-8c35-a075a21363dc\") "
Sep 10 16:19:51.777824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.777529    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d16c92f2-6c07-4825-8c35-a075a21363dc" (UID: "d16c92f2-6c07-4825-8c35-a075a21363dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:19:51.777824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.777588    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d16c92f2-6c07-4825-8c35-a075a21363dc" (UID: "d16c92f2-6c07-4825-8c35-a075a21363dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:19:51.777824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.777767    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-data\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:51.777824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.777793    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d16c92f2-6c07-4825-8c35-a075a21363dc-istiod-ca-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:51.777824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.777807    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-workload-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:51.777824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.777821    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-workload-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:51.778100 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.777834    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-credential-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:51.780683 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.779545    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d16c92f2-6c07-4825-8c35-a075a21363dc" (UID: "d16c92f2-6c07-4825-8c35-a075a21363dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:19:51.786928 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.786868    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d16c92f2-6c07-4825-8c35-a075a21363dc" (UID: "d16c92f2-6c07-4825-8c35-a075a21363dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:19:51.786928 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.786882    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "d16c92f2-6c07-4825-8c35-a075a21363dc" (UID: "d16c92f2-6c07-4825-8c35-a075a21363dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:19:51.788442 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.788286    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d16c92f2-6c07-4825-8c35-a075a21363dc-kube-api-access-rmp5b" (OuterVolumeSpecName: "kube-api-access-rmp5b") pod "d16c92f2-6c07-4825-8c35-a075a21363dc" (UID: "d16c92f2-6c07-4825-8c35-a075a21363dc"). InnerVolumeSpecName "kube-api-access-rmp5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:19:51.879078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.879032    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-token\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:51.879078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.879069    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-podinfo\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:51.879078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.879084    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmp5b\" (UniqueName: \"kubernetes.io/projected/d16c92f2-6c07-4825-8c35-a075a21363dc-kube-api-access-rmp5b\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:51.879318 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.879097    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d16c92f2-6c07-4825-8c35-a075a21363dc-istio-envoy\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:19:51.894367 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.894326    2562 generic.go:356] "Generic (PLEG): container finished" podID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerID="4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3" exitCode=0
Sep 10 16:19:51.894532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.894373    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" event={"ID":"d16c92f2-6c07-4825-8c35-a075a21363dc","Type":"ContainerDied","Data":"4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3"}
Sep 10 16:19:51.894532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.894431    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z" event={"ID":"d16c92f2-6c07-4825-8c35-a075a21363dc","Type":"ContainerDied","Data":"d4433e4f41280ac9f990ffd20b53d3c377fef09e7c782c70f467ae20f8b7d649"}
Sep 10 16:19:51.894532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.894384    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"
Sep 10 16:19:51.894532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.894454    2562 scope.go:117] "RemoveContainer" containerID="4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3"
Sep 10 16:19:51.903553 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.903527    2562 scope.go:117] "RemoveContainer" containerID="7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d"
Sep 10 16:19:51.912182 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.912163    2562 scope.go:117] "RemoveContainer" containerID="4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3"
Sep 10 16:19:51.912481 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:19:51.912464    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3\": container with ID starting with 4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3 not found: ID does not exist" containerID="4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3"
Sep 10 16:19:51.912532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.912489    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3"} err="failed to get container status \"4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3\": rpc error: code = NotFound desc = could not find container \"4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3\": container with ID starting with 4ae6e8b449a251fd4825184406dfaa1f83f6cf0148226c08d869634eaa4b0af3 not found: ID does not exist"
Sep 10 16:19:51.912532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.912504    2562 scope.go:117] "RemoveContainer" containerID="7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d"
Sep 10 16:19:51.912760 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:19:51.912712    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d\": container with ID starting with 7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d not found: ID does not exist" containerID="7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d"
Sep 10 16:19:51.912831 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.912764    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d"} err="failed to get container status \"7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d\": rpc error: code = NotFound desc = could not find container \"7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d\": container with ID starting with 7376da823298cd483f0ebd909298cfeac501cb7f9e876c2b6d15f7a9f0810e3d not found: ID does not exist"
Sep 10 16:19:51.921778 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.921751    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"]
Sep 10 16:19:51.926258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.926234    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fefaa7ab-openshift-default-5b47bb44f8-jsb7z"]
Sep 10 16:19:51.999899 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:51.999875    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"]
Sep 10 16:19:52.001595 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:19:52.001571    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1de52e_7e79_4b62_a64a_583ec42570c7.slice/crio-914dea2eb47e471a3e314658df7eba266adcdaaed4cf3a0bebda5c2852d59314 WatchSource:0}: Error finding container 914dea2eb47e471a3e314658df7eba266adcdaaed4cf3a0bebda5c2852d59314: Status 404 returned error can't find the container with id 914dea2eb47e471a3e314658df7eba266adcdaaed4cf3a0bebda5c2852d59314
Sep 10 16:19:52.079016 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:52.078982    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" path="/var/lib/kubelet/pods/d16c92f2-6c07-4825-8c35-a075a21363dc/volumes"
Sep 10 16:19:52.901820 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:52.901785    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f" event={"ID":"dd1de52e-7e79-4b62-a64a-583ec42570c7","Type":"ContainerStarted","Data":"1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e"}
Sep 10 16:19:52.902209 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:52.901839    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f" event={"ID":"dd1de52e-7e79-4b62-a64a-583ec42570c7","Type":"ContainerStarted","Data":"914dea2eb47e471a3e314658df7eba266adcdaaed4cf3a0bebda5c2852d59314"}
Sep 10 16:19:52.902209 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:52.901891    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"
Sep 10 16:19:52.922320 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:19:52.922266    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f" podStartSLOduration=1.9222483129999999 podStartE2EDuration="1.922248313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:19:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:19:52.920386435 +0000 UTC m=+1077.332472650" watchObservedRunningTime="2026-09-10 16:19:52.922248313 +0000 UTC m=+1077.334334522"
Sep 10 16:20:03.909941 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:03.909905    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"
Sep 10 16:20:04.743961 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.743918    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"]
Sep 10 16:20:04.744649 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.744622    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy"
Sep 10 16:20:04.744649 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.744650    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy"
Sep 10 16:20:04.744851 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.744672    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy"
Sep 10 16:20:04.744851 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.744681    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy"
Sep 10 16:20:04.744851 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.744825    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy"
Sep 10 16:20:04.744851 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.744840    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d16c92f2-6c07-4825-8c35-a075a21363dc" containerName="istio-proxy"
Sep 10 16:20:04.748380 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.748358    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:04.751442 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.751416    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-aa8ef0bd-kserve-self-signed-certs\""
Sep 10 16:20:04.759395 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.759369    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"]
Sep 10 16:20:04.919693 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.919653    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-model-cache\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:04.921194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.919712    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-tmp-dir\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:04.921194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.919856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a17b75a-d75b-4347-818d-2b4ff815f758-tls-certs\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:04.921194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.919945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-home\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:04.921194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.919978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccstb\" (UniqueName: \"kubernetes.io/projected/2a17b75a-d75b-4347-818d-2b4ff815f758-kube-api-access-ccstb\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:04.921194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.920041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-dshm\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:04.961200 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.961168    2562 patch_prober.go:28] interesting pod/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": read tcp 10.134.0.2:53770->10.134.0.45:15021: read: connection reset by peer" start-of-body=
Sep 10 16:20:04.961326 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:04.961263    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": read tcp 10.134.0.2:53770->10.134.0.45:15021: read: connection reset by peer"
Sep 10 16:20:05.021010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.020926    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a17b75a-d75b-4347-818d-2b4ff815f758-tls-certs\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.021010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.021007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-home\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.021242 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.021036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccstb\" (UniqueName: \"kubernetes.io/projected/2a17b75a-d75b-4347-818d-2b4ff815f758-kube-api-access-ccstb\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.021242 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.021069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-dshm\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.021242 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.021097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-model-cache\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.021242 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.021134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-tmp-dir\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.021516 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.021491    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-home\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.021575 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.021547    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-model-cache\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.021612 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.021568    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-tmp-dir\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.023341 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.023321    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-dshm\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.023523 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.023505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a17b75a-d75b-4347-818d-2b4ff815f758-tls-certs\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.032312 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.032286    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccstb\" (UniqueName: \"kubernetes.io/projected/2a17b75a-d75b-4347-818d-2b4ff815f758-kube-api-access-ccstb\") pod \"e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") " pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.059393 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.059354    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:05.335758 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.335710    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"]
Sep 10 16:20:05.338191 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:20:05.338162    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a17b75a_d75b_4347_818d_2b4ff815f758.slice/crio-587998e1561d44304bf42f1d08bd207abf33240520b118064e4e51610632492e WatchSource:0}: Error finding container 587998e1561d44304bf42f1d08bd207abf33240520b118064e4e51610632492e: Status 404 returned error can't find the container with id 587998e1561d44304bf42f1d08bd207abf33240520b118064e4e51610632492e
Sep 10 16:20:05.985399 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.985367    2562 generic.go:356] "Generic (PLEG): container finished" podID="10b283da-f00a-44e4-876b-55ba780bb30b" containerID="0b92adae2033543eadd21be94a89670369b3a37694a3e49131ec1d1903b26451" exitCode=0
Sep 10 16:20:05.985824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.985442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" event={"ID":"10b283da-f00a-44e4-876b-55ba780bb30b","Type":"ContainerDied","Data":"0b92adae2033543eadd21be94a89670369b3a37694a3e49131ec1d1903b26451"}
Sep 10 16:20:05.985989 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.985973    2562 scope.go:117] "RemoveContainer" containerID="0b92adae2033543eadd21be94a89670369b3a37694a3e49131ec1d1903b26451"
Sep 10 16:20:05.987153 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.987121    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq" event={"ID":"2a17b75a-d75b-4347-818d-2b4ff815f758","Type":"ContainerStarted","Data":"1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45"}
Sep 10 16:20:05.987246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.987166    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq" event={"ID":"2a17b75a-d75b-4347-818d-2b4ff815f758","Type":"ContainerStarted","Data":"587998e1561d44304bf42f1d08bd207abf33240520b118064e4e51610632492e"}
Sep 10 16:20:05.987246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.987124    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:20:05.987320 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.987256    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:20:05.987355 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:05.987327    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:20:06.039328 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:06.039265    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq" podStartSLOduration=2.039242815 podStartE2EDuration="2.039242815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:20:06.03606488 +0000 UTC m=+1090.448151089" watchObservedRunningTime="2026-09-10 16:20:06.039242815 +0000 UTC m=+1090.451329025"
Sep 10 16:20:06.995153 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:06.995113    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" event={"ID":"10b283da-f00a-44e4-876b-55ba780bb30b","Type":"ContainerStarted","Data":"171ad93366ebe97897fe8a7c4f175b173c0c024d02ea1a5d476ea3abc8574874"}
Sep 10 16:20:07.803299 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:07.803251    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:20:07.803554 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:07.803527    2562 patch_prober.go:28] interesting pod/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 10 16:20:07.803642 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:07.803589    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 10 16:20:08.803238 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:08.803201    2562 patch_prober.go:28] interesting pod/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 10 16:20:08.803629 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:08.803260    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 10 16:20:09.803443 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:09.803396    2562 patch_prober.go:28] interesting pod/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 10 16:20:09.803977 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:09.803463    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 10 16:20:10.802858 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:10.802818    2562 patch_prober.go:28] interesting pod/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 10 16:20:10.803076 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:10.802886    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 10 16:20:11.803319 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:11.803278    2562 patch_prober.go:28] interesting pod/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 10 16:20:11.803719 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:11.803350    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 10 16:20:12.806925 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:12.806885    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:20:12.807314 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:12.807177    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:20:12.807923 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:12.807906    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:20:15.059719 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:15.059666    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:15.060120 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:15.059760    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:15.072392 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:15.072361    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:15.358593 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:15.356454    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d"]
Sep 10 16:20:15.363965 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:15.363935    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d"
Sep 10 16:20:15.368281 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:15.368249    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l2dj2\""
Sep 10 16:20:15.370068 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:15.370033    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d"]
Sep 10 16:20:15.439102 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:15.439061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d\" (UID: \"2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d"
Sep 10 16:20:15.540672 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:15.540634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d\" (UID: \"2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d"
Sep 10 16:20:15.541354 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:15.541332    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d\" (UID: \"2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d"
Sep 10 16:20:15.678377 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:15.678278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d"
Sep 10 16:20:15.950384 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:15.950359    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d"]
Sep 10 16:20:15.952408 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:20:15.952381    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9ecbd0_b3f6_4d1d_8a44_06c08d8a2d5c.slice/crio-4862b0656a253d3388ea6fc5b223b8a1e83942bac8a2283594798761929feaa5 WatchSource:0}: Error finding container 4862b0656a253d3388ea6fc5b223b8a1e83942bac8a2283594798761929feaa5: Status 404 returned error can't find the container with id 4862b0656a253d3388ea6fc5b223b8a1e83942bac8a2283594798761929feaa5
Sep 10 16:20:16.049579 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:16.049544    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d" event={"ID":"2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c","Type":"ContainerStarted","Data":"4862b0656a253d3388ea6fc5b223b8a1e83942bac8a2283594798761929feaa5"}
Sep 10 16:20:16.060763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:16.060738    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:17.056576 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:17.056540    2562 generic.go:356] "Generic (PLEG): container finished" podID="2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c" containerID="6946c907893234afa3ebf081f82c67d2b6735218355327b942bf9600a610fb6f" exitCode=0
Sep 10 16:20:17.056769 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:17.056628    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d" event={"ID":"2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c","Type":"ContainerDied","Data":"6946c907893234afa3ebf081f82c67d2b6735218355327b942bf9600a610fb6f"}
Sep 10 16:20:18.194392 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:18.194364    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d"
Sep 10 16:20:18.271295 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:18.271261    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c-maas-api-service-ca\") pod \"2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c\" (UID: \"2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c\") "
Sep 10 16:20:18.271584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:18.271561    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c" (UID: "2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:20:18.373018 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:18.372927    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c-maas-api-service-ca\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:19.068900 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:19.068864    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d" event={"ID":"2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c","Type":"ContainerDied","Data":"4862b0656a253d3388ea6fc5b223b8a1e83942bac8a2283594798761929feaa5"}
Sep 10 16:20:19.068900 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:19.068896    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d"
Sep 10 16:20:19.069118 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:19.068913    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4862b0656a253d3388ea6fc5b223b8a1e83942bac8a2283594798761929feaa5"
Sep 10 16:20:21.654390 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:21.654356    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"]
Sep 10 16:20:21.654898 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:21.654590    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f" podUID="dd1de52e-7e79-4b62-a64a-583ec42570c7" containerName="payload-pre-processing" containerID="cri-o://1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e" gracePeriod=30
Sep 10 16:20:21.859545 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:21.859480    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d"]
Sep 10 16:20:21.863320 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:21.863286    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b7764c7d-vm74d"]
Sep 10 16:20:21.921444 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:21.921370    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"
Sep 10 16:20:21.985221 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:21.985186    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"]
Sep 10 16:20:21.986266 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:21.985700    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy" containerID="cri-o://171ad93366ebe97897fe8a7c4f175b173c0c024d02ea1a5d476ea3abc8574874" gracePeriod=30
Sep 10 16:20:22.009937 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.009899    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st9gp\" (UniqueName: \"kubernetes.io/projected/dd1de52e-7e79-4b62-a64a-583ec42570c7-kube-api-access-st9gp\") pod \"dd1de52e-7e79-4b62-a64a-583ec42570c7\" (UID: \"dd1de52e-7e79-4b62-a64a-583ec42570c7\") "
Sep 10 16:20:22.010110 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.009995    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1de52e-7e79-4b62-a64a-583ec42570c7-plugins-config-volume\") pod \"dd1de52e-7e79-4b62-a64a-583ec42570c7\" (UID: \"dd1de52e-7e79-4b62-a64a-583ec42570c7\") "
Sep 10 16:20:22.010364 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.010332    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd1de52e-7e79-4b62-a64a-583ec42570c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dd1de52e-7e79-4b62-a64a-583ec42570c7" (UID: "dd1de52e-7e79-4b62-a64a-583ec42570c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:20:22.010478 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.010411    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1de52e-7e79-4b62-a64a-583ec42570c7-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:22.012015 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.011986    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd1de52e-7e79-4b62-a64a-583ec42570c7-kube-api-access-st9gp" (OuterVolumeSpecName: "kube-api-access-st9gp") pod "dd1de52e-7e79-4b62-a64a-583ec42570c7" (UID: "dd1de52e-7e79-4b62-a64a-583ec42570c7"). InnerVolumeSpecName "kube-api-access-st9gp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:20:22.072314 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.072275    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c" path="/var/lib/kubelet/pods/2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c/volumes"
Sep 10 16:20:22.090221 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.090139    2562 generic.go:356] "Generic (PLEG): container finished" podID="dd1de52e-7e79-4b62-a64a-583ec42570c7" containerID="1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e" exitCode=0
Sep 10 16:20:22.090432 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.090337    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f" event={"ID":"dd1de52e-7e79-4b62-a64a-583ec42570c7","Type":"ContainerDied","Data":"1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e"}
Sep 10 16:20:22.090432 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.090391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f" event={"ID":"dd1de52e-7e79-4b62-a64a-583ec42570c7","Type":"ContainerDied","Data":"914dea2eb47e471a3e314658df7eba266adcdaaed4cf3a0bebda5c2852d59314"}
Sep 10 16:20:22.090432 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.090422    2562 scope.go:117] "RemoveContainer" containerID="1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e"
Sep 10 16:20:22.090602 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.090591    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"
Sep 10 16:20:22.108537 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.108216    2562 scope.go:117] "RemoveContainer" containerID="1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e"
Sep 10 16:20:22.108905 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:20:22.108792    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e\": container with ID starting with 1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e not found: ID does not exist" containerID="1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e"
Sep 10 16:20:22.108905 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.108841    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e"} err="failed to get container status \"1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e\": rpc error: code = NotFound desc = could not find container \"1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e\": container with ID starting with 1e096eb13a0845e7f0531b2eb5a992eede86487116c15c1c56792e970d53bd2e not found: ID does not exist"
Sep 10 16:20:22.112621 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.112578    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st9gp\" (UniqueName: \"kubernetes.io/projected/dd1de52e-7e79-4b62-a64a-583ec42570c7-kube-api-access-st9gp\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:22.116173 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.116091    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"]
Sep 10 16:20:22.119047 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.119023    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b7764c7d-595d9bf76b-62n7f"]
Sep 10 16:20:22.803163 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.803115    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"]
Sep 10 16:20:22.804251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.804220    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c" containerName="revoke-keys"
Sep 10 16:20:22.804251 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.804254    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c" containerName="revoke-keys"
Sep 10 16:20:22.804447 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.804300    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd1de52e-7e79-4b62-a64a-583ec42570c7" containerName="payload-pre-processing"
Sep 10 16:20:22.804447 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.804310    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd1de52e-7e79-4b62-a64a-583ec42570c7" containerName="payload-pre-processing"
Sep 10 16:20:22.804549 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.804537    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd1de52e-7e79-4b62-a64a-583ec42570c7" containerName="payload-pre-processing"
Sep 10 16:20:22.804600 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.804561    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e9ecbd0-b3f6-4d1d-8a44-06c08d8a2d5c" containerName="revoke-keys"
Sep 10 16:20:22.812034 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.812002    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:22.815474 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.815450    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7a64cdb4-openshift-default-dockercfg-xhr5b\""
Sep 10 16:20:22.848915 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.848877    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"]
Sep 10 16:20:22.922709 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.922665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-credential-socket\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:22.922709 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.922711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-token\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:22.922979 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.922754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-data\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:22.922979 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.922857    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-envoy\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:22.922979 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.922918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzs97\" (UniqueName: \"kubernetes.io/projected/bcfb904c-14be-47ff-9000-50795cc3aad0-kube-api-access-tzs97\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:22.923146 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.923014    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-podinfo\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:22.923146 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.923119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-workload-socket\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:22.923256 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.923150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcfb904c-14be-47ff-9000-50795cc3aad0-istiod-ca-cert\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:22.923256 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:22.923181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-workload-certs\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.024611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.024575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-credential-socket\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.024611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.024612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-token\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.024854 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.024634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-data\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.024854 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.024683    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-envoy\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.024854 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.024759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzs97\" (UniqueName: \"kubernetes.io/projected/bcfb904c-14be-47ff-9000-50795cc3aad0-kube-api-access-tzs97\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.024854 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.024825    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-podinfo\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.025080 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.024906    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-workload-socket\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.025080 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.024930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcfb904c-14be-47ff-9000-50795cc3aad0-istiod-ca-cert\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.025080 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.024957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-workload-certs\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.025080 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.025062    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-data\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.025308 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.025167    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-credential-socket\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.025430 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.025405    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-workload-socket\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.025483 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.025457    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-workload-certs\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.025643 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.025626    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcfb904c-14be-47ff-9000-50795cc3aad0-istiod-ca-cert\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.027371 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.027339    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-podinfo\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.027497 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.027443    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-envoy\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.043167 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.043140    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-token\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.052350 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.052322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzs97\" (UniqueName: \"kubernetes.io/projected/bcfb904c-14be-47ff-9000-50795cc3aad0-kube-api-access-tzs97\") pod \"e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") " pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.122956 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.122856    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:23.406083 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.406057    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"]
Sep 10 16:20:23.407638 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:20:23.407614    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfb904c_14be_47ff_9000_50795cc3aad0.slice/crio-1bbf0c12972a181fdac912f5d659062f25a12c6fe3b13c9169b86600bf4369c4 WatchSource:0}: Error finding container 1bbf0c12972a181fdac912f5d659062f25a12c6fe3b13c9169b86600bf4369c4: Status 404 returned error can't find the container with id 1bbf0c12972a181fdac912f5d659062f25a12c6fe3b13c9169b86600bf4369c4
Sep 10 16:20:23.409816 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.409781    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:20:23.409893 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.409847    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:20:23.409893 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:23.409875    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:20:24.071518 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:24.071482    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd1de52e-7e79-4b62-a64a-583ec42570c7" path="/var/lib/kubelet/pods/dd1de52e-7e79-4b62-a64a-583ec42570c7/volumes"
Sep 10 16:20:24.106651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:24.106619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" event={"ID":"bcfb904c-14be-47ff-9000-50795cc3aad0","Type":"ContainerStarted","Data":"6b0f58e1340ef78335094e1ef2b52d862ccf74fd93b70f60306963eca5c28519"}
Sep 10 16:20:24.106851 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:24.106670    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" event={"ID":"bcfb904c-14be-47ff-9000-50795cc3aad0","Type":"ContainerStarted","Data":"1bbf0c12972a181fdac912f5d659062f25a12c6fe3b13c9169b86600bf4369c4"}
Sep 10 16:20:24.123615 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:24.123591    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:24.128239 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:24.128215    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:24.130883 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:24.130840    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" podStartSLOduration=2.130800831 podStartE2EDuration="2.130800831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:20:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:20:24.130140949 +0000 UTC m=+1108.542227179" watchObservedRunningTime="2026-09-10 16:20:24.130800831 +0000 UTC m=+1108.542887037"
Sep 10 16:20:25.111787 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:25.111756    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:25.112951 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:25.112926    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:27.124370 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.124335    2562 generic.go:356] "Generic (PLEG): container finished" podID="10b283da-f00a-44e4-876b-55ba780bb30b" containerID="171ad93366ebe97897fe8a7c4f175b173c0c024d02ea1a5d476ea3abc8574874" exitCode=0
Sep 10 16:20:27.124880 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.124404    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" event={"ID":"10b283da-f00a-44e4-876b-55ba780bb30b","Type":"ContainerDied","Data":"171ad93366ebe97897fe8a7c4f175b173c0c024d02ea1a5d476ea3abc8574874"}
Sep 10 16:20:27.124880 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.124466    2562 scope.go:117] "RemoveContainer" containerID="0b92adae2033543eadd21be94a89670369b3a37694a3e49131ec1d1903b26451"
Sep 10 16:20:27.238678 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.238651    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:20:27.352747 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.352644    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"]
Sep 10 16:20:27.353152 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.353137    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy"
Sep 10 16:20:27.353205 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.353154    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy"
Sep 10 16:20:27.353205 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.353167    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy"
Sep 10 16:20:27.353205 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.353172    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy"
Sep 10 16:20:27.353325 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.353245    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy"
Sep 10 16:20:27.355449 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.355433    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"
Sep 10 16:20:27.358190 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.358171    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-7a64cdb4\""
Sep 10 16:20:27.370347 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.370314    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"]
Sep 10 16:20:27.375642 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.375616    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-workload-certs\") pod \"10b283da-f00a-44e4-876b-55ba780bb30b\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") "
Sep 10 16:20:27.375794 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.375680    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-workload-socket\") pod \"10b283da-f00a-44e4-876b-55ba780bb30b\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") "
Sep 10 16:20:27.375794 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.375758    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9cm6\" (UniqueName: \"kubernetes.io/projected/10b283da-f00a-44e4-876b-55ba780bb30b-kube-api-access-x9cm6\") pod \"10b283da-f00a-44e4-876b-55ba780bb30b\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") "
Sep 10 16:20:27.375794 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.375794    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-istio-data\") pod \"10b283da-f00a-44e4-876b-55ba780bb30b\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") "
Sep 10 16:20:27.375976 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.375811    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10b283da-f00a-44e4-876b-55ba780bb30b-istio-podinfo\") pod \"10b283da-f00a-44e4-876b-55ba780bb30b\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") "
Sep 10 16:20:27.375976 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.375840    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10b283da-f00a-44e4-876b-55ba780bb30b-istio-token\") pod \"10b283da-f00a-44e4-876b-55ba780bb30b\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") "
Sep 10 16:20:27.375976 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.375863    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-credential-socket\") pod \"10b283da-f00a-44e4-876b-55ba780bb30b\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") "
Sep 10 16:20:27.375976 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.375901    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10b283da-f00a-44e4-876b-55ba780bb30b-istiod-ca-cert\") pod \"10b283da-f00a-44e4-876b-55ba780bb30b\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") "
Sep 10 16:20:27.375976 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.375917    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10b283da-f00a-44e4-876b-55ba780bb30b" (UID: "10b283da-f00a-44e4-876b-55ba780bb30b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:20:27.375976 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.375957    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-istio-envoy\") pod \"10b283da-f00a-44e4-876b-55ba780bb30b\" (UID: \"10b283da-f00a-44e4-876b-55ba780bb30b\") "
Sep 10 16:20:27.376280 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.376036    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10b283da-f00a-44e4-876b-55ba780bb30b" (UID: "10b283da-f00a-44e4-876b-55ba780bb30b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:20:27.376280 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.376106    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-istio-data" (OuterVolumeSpecName: "istio-data") pod "10b283da-f00a-44e4-876b-55ba780bb30b" (UID: "10b283da-f00a-44e4-876b-55ba780bb30b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:20:27.376280 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.376268    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10b283da-f00a-44e4-876b-55ba780bb30b" (UID: "10b283da-f00a-44e4-876b-55ba780bb30b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:20:27.376552 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.376469    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-workload-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:27.376552 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.376492    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-workload-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:27.376552 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.376503    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-istio-data\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:27.376552 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.376515    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-credential-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:27.376803 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.376583    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10b283da-f00a-44e4-876b-55ba780bb30b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10b283da-f00a-44e4-876b-55ba780bb30b" (UID: "10b283da-f00a-44e4-876b-55ba780bb30b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:20:27.379523 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.379360    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10b283da-f00a-44e4-876b-55ba780bb30b-istio-token" (OuterVolumeSpecName: "istio-token") pod "10b283da-f00a-44e4-876b-55ba780bb30b" (UID: "10b283da-f00a-44e4-876b-55ba780bb30b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:20:27.379954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.379925    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10b283da-f00a-44e4-876b-55ba780bb30b" (UID: "10b283da-f00a-44e4-876b-55ba780bb30b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:20:27.380276 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.380244    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10b283da-f00a-44e4-876b-55ba780bb30b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10b283da-f00a-44e4-876b-55ba780bb30b" (UID: "10b283da-f00a-44e4-876b-55ba780bb30b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:20:27.380568 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.380543    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10b283da-f00a-44e4-876b-55ba780bb30b-kube-api-access-x9cm6" (OuterVolumeSpecName: "kube-api-access-x9cm6") pod "10b283da-f00a-44e4-876b-55ba780bb30b" (UID: "10b283da-f00a-44e4-876b-55ba780bb30b"). InnerVolumeSpecName "kube-api-access-x9cm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:20:27.387549 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.387524    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"]
Sep 10 16:20:27.388309 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.388292    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" containerName="istio-proxy"
Sep 10 16:20:27.391188 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.391165    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"
Sep 10 16:20:27.393880 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.393860    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-7a64cdb4-dockercfg-lc4m4\""
Sep 10 16:20:27.399756 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.399717    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"]
Sep 10 16:20:27.478427 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.478312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mrlq\" (UniqueName: \"kubernetes.io/projected/8032b5e5-261c-40a9-8b0c-1a4bd384238e-kube-api-access-4mrlq\") pod \"payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2\" (UID: \"8032b5e5-261c-40a9-8b0c-1a4bd384238e\") " pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"
Sep 10 16:20:27.478427 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.478381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9klrg\" (UniqueName: \"kubernetes.io/projected/1e059746-ec11-4d11-b2a5-b458cc2f11fa-kube-api-access-9klrg\") pod \"payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c\" (UID: \"1e059746-ec11-4d11-b2a5-b458cc2f11fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"
Sep 10 16:20:27.478697 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.478494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8032b5e5-261c-40a9-8b0c-1a4bd384238e-plugins-config-volume\") pod \"payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2\" (UID: \"8032b5e5-261c-40a9-8b0c-1a4bd384238e\") " pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"
Sep 10 16:20:27.478697 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.478553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e059746-ec11-4d11-b2a5-b458cc2f11fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c\" (UID: \"1e059746-ec11-4d11-b2a5-b458cc2f11fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"
Sep 10 16:20:27.478697 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.478640    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10b283da-f00a-44e4-876b-55ba780bb30b-istio-token\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:27.478697 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.478656    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10b283da-f00a-44e4-876b-55ba780bb30b-istiod-ca-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:27.478697 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.478669    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10b283da-f00a-44e4-876b-55ba780bb30b-istio-envoy\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:27.478697 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.478683    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9cm6\" (UniqueName: \"kubernetes.io/projected/10b283da-f00a-44e4-876b-55ba780bb30b-kube-api-access-x9cm6\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:27.479075 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.478708    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10b283da-f00a-44e4-876b-55ba780bb30b-istio-podinfo\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:27.579266 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.579234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8032b5e5-261c-40a9-8b0c-1a4bd384238e-plugins-config-volume\") pod \"payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2\" (UID: \"8032b5e5-261c-40a9-8b0c-1a4bd384238e\") " pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"
Sep 10 16:20:27.579266 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.579269    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e059746-ec11-4d11-b2a5-b458cc2f11fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c\" (UID: \"1e059746-ec11-4d11-b2a5-b458cc2f11fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"
Sep 10 16:20:27.579453 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.579441    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mrlq\" (UniqueName: \"kubernetes.io/projected/8032b5e5-261c-40a9-8b0c-1a4bd384238e-kube-api-access-4mrlq\") pod \"payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2\" (UID: \"8032b5e5-261c-40a9-8b0c-1a4bd384238e\") " pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"
Sep 10 16:20:27.579503 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.579472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9klrg\" (UniqueName: \"kubernetes.io/projected/1e059746-ec11-4d11-b2a5-b458cc2f11fa-kube-api-access-9klrg\") pod \"payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c\" (UID: \"1e059746-ec11-4d11-b2a5-b458cc2f11fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"
Sep 10 16:20:27.580066 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.580045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e059746-ec11-4d11-b2a5-b458cc2f11fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c\" (UID: \"1e059746-ec11-4d11-b2a5-b458cc2f11fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"
Sep 10 16:20:27.580119 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.580044    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8032b5e5-261c-40a9-8b0c-1a4bd384238e-plugins-config-volume\") pod \"payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2\" (UID: \"8032b5e5-261c-40a9-8b0c-1a4bd384238e\") " pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"
Sep 10 16:20:27.590000 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.589972    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mrlq\" (UniqueName: \"kubernetes.io/projected/8032b5e5-261c-40a9-8b0c-1a4bd384238e-kube-api-access-4mrlq\") pod \"payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2\" (UID: \"8032b5e5-261c-40a9-8b0c-1a4bd384238e\") " pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"
Sep 10 16:20:27.590115 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.590000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9klrg\" (UniqueName: \"kubernetes.io/projected/1e059746-ec11-4d11-b2a5-b458cc2f11fa-kube-api-access-9klrg\") pod \"payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c\" (UID: \"1e059746-ec11-4d11-b2a5-b458cc2f11fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"
Sep 10 16:20:27.668894 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.668804    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"
Sep 10 16:20:27.712044 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.712007    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"
Sep 10 16:20:27.966394 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:27.966369    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"]
Sep 10 16:20:27.967450 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:20:27.967427    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e059746_ec11_4d11_b2a5_b458cc2f11fa.slice/crio-2e67a57b948d17694921d635207ab2b44bab9e03e3250b6285f9984205babf3a WatchSource:0}: Error finding container 2e67a57b948d17694921d635207ab2b44bab9e03e3250b6285f9984205babf3a: Status 404 returned error can't find the container with id 2e67a57b948d17694921d635207ab2b44bab9e03e3250b6285f9984205babf3a
Sep 10 16:20:28.031749 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.031709    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"]
Sep 10 16:20:28.034142 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:20:28.034112    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8032b5e5_261c_40a9_8b0c_1a4bd384238e.slice/crio-e8cc483c543f20e8c0d2f428ae1af61c84bfd821cb098abba294c46485481188 WatchSource:0}: Error finding container e8cc483c543f20e8c0d2f428ae1af61c84bfd821cb098abba294c46485481188: Status 404 returned error can't find the container with id e8cc483c543f20e8c0d2f428ae1af61c84bfd821cb098abba294c46485481188
Sep 10 16:20:28.133553 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.133512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2" event={"ID":"8032b5e5-261c-40a9-8b0c-1a4bd384238e","Type":"ContainerStarted","Data":"ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f"}
Sep 10 16:20:28.134016 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.133590    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"
Sep 10 16:20:28.134016 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.133618    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2" event={"ID":"8032b5e5-261c-40a9-8b0c-1a4bd384238e","Type":"ContainerStarted","Data":"e8cc483c543f20e8c0d2f428ae1af61c84bfd821cb098abba294c46485481188"}
Sep 10 16:20:28.135651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.135617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c" event={"ID":"1e059746-ec11-4d11-b2a5-b458cc2f11fa","Type":"ContainerStarted","Data":"3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731"}
Sep 10 16:20:28.135797 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.135671    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c" event={"ID":"1e059746-ec11-4d11-b2a5-b458cc2f11fa","Type":"ContainerStarted","Data":"2e67a57b948d17694921d635207ab2b44bab9e03e3250b6285f9984205babf3a"}
Sep 10 16:20:28.135797 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.135704    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"
Sep 10 16:20:28.137227 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.137205    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf" event={"ID":"10b283da-f00a-44e4-876b-55ba780bb30b","Type":"ContainerDied","Data":"151db7d2a331f99c9018cdf68987a42f0bda92c18c4bcc88ba6a5cd6772585b2"}
Sep 10 16:20:28.137227 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.137217    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"
Sep 10 16:20:28.137574 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.137249    2562 scope.go:117] "RemoveContainer" containerID="171ad93366ebe97897fe8a7c4f175b173c0c024d02ea1a5d476ea3abc8574874"
Sep 10 16:20:28.187531 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.187474    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2" podStartSLOduration=1.18745429 podStartE2EDuration="1.18745429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:20:28.186607165 +0000 UTC m=+1112.598693376" watchObservedRunningTime="2026-09-10 16:20:28.18745429 +0000 UTC m=+1112.599540500"
Sep 10 16:20:28.217253 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.217135    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c" podStartSLOduration=1.217115237 podStartE2EDuration="1.217115237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:20:28.21308602 +0000 UTC m=+1112.625172228" watchObservedRunningTime="2026-09-10 16:20:28.217115237 +0000 UTC m=+1112.629201451"
Sep 10 16:20:28.233607 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.233570    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"]
Sep 10 16:20:28.239265 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:28.239236    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b7764c7d-gw-openshift-default-658449c4b4-jlvxf"]
Sep 10 16:20:30.072629 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:30.072579    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10b283da-f00a-44e4-876b-55ba780bb30b" path="/var/lib/kubelet/pods/10b283da-f00a-44e4-876b-55ba780bb30b/volumes"
Sep 10 16:20:39.147874 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:39.147830    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"
Sep 10 16:20:39.148742 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:39.148690    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"
Sep 10 16:20:42.990749 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:42.990698    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"]
Sep 10 16:20:44.125252 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.125218    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6"]
Sep 10 16:20:44.128032 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.128012    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6"
Sep 10 16:20:44.131186 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.131165    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l2dj2\""
Sep 10 16:20:44.138951 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.138923    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6"]
Sep 10 16:20:44.173983 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.173943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/406ae9bd-1faf-4648-9a8f-e9bc0b09208a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-1596ac-drnz6\" (UID: \"406ae9bd-1faf-4648-9a8f-e9bc0b09208a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6"
Sep 10 16:20:44.240258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.240223    2562 generic.go:356] "Generic (PLEG): container finished" podID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerID="6b0f58e1340ef78335094e1ef2b52d862ccf74fd93b70f60306963eca5c28519" exitCode=0
Sep 10 16:20:44.240422 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.240297    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" event={"ID":"bcfb904c-14be-47ff-9000-50795cc3aad0","Type":"ContainerDied","Data":"6b0f58e1340ef78335094e1ef2b52d862ccf74fd93b70f60306963eca5c28519"}
Sep 10 16:20:44.240768 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.240742    2562 scope.go:117] "RemoveContainer" containerID="6b0f58e1340ef78335094e1ef2b52d862ccf74fd93b70f60306963eca5c28519"
Sep 10 16:20:44.241876 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.241841    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:20:44.241976 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.241930    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:20:44.242036 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.241996    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:20:44.275360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.274961    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/406ae9bd-1faf-4648-9a8f-e9bc0b09208a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-1596ac-drnz6\" (UID: \"406ae9bd-1faf-4648-9a8f-e9bc0b09208a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6"
Sep 10 16:20:44.276157 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.276130    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/406ae9bd-1faf-4648-9a8f-e9bc0b09208a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-1596ac-drnz6\" (UID: \"406ae9bd-1faf-4648-9a8f-e9bc0b09208a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6"
Sep 10 16:20:44.439597 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.439500    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6"
Sep 10 16:20:44.725647 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:44.725616    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6"]
Sep 10 16:20:44.727250 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:20:44.727218    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406ae9bd_1faf_4648_9a8f_e9bc0b09208a.slice/crio-77d8a7f51fe3a3a3ea80c5643af1143a1fef8d978d3a7bc3bf48b9c4ebfe904e WatchSource:0}: Error finding container 77d8a7f51fe3a3a3ea80c5643af1143a1fef8d978d3a7bc3bf48b9c4ebfe904e: Status 404 returned error can't find the container with id 77d8a7f51fe3a3a3ea80c5643af1143a1fef8d978d3a7bc3bf48b9c4ebfe904e
Sep 10 16:20:45.248662 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:45.248626    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6" event={"ID":"406ae9bd-1faf-4648-9a8f-e9bc0b09208a","Type":"ContainerStarted","Data":"1e16098671cf84d35b28f31b1bf83180a51a5a5febbc18a14abfcd8eb2ec98ab"}
Sep 10 16:20:45.249132 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:45.248683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6" event={"ID":"406ae9bd-1faf-4648-9a8f-e9bc0b09208a","Type":"ContainerStarted","Data":"77d8a7f51fe3a3a3ea80c5643af1143a1fef8d978d3a7bc3bf48b9c4ebfe904e"}
Sep 10 16:20:45.250685 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:45.250660    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" event={"ID":"bcfb904c-14be-47ff-9000-50795cc3aad0","Type":"ContainerStarted","Data":"9ea923f5411fea4589e5eb47875a66ca9deb5581cb865beab415c2708ac2eee8"}
Sep 10 16:20:45.288368 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:45.288314    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6" podStartSLOduration=1.288297534 podStartE2EDuration="1.288297534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:20:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:20:45.282067056 +0000 UTC m=+1129.694153266" watchObservedRunningTime="2026-09-10 16:20:45.288297534 +0000 UTC m=+1129.700383742"
Sep 10 16:20:46.123749 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:46.123689    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:46.124020 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:46.123996    2562 patch_prober.go:28] interesting pod/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 16:20:46.124085 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:46.124063    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 16:20:46.261661 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:46.261622    2562 generic.go:356] "Generic (PLEG): container finished" podID="406ae9bd-1faf-4648-9a8f-e9bc0b09208a" containerID="1e16098671cf84d35b28f31b1bf83180a51a5a5febbc18a14abfcd8eb2ec98ab" exitCode=0
Sep 10 16:20:46.262301 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:46.261719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6" event={"ID":"406ae9bd-1faf-4648-9a8f-e9bc0b09208a","Type":"ContainerDied","Data":"1e16098671cf84d35b28f31b1bf83180a51a5a5febbc18a14abfcd8eb2ec98ab"}
Sep 10 16:20:47.123498 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:47.123462    2562 patch_prober.go:28] interesting pod/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 16:20:47.123786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:47.123518    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 16:20:47.429452 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:47.429428    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6"
Sep 10 16:20:47.511445 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:47.511413    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/406ae9bd-1faf-4648-9a8f-e9bc0b09208a-maas-api-service-ca\") pod \"406ae9bd-1faf-4648-9a8f-e9bc0b09208a\" (UID: \"406ae9bd-1faf-4648-9a8f-e9bc0b09208a\") "
Sep 10 16:20:47.511791 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:47.511767    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/406ae9bd-1faf-4648-9a8f-e9bc0b09208a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "406ae9bd-1faf-4648-9a8f-e9bc0b09208a" (UID: "406ae9bd-1faf-4648-9a8f-e9bc0b09208a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:20:47.612578 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:47.612535    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/406ae9bd-1faf-4648-9a8f-e9bc0b09208a-maas-api-service-ca\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:48.123762 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:48.123704    2562 patch_prober.go:28] interesting pod/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 16:20:48.123947 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:48.123801    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 16:20:48.277786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:48.277756    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6"
Sep 10 16:20:48.277968 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:48.277755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6" event={"ID":"406ae9bd-1faf-4648-9a8f-e9bc0b09208a","Type":"ContainerDied","Data":"77d8a7f51fe3a3a3ea80c5643af1143a1fef8d978d3a7bc3bf48b9c4ebfe904e"}
Sep 10 16:20:48.277968 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:48.277906    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77d8a7f51fe3a3a3ea80c5643af1143a1fef8d978d3a7bc3bf48b9c4ebfe904e"
Sep 10 16:20:49.123507 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:49.123468    2562 patch_prober.go:28] interesting pod/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 16:20:49.123914 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:49.123535    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 16:20:50.123908 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:50.123872    2562 patch_prober.go:28] interesting pod/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 16:20:50.124311 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:50.123936    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 16:20:51.127630 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:51.127596    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:51.128055 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:51.127971    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:51.128591 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:51.128569    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:20:55.251793 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:55.251748    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6"]
Sep 10 16:20:55.255109 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:55.255083    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1596ac-drnz6"]
Sep 10 16:20:56.072784 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:56.072718    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="406ae9bd-1faf-4648-9a8f-e9bc0b09208a" path="/var/lib/kubelet/pods/406ae9bd-1faf-4648-9a8f-e9bc0b09208a/volumes"
Sep 10 16:20:58.011623 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.011573    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq" podUID="2a17b75a-d75b-4347-818d-2b4ff815f758" containerName="main" containerID="cri-o://1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45" gracePeriod=45
Sep 10 16:20:58.250124 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.250094    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:58.331905 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.331824    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a17b75a-d75b-4347-818d-2b4ff815f758-tls-certs\") pod \"2a17b75a-d75b-4347-818d-2b4ff815f758\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") "
Sep 10 16:20:58.331905 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.331894    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-tmp-dir\") pod \"2a17b75a-d75b-4347-818d-2b4ff815f758\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") "
Sep 10 16:20:58.332114 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.331937    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-dshm\") pod \"2a17b75a-d75b-4347-818d-2b4ff815f758\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") "
Sep 10 16:20:58.332114 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.331961    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-model-cache\") pod \"2a17b75a-d75b-4347-818d-2b4ff815f758\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") "
Sep 10 16:20:58.332114 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.332022    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccstb\" (UniqueName: \"kubernetes.io/projected/2a17b75a-d75b-4347-818d-2b4ff815f758-kube-api-access-ccstb\") pod \"2a17b75a-d75b-4347-818d-2b4ff815f758\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") "
Sep 10 16:20:58.332114 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.332057    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-home\") pod \"2a17b75a-d75b-4347-818d-2b4ff815f758\" (UID: \"2a17b75a-d75b-4347-818d-2b4ff815f758\") "
Sep 10 16:20:58.332333 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.332149    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a17b75a-d75b-4347-818d-2b4ff815f758" (UID: "2a17b75a-d75b-4347-818d-2b4ff815f758"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:20:58.332453 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.332427    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-tmp-dir\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:58.332574 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.332412    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-home" (OuterVolumeSpecName: "home") pod "2a17b75a-d75b-4347-818d-2b4ff815f758" (UID: "2a17b75a-d75b-4347-818d-2b4ff815f758"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:20:58.332639 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.332566    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a17b75a-d75b-4347-818d-2b4ff815f758" (UID: "2a17b75a-d75b-4347-818d-2b4ff815f758"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:20:58.334154 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.334127    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-dshm" (OuterVolumeSpecName: "dshm") pod "2a17b75a-d75b-4347-818d-2b4ff815f758" (UID: "2a17b75a-d75b-4347-818d-2b4ff815f758"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:20:58.334448 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.334427    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a17b75a-d75b-4347-818d-2b4ff815f758-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a17b75a-d75b-4347-818d-2b4ff815f758" (UID: "2a17b75a-d75b-4347-818d-2b4ff815f758"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 16:20:58.334526 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.334445    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a17b75a-d75b-4347-818d-2b4ff815f758-kube-api-access-ccstb" (OuterVolumeSpecName: "kube-api-access-ccstb") pod "2a17b75a-d75b-4347-818d-2b4ff815f758" (UID: "2a17b75a-d75b-4347-818d-2b4ff815f758"). InnerVolumeSpecName "kube-api-access-ccstb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:20:58.346144 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.346117    2562 generic.go:356] "Generic (PLEG): container finished" podID="2a17b75a-d75b-4347-818d-2b4ff815f758" containerID="1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45" exitCode=0
Sep 10 16:20:58.346237 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.346155    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"
Sep 10 16:20:58.346237 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.346196    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq" event={"ID":"2a17b75a-d75b-4347-818d-2b4ff815f758","Type":"ContainerDied","Data":"1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45"}
Sep 10 16:20:58.346237 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.346236    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq" event={"ID":"2a17b75a-d75b-4347-818d-2b4ff815f758","Type":"ContainerDied","Data":"587998e1561d44304bf42f1d08bd207abf33240520b118064e4e51610632492e"}
Sep 10 16:20:58.346357 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.346253    2562 scope.go:117] "RemoveContainer" containerID="1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45"
Sep 10 16:20:58.355984 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.355968    2562 scope.go:117] "RemoveContainer" containerID="1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45"
Sep 10 16:20:58.356245 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:20:58.356226    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45\": container with ID starting with 1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45 not found: ID does not exist" containerID="1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45"
Sep 10 16:20:58.356294 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.356250    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45"} err="failed to get container status \"1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45\": rpc error: code = NotFound desc = could not find container \"1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45\": container with ID starting with 1a4be7ee68f8c8522124b5d37d6d4c266270b28ed0314b0b0fb9a47177638c45 not found: ID does not exist"
Sep 10 16:20:58.378970 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.378936    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"]
Sep 10 16:20:58.380890 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.380867    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-aa8ef0bd-kserve-6f558dffcb-h29cq"]
Sep 10 16:20:58.433685 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.433639    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-dshm\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:58.433685 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.433683    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-model-cache\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:58.433685 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.433693    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccstb\" (UniqueName: \"kubernetes.io/projected/2a17b75a-d75b-4347-818d-2b4ff815f758-kube-api-access-ccstb\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:58.433914 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.433704    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a17b75a-d75b-4347-818d-2b4ff815f758-home\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:20:58.433914 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:20:58.433714    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a17b75a-d75b-4347-818d-2b4ff815f758-tls-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:00.071077 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:00.071042    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a17b75a-d75b-4347-818d-2b4ff815f758" path="/var/lib/kubelet/pods/2a17b75a-d75b-4347-818d-2b4ff815f758/volumes"
Sep 10 16:21:03.427466 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:03.427434    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"]
Sep 10 16:21:03.427869 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:03.427665    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy" containerID="cri-o://bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02" gracePeriod=30
Sep 10 16:21:07.684434 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:07.684398    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"]
Sep 10 16:21:07.684920 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:07.684662    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2" podUID="8032b5e5-261c-40a9-8b0c-1a4bd384238e" containerName="payload-processing" containerID="cri-o://ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f" gracePeriod=30
Sep 10 16:21:07.700145 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:07.700117    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"]
Sep 10 16:21:07.700345 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:07.700307    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c" podUID="1e059746-ec11-4d11-b2a5-b458cc2f11fa" containerName="payload-pre-processing" containerID="cri-o://3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731" gracePeriod=30
Sep 10 16:21:08.017637 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.017613    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"
Sep 10 16:21:08.020387 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.020365    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"
Sep 10 16:21:08.144380 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.144349    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e059746-ec11-4d11-b2a5-b458cc2f11fa-plugins-config-volume\") pod \"1e059746-ec11-4d11-b2a5-b458cc2f11fa\" (UID: \"1e059746-ec11-4d11-b2a5-b458cc2f11fa\") "
Sep 10 16:21:08.144580 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.144388    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8032b5e5-261c-40a9-8b0c-1a4bd384238e-plugins-config-volume\") pod \"8032b5e5-261c-40a9-8b0c-1a4bd384238e\" (UID: \"8032b5e5-261c-40a9-8b0c-1a4bd384238e\") "
Sep 10 16:21:08.144580 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.144411    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9klrg\" (UniqueName: \"kubernetes.io/projected/1e059746-ec11-4d11-b2a5-b458cc2f11fa-kube-api-access-9klrg\") pod \"1e059746-ec11-4d11-b2a5-b458cc2f11fa\" (UID: \"1e059746-ec11-4d11-b2a5-b458cc2f11fa\") "
Sep 10 16:21:08.144580 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.144454    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mrlq\" (UniqueName: \"kubernetes.io/projected/8032b5e5-261c-40a9-8b0c-1a4bd384238e-kube-api-access-4mrlq\") pod \"8032b5e5-261c-40a9-8b0c-1a4bd384238e\" (UID: \"8032b5e5-261c-40a9-8b0c-1a4bd384238e\") "
Sep 10 16:21:08.144862 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.144830    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e059746-ec11-4d11-b2a5-b458cc2f11fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e059746-ec11-4d11-b2a5-b458cc2f11fa" (UID: "1e059746-ec11-4d11-b2a5-b458cc2f11fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:21:08.145202 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.145178    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8032b5e5-261c-40a9-8b0c-1a4bd384238e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8032b5e5-261c-40a9-8b0c-1a4bd384238e" (UID: "8032b5e5-261c-40a9-8b0c-1a4bd384238e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:21:08.146927 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.146901    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8032b5e5-261c-40a9-8b0c-1a4bd384238e-kube-api-access-4mrlq" (OuterVolumeSpecName: "kube-api-access-4mrlq") pod "8032b5e5-261c-40a9-8b0c-1a4bd384238e" (UID: "8032b5e5-261c-40a9-8b0c-1a4bd384238e"). InnerVolumeSpecName "kube-api-access-4mrlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:21:08.147049 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.147029    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e059746-ec11-4d11-b2a5-b458cc2f11fa-kube-api-access-9klrg" (OuterVolumeSpecName: "kube-api-access-9klrg") pod "1e059746-ec11-4d11-b2a5-b458cc2f11fa" (UID: "1e059746-ec11-4d11-b2a5-b458cc2f11fa"). InnerVolumeSpecName "kube-api-access-9klrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:21:08.245936 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.245906    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e059746-ec11-4d11-b2a5-b458cc2f11fa-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:08.245936 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.245937    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8032b5e5-261c-40a9-8b0c-1a4bd384238e-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:08.246132 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.245948    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9klrg\" (UniqueName: \"kubernetes.io/projected/1e059746-ec11-4d11-b2a5-b458cc2f11fa-kube-api-access-9klrg\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:08.246132 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.245957    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mrlq\" (UniqueName: \"kubernetes.io/projected/8032b5e5-261c-40a9-8b0c-1a4bd384238e-kube-api-access-4mrlq\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:08.403858 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.403824    2562 generic.go:356] "Generic (PLEG): container finished" podID="8032b5e5-261c-40a9-8b0c-1a4bd384238e" containerID="ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f" exitCode=0
Sep 10 16:21:08.404057 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.403865    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"
Sep 10 16:21:08.404057 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.403911    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2" event={"ID":"8032b5e5-261c-40a9-8b0c-1a4bd384238e","Type":"ContainerDied","Data":"ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f"}
Sep 10 16:21:08.404057 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.403969    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2" event={"ID":"8032b5e5-261c-40a9-8b0c-1a4bd384238e","Type":"ContainerDied","Data":"e8cc483c543f20e8c0d2f428ae1af61c84bfd821cb098abba294c46485481188"}
Sep 10 16:21:08.404057 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.403999    2562 scope.go:117] "RemoveContainer" containerID="ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f"
Sep 10 16:21:08.405302 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.405279    2562 generic.go:356] "Generic (PLEG): container finished" podID="1e059746-ec11-4d11-b2a5-b458cc2f11fa" containerID="3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731" exitCode=0
Sep 10 16:21:08.405402 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.405321    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"
Sep 10 16:21:08.405402 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.405379    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c" event={"ID":"1e059746-ec11-4d11-b2a5-b458cc2f11fa","Type":"ContainerDied","Data":"3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731"}
Sep 10 16:21:08.405509 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.405440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c" event={"ID":"1e059746-ec11-4d11-b2a5-b458cc2f11fa","Type":"ContainerDied","Data":"2e67a57b948d17694921d635207ab2b44bab9e03e3250b6285f9984205babf3a"}
Sep 10 16:21:08.413078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.413061    2562 scope.go:117] "RemoveContainer" containerID="ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f"
Sep 10 16:21:08.413395 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:21:08.413358    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f\": container with ID starting with ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f not found: ID does not exist" containerID="ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f"
Sep 10 16:21:08.413506 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.413404    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f"} err="failed to get container status \"ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f\": rpc error: code = NotFound desc = could not find container \"ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f\": container with ID starting with ca8ccf7c56054f13edfc760078ebdd5eb907a085613835330cd9791dd0bebe1f not found: ID does not exist"
Sep 10 16:21:08.413506 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.413428    2562 scope.go:117] "RemoveContainer" containerID="3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731"
Sep 10 16:21:08.421633 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.421618    2562 scope.go:117] "RemoveContainer" containerID="3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731"
Sep 10 16:21:08.421917 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:21:08.421898    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731\": container with ID starting with 3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731 not found: ID does not exist" containerID="3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731"
Sep 10 16:21:08.421986 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.421927    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731"} err="failed to get container status \"3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731\": rpc error: code = NotFound desc = could not find container \"3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731\": container with ID starting with 3062125e9505b4d7da07650b627370dad689abb50f34d706f3721552b7f18731 not found: ID does not exist"
Sep 10 16:21:08.432680 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.432658    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"]
Sep 10 16:21:08.440400 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.440376    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-7a64cdb4-65b86cdc7d-btl5c"]
Sep 10 16:21:08.456326 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.456298    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"]
Sep 10 16:21:08.463444 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.463421    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7a64cdb4-667f7c6c8f-xtnr2"]
Sep 10 16:21:08.673143 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.673117    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:21:08.852312 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852232    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-workload-certs\") pod \"00cb1278-23ae-4587-94ce-d53409e9489a\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") "
Sep 10 16:21:08.852312 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852284    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-istio-envoy\") pod \"00cb1278-23ae-4587-94ce-d53409e9489a\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") "
Sep 10 16:21:08.852866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852338    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-credential-socket\") pod \"00cb1278-23ae-4587-94ce-d53409e9489a\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") "
Sep 10 16:21:08.852866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852375    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-workload-socket\") pod \"00cb1278-23ae-4587-94ce-d53409e9489a\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") "
Sep 10 16:21:08.852866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852412    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00cb1278-23ae-4587-94ce-d53409e9489a-istio-token\") pod \"00cb1278-23ae-4587-94ce-d53409e9489a\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") "
Sep 10 16:21:08.852866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852466    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-istio-data\") pod \"00cb1278-23ae-4587-94ce-d53409e9489a\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") "
Sep 10 16:21:08.852866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852506    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm4sr\" (UniqueName: \"kubernetes.io/projected/00cb1278-23ae-4587-94ce-d53409e9489a-kube-api-access-bm4sr\") pod \"00cb1278-23ae-4587-94ce-d53409e9489a\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") "
Sep 10 16:21:08.852866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852507    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00cb1278-23ae-4587-94ce-d53409e9489a" (UID: "00cb1278-23ae-4587-94ce-d53409e9489a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:08.852866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852546    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00cb1278-23ae-4587-94ce-d53409e9489a-istio-podinfo\") pod \"00cb1278-23ae-4587-94ce-d53409e9489a\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") "
Sep 10 16:21:08.852866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852574    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00cb1278-23ae-4587-94ce-d53409e9489a-istiod-ca-cert\") pod \"00cb1278-23ae-4587-94ce-d53409e9489a\" (UID: \"00cb1278-23ae-4587-94ce-d53409e9489a\") "
Sep 10 16:21:08.852866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852654    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00cb1278-23ae-4587-94ce-d53409e9489a" (UID: "00cb1278-23ae-4587-94ce-d53409e9489a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:08.852866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852757    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00cb1278-23ae-4587-94ce-d53409e9489a" (UID: "00cb1278-23ae-4587-94ce-d53409e9489a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:08.852866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.852817    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-istio-data" (OuterVolumeSpecName: "istio-data") pod "00cb1278-23ae-4587-94ce-d53409e9489a" (UID: "00cb1278-23ae-4587-94ce-d53409e9489a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:08.853456 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.853055    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-credential-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:08.853456 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.853078    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-workload-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:08.853456 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.853092    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-istio-data\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:08.853456 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.853107    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-workload-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:08.853456 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.853087    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00cb1278-23ae-4587-94ce-d53409e9489a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00cb1278-23ae-4587-94ce-d53409e9489a" (UID: "00cb1278-23ae-4587-94ce-d53409e9489a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:21:08.854560 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.854537    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00cb1278-23ae-4587-94ce-d53409e9489a" (UID: "00cb1278-23ae-4587-94ce-d53409e9489a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:08.854680 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.854631    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00cb1278-23ae-4587-94ce-d53409e9489a-istio-token" (OuterVolumeSpecName: "istio-token") pod "00cb1278-23ae-4587-94ce-d53409e9489a" (UID: "00cb1278-23ae-4587-94ce-d53409e9489a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:21:08.854822 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.854788    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00cb1278-23ae-4587-94ce-d53409e9489a-kube-api-access-bm4sr" (OuterVolumeSpecName: "kube-api-access-bm4sr") pod "00cb1278-23ae-4587-94ce-d53409e9489a" (UID: "00cb1278-23ae-4587-94ce-d53409e9489a"). InnerVolumeSpecName "kube-api-access-bm4sr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:21:08.854941 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.854850    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00cb1278-23ae-4587-94ce-d53409e9489a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00cb1278-23ae-4587-94ce-d53409e9489a" (UID: "00cb1278-23ae-4587-94ce-d53409e9489a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:21:08.954565 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.954528    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00cb1278-23ae-4587-94ce-d53409e9489a-istio-envoy\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:08.954565 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.954559    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00cb1278-23ae-4587-94ce-d53409e9489a-istio-token\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:08.954565 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.954568    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm4sr\" (UniqueName: \"kubernetes.io/projected/00cb1278-23ae-4587-94ce-d53409e9489a-kube-api-access-bm4sr\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:08.954824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.954577    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00cb1278-23ae-4587-94ce-d53409e9489a-istio-podinfo\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:08.954824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:08.954586    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00cb1278-23ae-4587-94ce-d53409e9489a-istiod-ca-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:09.238782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.238753    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"]
Sep 10 16:21:09.239025 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.238984    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerName="istio-proxy" containerID="cri-o://9ea923f5411fea4589e5eb47875a66ca9deb5581cb865beab415c2708ac2eee8" gracePeriod=30
Sep 10 16:21:09.413941 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.413902    2562 generic.go:356] "Generic (PLEG): container finished" podID="00cb1278-23ae-4587-94ce-d53409e9489a" containerID="bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02" exitCode=0
Sep 10 16:21:09.413941 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.413945    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"
Sep 10 16:21:09.414206 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.413987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" event={"ID":"00cb1278-23ae-4587-94ce-d53409e9489a","Type":"ContainerDied","Data":"bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02"}
Sep 10 16:21:09.414206 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.414047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4" event={"ID":"00cb1278-23ae-4587-94ce-d53409e9489a","Type":"ContainerDied","Data":"a95b72483b144cfbe2fe43e7e1b7f2819bae93060dceb9f3a0dd164c754f0946"}
Sep 10 16:21:09.414206 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.414079    2562 scope.go:117] "RemoveContainer" containerID="bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02"
Sep 10 16:21:09.424426 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.424407    2562 scope.go:117] "RemoveContainer" containerID="532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5"
Sep 10 16:21:09.432768 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.432751    2562 scope.go:117] "RemoveContainer" containerID="bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02"
Sep 10 16:21:09.433043 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:21:09.433026    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02\": container with ID starting with bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02 not found: ID does not exist" containerID="bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02"
Sep 10 16:21:09.433110 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.433052    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02"} err="failed to get container status \"bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02\": rpc error: code = NotFound desc = could not find container \"bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02\": container with ID starting with bbae4e4e0a5dded46f34d8e8fa2e4964397f0c3d255c1d945cf3bc85d61fdc02 not found: ID does not exist"
Sep 10 16:21:09.433110 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.433073    2562 scope.go:117] "RemoveContainer" containerID="532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5"
Sep 10 16:21:09.433344 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:21:09.433324    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5\": container with ID starting with 532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5 not found: ID does not exist" containerID="532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5"
Sep 10 16:21:09.433384 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.433351    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5"} err="failed to get container status \"532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5\": rpc error: code = NotFound desc = could not find container \"532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5\": container with ID starting with 532f9835038e91a60a1af41eb7ece602c7892896d5f58a4da38e4102d3de75b5 not found: ID does not exist"
Sep 10 16:21:09.446141 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.446116    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"]
Sep 10 16:21:09.448226 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:09.448193    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-1596ac-openshift-default-66bf86db88-9w5b4"]
Sep 10 16:21:10.076039 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.076004    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" path="/var/lib/kubelet/pods/00cb1278-23ae-4587-94ce-d53409e9489a/volumes"
Sep 10 16:21:10.076489 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.076377    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e059746-ec11-4d11-b2a5-b458cc2f11fa" path="/var/lib/kubelet/pods/1e059746-ec11-4d11-b2a5-b458cc2f11fa/volumes"
Sep 10 16:21:10.076707 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.076678    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8032b5e5-261c-40a9-8b0c-1a4bd384238e" path="/var/lib/kubelet/pods/8032b5e5-261c-40a9-8b0c-1a4bd384238e/volumes"
Sep 10 16:21:10.085895 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.085869    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"]
Sep 10 16:21:10.086361 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086344    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy"
Sep 10 16:21:10.086446 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086364    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy"
Sep 10 16:21:10.086446 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086381    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8032b5e5-261c-40a9-8b0c-1a4bd384238e" containerName="payload-processing"
Sep 10 16:21:10.086446 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086389    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8032b5e5-261c-40a9-8b0c-1a4bd384238e" containerName="payload-processing"
Sep 10 16:21:10.086446 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086415    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy"
Sep 10 16:21:10.086446 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086423    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy"
Sep 10 16:21:10.086446 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086439    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="406ae9bd-1faf-4648-9a8f-e9bc0b09208a" containerName="revoke-keys"
Sep 10 16:21:10.086763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086448    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="406ae9bd-1faf-4648-9a8f-e9bc0b09208a" containerName="revoke-keys"
Sep 10 16:21:10.086763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086459    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a17b75a-d75b-4347-818d-2b4ff815f758" containerName="main"
Sep 10 16:21:10.086763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086468    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a17b75a-d75b-4347-818d-2b4ff815f758" containerName="main"
Sep 10 16:21:10.086763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086488    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e059746-ec11-4d11-b2a5-b458cc2f11fa" containerName="payload-pre-processing"
Sep 10 16:21:10.086763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086497    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e059746-ec11-4d11-b2a5-b458cc2f11fa" containerName="payload-pre-processing"
Sep 10 16:21:10.086763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086596    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8032b5e5-261c-40a9-8b0c-1a4bd384238e" containerName="payload-processing"
Sep 10 16:21:10.086763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086612    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="406ae9bd-1faf-4648-9a8f-e9bc0b09208a" containerName="revoke-keys"
Sep 10 16:21:10.086763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086621    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy"
Sep 10 16:21:10.086763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086631    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a17b75a-d75b-4347-818d-2b4ff815f758" containerName="main"
Sep 10 16:21:10.086763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.086642    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e059746-ec11-4d11-b2a5-b458cc2f11fa" containerName="payload-pre-processing"
Sep 10 16:21:10.090002 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.089975    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.093776 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.093753    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0e28e849-openshift-default-dockercfg-bdghs\""
Sep 10 16:21:10.216844 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.216807    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"]
Sep 10 16:21:10.269009 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.268967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-envoy\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.269172 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.269015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-data\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.269172 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.269047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sgww\" (UniqueName: \"kubernetes.io/projected/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-kube-api-access-9sgww\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.269172 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.269097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-credential-socket\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.269275 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.269183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istiod-ca-cert\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.269275 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.269215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-podinfo\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.269275 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.269256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-workload-certs\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.269369 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.269277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-token\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.269369 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.269305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-workload-socket\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370058 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.369969    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istiod-ca-cert\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370058 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-podinfo\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370287 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370122    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-workload-certs\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370287 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370159    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-token\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370287 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-workload-socket\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370458 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-envoy\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370458 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-data\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370458 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sgww\" (UniqueName: \"kubernetes.io/projected/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-kube-api-access-9sgww\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370619 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-credential-socket\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370619 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370506    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-workload-certs\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370831 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370655    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-workload-socket\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370896 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370830    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-credential-socket\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370896 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370837    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istiod-ca-cert\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.370896 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.370860    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-data\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.372367 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.372347    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-podinfo\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.372462 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.372355    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-envoy\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.384228 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.384206    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-token\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.386484 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.386458    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sgww\" (UniqueName: \"kubernetes.io/projected/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-kube-api-access-9sgww\") pod \"e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") " pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.402248 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.402220    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:10.691078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.691048    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"]
Sep 10 16:21:10.692166 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:21:10.692129    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76d40da_6c2a_4cd5_90ea_43bc55021c7b.slice/crio-70b4fceb7e9130e9b82e514a837a9332641204f71ea091ececdcb6473487f06d WatchSource:0}: Error finding container 70b4fceb7e9130e9b82e514a837a9332641204f71ea091ececdcb6473487f06d: Status 404 returned error can't find the container with id 70b4fceb7e9130e9b82e514a837a9332641204f71ea091ececdcb6473487f06d
Sep 10 16:21:10.694710 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.694677    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:21:10.694823 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.694767    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:21:10.694823 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:10.694795    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:21:11.429926 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:11.429880    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" event={"ID":"c76d40da-6c2a-4cd5-90ea-43bc55021c7b","Type":"ContainerStarted","Data":"8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56"}
Sep 10 16:21:11.429926 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:11.429932    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" event={"ID":"c76d40da-6c2a-4cd5-90ea-43bc55021c7b","Type":"ContainerStarted","Data":"70b4fceb7e9130e9b82e514a837a9332641204f71ea091ececdcb6473487f06d"}
Sep 10 16:21:11.453428 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:11.453376    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" podStartSLOduration=1.45335831 podStartE2EDuration="1.45335831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:21:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:21:11.452591899 +0000 UTC m=+1155.864678109" watchObservedRunningTime="2026-09-10 16:21:11.45335831 +0000 UTC m=+1155.865444519"
Sep 10 16:21:12.402414 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:12.402375    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:12.407588 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:12.407556    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:12.438329 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:12.438298    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:12.439381 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:12.439360    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:14.451787 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.451757    2562 generic.go:356] "Generic (PLEG): container finished" podID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerID="9ea923f5411fea4589e5eb47875a66ca9deb5581cb865beab415c2708ac2eee8" exitCode=0
Sep 10 16:21:14.452155 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.451820    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" event={"ID":"bcfb904c-14be-47ff-9000-50795cc3aad0","Type":"ContainerDied","Data":"9ea923f5411fea4589e5eb47875a66ca9deb5581cb865beab415c2708ac2eee8"}
Sep 10 16:21:14.452155 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.451884    2562 scope.go:117] "RemoveContainer" containerID="6b0f58e1340ef78335094e1ef2b52d862ccf74fd93b70f60306963eca5c28519"
Sep 10 16:21:14.498485 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.498457    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:21:14.515765 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.515645    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-credential-socket\") pod \"bcfb904c-14be-47ff-9000-50795cc3aad0\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") "
Sep 10 16:21:14.515898 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.515767    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-token\") pod \"bcfb904c-14be-47ff-9000-50795cc3aad0\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") "
Sep 10 16:21:14.515898 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.515848    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-data\") pod \"bcfb904c-14be-47ff-9000-50795cc3aad0\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") "
Sep 10 16:21:14.515898 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.515875    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-envoy\") pod \"bcfb904c-14be-47ff-9000-50795cc3aad0\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") "
Sep 10 16:21:14.516020 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.515899    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzs97\" (UniqueName: \"kubernetes.io/projected/bcfb904c-14be-47ff-9000-50795cc3aad0-kube-api-access-tzs97\") pod \"bcfb904c-14be-47ff-9000-50795cc3aad0\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") "
Sep 10 16:21:14.516020 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.515927    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcfb904c-14be-47ff-9000-50795cc3aad0-istiod-ca-cert\") pod \"bcfb904c-14be-47ff-9000-50795cc3aad0\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") "
Sep 10 16:21:14.516020 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.515970    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-workload-socket\") pod \"bcfb904c-14be-47ff-9000-50795cc3aad0\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") "
Sep 10 16:21:14.516020 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.515964    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bcfb904c-14be-47ff-9000-50795cc3aad0" (UID: "bcfb904c-14be-47ff-9000-50795cc3aad0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:14.516194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.516044    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-workload-certs\") pod \"bcfb904c-14be-47ff-9000-50795cc3aad0\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") "
Sep 10 16:21:14.516194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.516076    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-podinfo\") pod \"bcfb904c-14be-47ff-9000-50795cc3aad0\" (UID: \"bcfb904c-14be-47ff-9000-50795cc3aad0\") "
Sep 10 16:21:14.516301 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.516199    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bcfb904c-14be-47ff-9000-50795cc3aad0" (UID: "bcfb904c-14be-47ff-9000-50795cc3aad0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:14.516536 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.516488    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-data" (OuterVolumeSpecName: "istio-data") pod "bcfb904c-14be-47ff-9000-50795cc3aad0" (UID: "bcfb904c-14be-47ff-9000-50795cc3aad0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:14.517120 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.516547    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-credential-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:14.517120 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.516677    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcfb904c-14be-47ff-9000-50795cc3aad0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bcfb904c-14be-47ff-9000-50795cc3aad0" (UID: "bcfb904c-14be-47ff-9000-50795cc3aad0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:21:14.517120 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.516711    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-workload-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:14.517120 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.516776    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bcfb904c-14be-47ff-9000-50795cc3aad0" (UID: "bcfb904c-14be-47ff-9000-50795cc3aad0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:14.518579 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.518544    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcfb904c-14be-47ff-9000-50795cc3aad0-kube-api-access-tzs97" (OuterVolumeSpecName: "kube-api-access-tzs97") pod "bcfb904c-14be-47ff-9000-50795cc3aad0" (UID: "bcfb904c-14be-47ff-9000-50795cc3aad0"). InnerVolumeSpecName "kube-api-access-tzs97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:21:14.518684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.518589    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-token" (OuterVolumeSpecName: "istio-token") pod "bcfb904c-14be-47ff-9000-50795cc3aad0" (UID: "bcfb904c-14be-47ff-9000-50795cc3aad0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:21:14.518775 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.518748    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bcfb904c-14be-47ff-9000-50795cc3aad0" (UID: "bcfb904c-14be-47ff-9000-50795cc3aad0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:14.518832 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.518777    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bcfb904c-14be-47ff-9000-50795cc3aad0" (UID: "bcfb904c-14be-47ff-9000-50795cc3aad0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:21:14.617593 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.617556    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-token\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:14.617593 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.617588    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-data\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:14.617593 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.617598    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-envoy\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:14.617863 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.617608    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzs97\" (UniqueName: \"kubernetes.io/projected/bcfb904c-14be-47ff-9000-50795cc3aad0-kube-api-access-tzs97\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:14.617863 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.617617    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcfb904c-14be-47ff-9000-50795cc3aad0-istiod-ca-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:14.617863 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.617626    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcfb904c-14be-47ff-9000-50795cc3aad0-workload-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:14.617863 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.617633    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcfb904c-14be-47ff-9000-50795cc3aad0-istio-podinfo\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:14.836578 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.836484    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"]
Sep 10 16:21:14.837174 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.837152    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerName="istio-proxy"
Sep 10 16:21:14.837174 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.837174    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerName="istio-proxy"
Sep 10 16:21:14.837392 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.837190    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerName="istio-proxy"
Sep 10 16:21:14.837392 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.837199    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerName="istio-proxy"
Sep 10 16:21:14.837392 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.837319    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="00cb1278-23ae-4587-94ce-d53409e9489a" containerName="istio-proxy"
Sep 10 16:21:14.837392 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.837331    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerName="istio-proxy"
Sep 10 16:21:14.839949 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.839930    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"]
Sep 10 16:21:14.840060 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.840042    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"
Sep 10 16:21:14.840442 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.840419    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" containerName="istio-proxy"
Sep 10 16:21:14.843075 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.843054    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"
Sep 10 16:21:14.843285 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.843264    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0e28e849\""
Sep 10 16:21:14.846068 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.846048    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0e28e849-dockercfg-w9hbz\""
Sep 10 16:21:14.854234 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.854212    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"]
Sep 10 16:21:14.859331 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.859304    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"]
Sep 10 16:21:14.921426 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.921390    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001382cd-64f4-47f7-a591-b262c6206dec-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq\" (UID: \"001382cd-64f4-47f7-a591-b262c6206dec\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"
Sep 10 16:21:14.921623 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.921520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqgzt\" (UniqueName: \"kubernetes.io/projected/001382cd-64f4-47f7-a591-b262c6206dec-kube-api-access-pqgzt\") pod \"payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq\" (UID: \"001382cd-64f4-47f7-a591-b262c6206dec\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"
Sep 10 16:21:14.921623 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.921561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4f26ec8-c862-4122-a8a6-93fb69837358-plugins-config-volume\") pod \"payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4\" (UID: \"b4f26ec8-c862-4122-a8a6-93fb69837358\") " pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"
Sep 10 16:21:14.921623 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:14.921587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw5rs\" (UniqueName: \"kubernetes.io/projected/b4f26ec8-c862-4122-a8a6-93fb69837358-kube-api-access-sw5rs\") pod \"payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4\" (UID: \"b4f26ec8-c862-4122-a8a6-93fb69837358\") " pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"
Sep 10 16:21:15.023056 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.023021    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqgzt\" (UniqueName: \"kubernetes.io/projected/001382cd-64f4-47f7-a591-b262c6206dec-kube-api-access-pqgzt\") pod \"payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq\" (UID: \"001382cd-64f4-47f7-a591-b262c6206dec\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"
Sep 10 16:21:15.023234 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.023067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4f26ec8-c862-4122-a8a6-93fb69837358-plugins-config-volume\") pod \"payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4\" (UID: \"b4f26ec8-c862-4122-a8a6-93fb69837358\") " pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"
Sep 10 16:21:15.023234 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.023098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw5rs\" (UniqueName: \"kubernetes.io/projected/b4f26ec8-c862-4122-a8a6-93fb69837358-kube-api-access-sw5rs\") pod \"payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4\" (UID: \"b4f26ec8-c862-4122-a8a6-93fb69837358\") " pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"
Sep 10 16:21:15.023234 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.023149    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001382cd-64f4-47f7-a591-b262c6206dec-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq\" (UID: \"001382cd-64f4-47f7-a591-b262c6206dec\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"
Sep 10 16:21:15.023865 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.023842    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001382cd-64f4-47f7-a591-b262c6206dec-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq\" (UID: \"001382cd-64f4-47f7-a591-b262c6206dec\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"
Sep 10 16:21:15.023966 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.023859    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4f26ec8-c862-4122-a8a6-93fb69837358-plugins-config-volume\") pod \"payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4\" (UID: \"b4f26ec8-c862-4122-a8a6-93fb69837358\") " pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"
Sep 10 16:21:15.033793 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.033738    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw5rs\" (UniqueName: \"kubernetes.io/projected/b4f26ec8-c862-4122-a8a6-93fb69837358-kube-api-access-sw5rs\") pod \"payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4\" (UID: \"b4f26ec8-c862-4122-a8a6-93fb69837358\") " pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"
Sep 10 16:21:15.034720 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.034701    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqgzt\" (UniqueName: \"kubernetes.io/projected/001382cd-64f4-47f7-a591-b262c6206dec-kube-api-access-pqgzt\") pod \"payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq\" (UID: \"001382cd-64f4-47f7-a591-b262c6206dec\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"
Sep 10 16:21:15.154468 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.154379    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"
Sep 10 16:21:15.162833 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.162812    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"
Sep 10 16:21:15.442319 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.442292    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"]
Sep 10 16:21:15.444689 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:21:15.444653    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001382cd_64f4_47f7_a591_b262c6206dec.slice/crio-910df47a0b29e2ec2aae9628565cd6ef80f52d6ed9b4b33f9de0592326fd797f WatchSource:0}: Error finding container 910df47a0b29e2ec2aae9628565cd6ef80f52d6ed9b4b33f9de0592326fd797f: Status 404 returned error can't find the container with id 910df47a0b29e2ec2aae9628565cd6ef80f52d6ed9b4b33f9de0592326fd797f
Sep 10 16:21:15.458393 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.458353    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq" event={"ID":"001382cd-64f4-47f7-a591-b262c6206dec","Type":"ContainerStarted","Data":"910df47a0b29e2ec2aae9628565cd6ef80f52d6ed9b4b33f9de0592326fd797f"}
Sep 10 16:21:15.459868 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.459832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc" event={"ID":"bcfb904c-14be-47ff-9000-50795cc3aad0","Type":"ContainerDied","Data":"1bbf0c12972a181fdac912f5d659062f25a12c6fe3b13c9169b86600bf4369c4"}
Sep 10 16:21:15.459988 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.459876    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"
Sep 10 16:21:15.459988 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.459898    2562 scope.go:117] "RemoveContainer" containerID="9ea923f5411fea4589e5eb47875a66ca9deb5581cb865beab415c2708ac2eee8"
Sep 10 16:21:15.469889 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.469861    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"]
Sep 10 16:21:15.485097 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:21:15.485072    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f26ec8_c862_4122_a8a6_93fb69837358.slice/crio-8ffa8cafb316d3ed02b4f8e29990ce8ca78ab1417cd1a93f1584456f12ea1756 WatchSource:0}: Error finding container 8ffa8cafb316d3ed02b4f8e29990ce8ca78ab1417cd1a93f1584456f12ea1756: Status 404 returned error can't find the container with id 8ffa8cafb316d3ed02b4f8e29990ce8ca78ab1417cd1a93f1584456f12ea1756
Sep 10 16:21:15.516693 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.516671    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"]
Sep 10 16:21:15.518948 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:15.518925    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7a64cdb4-openshift-default-7fb75798b6-nvbgc"]
Sep 10 16:21:16.072292 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:16.072254    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcfb904c-14be-47ff-9000-50795cc3aad0" path="/var/lib/kubelet/pods/bcfb904c-14be-47ff-9000-50795cc3aad0/volumes"
Sep 10 16:21:16.467167 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:16.467063    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4" event={"ID":"b4f26ec8-c862-4122-a8a6-93fb69837358","Type":"ContainerStarted","Data":"7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc"}
Sep 10 16:21:16.467167 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:16.467147    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4" event={"ID":"b4f26ec8-c862-4122-a8a6-93fb69837358","Type":"ContainerStarted","Data":"8ffa8cafb316d3ed02b4f8e29990ce8ca78ab1417cd1a93f1584456f12ea1756"}
Sep 10 16:21:16.467636 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:16.467184    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"
Sep 10 16:21:16.470045 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:16.470017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq" event={"ID":"001382cd-64f4-47f7-a591-b262c6206dec","Type":"ContainerStarted","Data":"37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6"}
Sep 10 16:21:16.470173 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:16.470157    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"
Sep 10 16:21:16.495141 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:16.495088    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4" podStartSLOduration=2.495070172 podStartE2EDuration="2.495070172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:21:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:21:16.491176771 +0000 UTC m=+1160.903262994" watchObservedRunningTime="2026-09-10 16:21:16.495070172 +0000 UTC m=+1160.907156397"
Sep 10 16:21:16.511429 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:16.511382    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq" podStartSLOduration=2.511367289 podStartE2EDuration="2.511367289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:21:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:21:16.509888788 +0000 UTC m=+1160.921974998" watchObservedRunningTime="2026-09-10 16:21:16.511367289 +0000 UTC m=+1160.923453525"
Sep 10 16:21:20.999081 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:20.998991    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"]
Sep 10 16:21:21.002487 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.002455    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"
Sep 10 16:21:21.014874 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.014854    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-555853-dockercfg-g2xqx\""
Sep 10 16:21:21.019951 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.019928    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"]
Sep 10 16:21:21.022421 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.022400    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-555853\""
Sep 10 16:21:21.086345 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.086286    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv7rv\" (UniqueName: \"kubernetes.io/projected/58275423-1ef1-4386-b1d4-2530f989b963-kube-api-access-fv7rv\") pod \"payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j\" (UID: \"58275423-1ef1-4386-b1d4-2530f989b963\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"
Sep 10 16:21:21.086539 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.086445    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58275423-1ef1-4386-b1d4-2530f989b963-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j\" (UID: \"58275423-1ef1-4386-b1d4-2530f989b963\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"
Sep 10 16:21:21.134397 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.134367    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"]
Sep 10 16:21:21.137007 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.136991    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"
Sep 10 16:21:21.164815 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.164787    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"]
Sep 10 16:21:21.188007 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.187970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv7rv\" (UniqueName: \"kubernetes.io/projected/58275423-1ef1-4386-b1d4-2530f989b963-kube-api-access-fv7rv\") pod \"payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j\" (UID: \"58275423-1ef1-4386-b1d4-2530f989b963\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"
Sep 10 16:21:21.188154 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.188029    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd\" (UID: \"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"
Sep 10 16:21:21.188154 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.188100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtchp\" (UniqueName: \"kubernetes.io/projected/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a-kube-api-access-qtchp\") pod \"payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd\" (UID: \"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"
Sep 10 16:21:21.188284 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.188150    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58275423-1ef1-4386-b1d4-2530f989b963-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j\" (UID: \"58275423-1ef1-4386-b1d4-2530f989b963\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"
Sep 10 16:21:21.188839 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.188819    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58275423-1ef1-4386-b1d4-2530f989b963-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j\" (UID: \"58275423-1ef1-4386-b1d4-2530f989b963\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"
Sep 10 16:21:21.202048 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.202005    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv7rv\" (UniqueName: \"kubernetes.io/projected/58275423-1ef1-4386-b1d4-2530f989b963-kube-api-access-fv7rv\") pod \"payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j\" (UID: \"58275423-1ef1-4386-b1d4-2530f989b963\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"
Sep 10 16:21:21.289812 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.289685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd\" (UID: \"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"
Sep 10 16:21:21.289812 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.289805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtchp\" (UniqueName: \"kubernetes.io/projected/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a-kube-api-access-qtchp\") pod \"payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd\" (UID: \"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"
Sep 10 16:21:21.290379 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.290341    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd\" (UID: \"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"
Sep 10 16:21:21.300485 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.300462    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtchp\" (UniqueName: \"kubernetes.io/projected/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a-kube-api-access-qtchp\") pod \"payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd\" (UID: \"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"
Sep 10 16:21:21.312379 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.312332    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"
Sep 10 16:21:21.447258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.447220    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"
Sep 10 16:21:21.597339 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.597308    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"]
Sep 10 16:21:21.598784 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:21:21.598758    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58275423_1ef1_4386_b1d4_2530f989b963.slice/crio-a3d5c8fb24cfee8ba482947aed925cfba611736807e40985f39f9bc907889d61 WatchSource:0}: Error finding container a3d5c8fb24cfee8ba482947aed925cfba611736807e40985f39f9bc907889d61: Status 404 returned error can't find the container with id a3d5c8fb24cfee8ba482947aed925cfba611736807e40985f39f9bc907889d61
Sep 10 16:21:21.730990 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:21.730924    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"]
Sep 10 16:21:21.733223 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:21:21.733194    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3be546f_5cfe_410f_b3e6_ca3e378c6c9a.slice/crio-db90b5dae2d814199e4bd8852153103abb084d3e00c6dee99c9ae5b0009b6c5d WatchSource:0}: Error finding container db90b5dae2d814199e4bd8852153103abb084d3e00c6dee99c9ae5b0009b6c5d: Status 404 returned error can't find the container with id db90b5dae2d814199e4bd8852153103abb084d3e00c6dee99c9ae5b0009b6c5d
Sep 10 16:21:22.507437 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:22.507383    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd" event={"ID":"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a","Type":"ContainerStarted","Data":"39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a"}
Sep 10 16:21:22.508002 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:22.507464    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd" event={"ID":"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a","Type":"ContainerStarted","Data":"db90b5dae2d814199e4bd8852153103abb084d3e00c6dee99c9ae5b0009b6c5d"}
Sep 10 16:21:22.508002 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:22.507496    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"
Sep 10 16:21:22.509124 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:22.509094    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j" event={"ID":"58275423-1ef1-4386-b1d4-2530f989b963","Type":"ContainerStarted","Data":"b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f"}
Sep 10 16:21:22.509249 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:22.509148    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j" event={"ID":"58275423-1ef1-4386-b1d4-2530f989b963","Type":"ContainerStarted","Data":"a3d5c8fb24cfee8ba482947aed925cfba611736807e40985f39f9bc907889d61"}
Sep 10 16:21:22.509249 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:22.509197    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"
Sep 10 16:21:22.531454 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:22.531399    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd" podStartSLOduration=1.531381686 podStartE2EDuration="1.531381686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:21:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:21:22.528503238 +0000 UTC m=+1166.940589448" watchObservedRunningTime="2026-09-10 16:21:22.531381686 +0000 UTC m=+1166.943467895"
Sep 10 16:21:27.478153 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:27.478117    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"
Sep 10 16:21:27.478560 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:27.478534    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"
Sep 10 16:21:27.514061 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:27.514006    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j" podStartSLOduration=7.513992187 podStartE2EDuration="7.513992187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:21:22.550837676 +0000 UTC m=+1166.962923884" watchObservedRunningTime="2026-09-10 16:21:27.513992187 +0000 UTC m=+1171.926078398"
Sep 10 16:21:33.517468 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:33.517425    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"
Sep 10 16:21:33.517907 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:33.517505    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"
Sep 10 16:21:34.596067 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:34.596035    2562 generic.go:356] "Generic (PLEG): container finished" podID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerID="8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56" exitCode=0
Sep 10 16:21:34.596509 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:34.596100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" event={"ID":"c76d40da-6c2a-4cd5-90ea-43bc55021c7b","Type":"ContainerDied","Data":"8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56"}
Sep 10 16:21:34.596595 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:34.596577    2562 scope.go:117] "RemoveContainer" containerID="8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56"
Sep 10 16:21:34.597739 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:34.597689    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:21:34.597850 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:34.597799    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:21:34.597917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:34.597853    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:21:35.604838 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:35.604806    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" event={"ID":"c76d40da-6c2a-4cd5-90ea-43bc55021c7b","Type":"ContainerStarted","Data":"9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a"}
Sep 10 16:21:36.402994 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:36.402947    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:36.403178 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:36.403160    2562 patch_prober.go:28] interesting pod/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 16:21:36.403226 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:36.403206    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 16:21:37.403365 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:37.403332    2562 patch_prober.go:28] interesting pod/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 16:21:37.403761 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:37.403401    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 16:21:38.403454 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:38.403416    2562 patch_prober.go:28] interesting pod/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 16:21:38.403877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:38.403482    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 16:21:39.403481 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:39.403449    2562 patch_prober.go:28] interesting pod/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 16:21:39.403921 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:39.403503    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 16:21:40.402887 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:40.402849    2562 patch_prober.go:28] interesting pod/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 16:21:40.403047 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:40.402905    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 16:21:41.406923 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:41.406891    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:41.407343 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:41.407162    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:41.407807 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:41.407790    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:44.781927 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:44.781887    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"]
Sep 10 16:21:44.782406 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:44.782149    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4" podUID="b4f26ec8-c862-4122-a8a6-93fb69837358" containerName="payload-processing" containerID="cri-o://7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc" gracePeriod=30
Sep 10 16:21:44.792671 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:44.792640    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"]
Sep 10 16:21:44.792921 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:44.792895    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq" podUID="001382cd-64f4-47f7-a591-b262c6206dec" containerName="payload-pre-processing" containerID="cri-o://37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6" gracePeriod=30
Sep 10 16:21:45.055629 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.055603    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"
Sep 10 16:21:45.086073 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.086047    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"
Sep 10 16:21:45.137216 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.137177    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"]
Sep 10 16:21:45.137449 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.137415    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerName="istio-proxy" containerID="cri-o://9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a" gracePeriod=30
Sep 10 16:21:45.155327 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.155300    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw5rs\" (UniqueName: \"kubernetes.io/projected/b4f26ec8-c862-4122-a8a6-93fb69837358-kube-api-access-sw5rs\") pod \"b4f26ec8-c862-4122-a8a6-93fb69837358\" (UID: \"b4f26ec8-c862-4122-a8a6-93fb69837358\") "
Sep 10 16:21:45.155531 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.155414    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4f26ec8-c862-4122-a8a6-93fb69837358-plugins-config-volume\") pod \"b4f26ec8-c862-4122-a8a6-93fb69837358\" (UID: \"b4f26ec8-c862-4122-a8a6-93fb69837358\") "
Sep 10 16:21:45.155531 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.155462    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001382cd-64f4-47f7-a591-b262c6206dec-plugins-config-volume\") pod \"001382cd-64f4-47f7-a591-b262c6206dec\" (UID: \"001382cd-64f4-47f7-a591-b262c6206dec\") "
Sep 10 16:21:45.155531 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.155511    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqgzt\" (UniqueName: \"kubernetes.io/projected/001382cd-64f4-47f7-a591-b262c6206dec-kube-api-access-pqgzt\") pod \"001382cd-64f4-47f7-a591-b262c6206dec\" (UID: \"001382cd-64f4-47f7-a591-b262c6206dec\") "
Sep 10 16:21:45.155842 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.155810    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4f26ec8-c862-4122-a8a6-93fb69837358-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b4f26ec8-c862-4122-a8a6-93fb69837358" (UID: "b4f26ec8-c862-4122-a8a6-93fb69837358"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:21:45.155981 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.155906    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/001382cd-64f4-47f7-a591-b262c6206dec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "001382cd-64f4-47f7-a591-b262c6206dec" (UID: "001382cd-64f4-47f7-a591-b262c6206dec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:21:45.155981 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.155972    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4f26ec8-c862-4122-a8a6-93fb69837358-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:45.157387 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.157366    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4f26ec8-c862-4122-a8a6-93fb69837358-kube-api-access-sw5rs" (OuterVolumeSpecName: "kube-api-access-sw5rs") pod "b4f26ec8-c862-4122-a8a6-93fb69837358" (UID: "b4f26ec8-c862-4122-a8a6-93fb69837358"). InnerVolumeSpecName "kube-api-access-sw5rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:21:45.157547 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.157523    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/001382cd-64f4-47f7-a591-b262c6206dec-kube-api-access-pqgzt" (OuterVolumeSpecName: "kube-api-access-pqgzt") pod "001382cd-64f4-47f7-a591-b262c6206dec" (UID: "001382cd-64f4-47f7-a591-b262c6206dec"). InnerVolumeSpecName "kube-api-access-pqgzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:21:45.257376 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.257340    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001382cd-64f4-47f7-a591-b262c6206dec-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:45.257376 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.257371    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqgzt\" (UniqueName: \"kubernetes.io/projected/001382cd-64f4-47f7-a591-b262c6206dec-kube-api-access-pqgzt\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:45.257376 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.257382    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw5rs\" (UniqueName: \"kubernetes.io/projected/b4f26ec8-c862-4122-a8a6-93fb69837358-kube-api-access-sw5rs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:45.661076 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.661041    2562 generic.go:356] "Generic (PLEG): container finished" podID="b4f26ec8-c862-4122-a8a6-93fb69837358" containerID="7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc" exitCode=0
Sep 10 16:21:45.661258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.661087    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"
Sep 10 16:21:45.661258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.661124    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4" event={"ID":"b4f26ec8-c862-4122-a8a6-93fb69837358","Type":"ContainerDied","Data":"7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc"}
Sep 10 16:21:45.661258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.661174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4" event={"ID":"b4f26ec8-c862-4122-a8a6-93fb69837358","Type":"ContainerDied","Data":"8ffa8cafb316d3ed02b4f8e29990ce8ca78ab1417cd1a93f1584456f12ea1756"}
Sep 10 16:21:45.661258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.661201    2562 scope.go:117] "RemoveContainer" containerID="7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc"
Sep 10 16:21:45.662532 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.662505    2562 generic.go:356] "Generic (PLEG): container finished" podID="001382cd-64f4-47f7-a591-b262c6206dec" containerID="37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6" exitCode=0
Sep 10 16:21:45.662650 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.662543    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"
Sep 10 16:21:45.662650 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.662582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq" event={"ID":"001382cd-64f4-47f7-a591-b262c6206dec","Type":"ContainerDied","Data":"37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6"}
Sep 10 16:21:45.662650 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.662626    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq" event={"ID":"001382cd-64f4-47f7-a591-b262c6206dec","Type":"ContainerDied","Data":"910df47a0b29e2ec2aae9628565cd6ef80f52d6ed9b4b33f9de0592326fd797f"}
Sep 10 16:21:45.671134 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.671101    2562 scope.go:117] "RemoveContainer" containerID="7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc"
Sep 10 16:21:45.671440 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:21:45.671418    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc\": container with ID starting with 7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc not found: ID does not exist" containerID="7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc"
Sep 10 16:21:45.671517 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.671448    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc"} err="failed to get container status \"7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc\": rpc error: code = NotFound desc = could not find container \"7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc\": container with ID starting with 7df7a63b452e969e78ec76b8c6c90e94e12e69c2cb7077ff8ff112d4c89260dc not found: ID does not exist"
Sep 10 16:21:45.671517 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.671465    2562 scope.go:117] "RemoveContainer" containerID="37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6"
Sep 10 16:21:45.679991 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.679973    2562 scope.go:117] "RemoveContainer" containerID="37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6"
Sep 10 16:21:45.680268 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:21:45.680245    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6\": container with ID starting with 37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6 not found: ID does not exist" containerID="37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6"
Sep 10 16:21:45.680332 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.680280    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6"} err="failed to get container status \"37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6\": rpc error: code = NotFound desc = could not find container \"37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6\": container with ID starting with 37b0f855074150f67209c1a46f0000f88868644d7d98fea9ec995db558df63e6 not found: ID does not exist"
Sep 10 16:21:45.692000 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.691962    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"]
Sep 10 16:21:45.694407 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.694386    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0e28e849-76fd5756fc-4zsk4"]
Sep 10 16:21:45.710985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.710954    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"]
Sep 10 16:21:45.716947 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:45.716922    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0e28e849-7bbcc49586-4vfbq"]
Sep 10 16:21:46.070803 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:46.070770    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="001382cd-64f4-47f7-a591-b262c6206dec" path="/var/lib/kubelet/pods/001382cd-64f4-47f7-a591-b262c6206dec/volumes"
Sep 10 16:21:46.071180 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:46.071144    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4f26ec8-c862-4122-a8a6-93fb69837358" path="/var/lib/kubelet/pods/b4f26ec8-c862-4122-a8a6-93fb69837358/volumes"
Sep 10 16:21:50.391527 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.391493    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:50.510169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510137    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-envoy\") pod \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") "
Sep 10 16:21:50.510339 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510196    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-token\") pod \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") "
Sep 10 16:21:50.510339 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510224    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-workload-socket\") pod \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") "
Sep 10 16:21:50.510339 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510258    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sgww\" (UniqueName: \"kubernetes.io/projected/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-kube-api-access-9sgww\") pod \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") "
Sep 10 16:21:50.510339 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510285    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-workload-certs\") pod \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") "
Sep 10 16:21:50.510339 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510312    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-podinfo\") pod \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") "
Sep 10 16:21:50.510617 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510349    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istiod-ca-cert\") pod \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") "
Sep 10 16:21:50.510617 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510378    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-data\") pod \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") "
Sep 10 16:21:50.510617 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510537    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c76d40da-6c2a-4cd5-90ea-43bc55021c7b" (UID: "c76d40da-6c2a-4cd5-90ea-43bc55021c7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:50.510617 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510562    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-credential-socket\") pod \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\" (UID: \"c76d40da-6c2a-4cd5-90ea-43bc55021c7b\") "
Sep 10 16:21:50.510844 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510772    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c76d40da-6c2a-4cd5-90ea-43bc55021c7b" (UID: "c76d40da-6c2a-4cd5-90ea-43bc55021c7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:50.510899 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510840    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-data" (OuterVolumeSpecName: "istio-data") pod "c76d40da-6c2a-4cd5-90ea-43bc55021c7b" (UID: "c76d40da-6c2a-4cd5-90ea-43bc55021c7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:50.511037 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.510985    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-workload-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:50.511037 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.511000    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c76d40da-6c2a-4cd5-90ea-43bc55021c7b" (UID: "c76d40da-6c2a-4cd5-90ea-43bc55021c7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:50.511037 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.511006    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-workload-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:50.511183 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.511041    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-data\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:50.511183 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.511013    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c76d40da-6c2a-4cd5-90ea-43bc55021c7b" (UID: "c76d40da-6c2a-4cd5-90ea-43bc55021c7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:21:50.512575 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.512546    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-token" (OuterVolumeSpecName: "istio-token") pod "c76d40da-6c2a-4cd5-90ea-43bc55021c7b" (UID: "c76d40da-6c2a-4cd5-90ea-43bc55021c7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:21:50.512575 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.512564    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c76d40da-6c2a-4cd5-90ea-43bc55021c7b" (UID: "c76d40da-6c2a-4cd5-90ea-43bc55021c7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:21:50.512860 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.512842    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-kube-api-access-9sgww" (OuterVolumeSpecName: "kube-api-access-9sgww") pod "c76d40da-6c2a-4cd5-90ea-43bc55021c7b" (UID: "c76d40da-6c2a-4cd5-90ea-43bc55021c7b"). InnerVolumeSpecName "kube-api-access-9sgww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:21:50.512931 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.512887    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c76d40da-6c2a-4cd5-90ea-43bc55021c7b" (UID: "c76d40da-6c2a-4cd5-90ea-43bc55021c7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:21:50.612121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.612086    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-credential-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:50.612121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.612115    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-envoy\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:50.612121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.612124    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-token\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:50.612342 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.612132    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sgww\" (UniqueName: \"kubernetes.io/projected/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-kube-api-access-9sgww\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:50.612342 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.612140    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istio-podinfo\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:50.612342 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.612149    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c76d40da-6c2a-4cd5-90ea-43bc55021c7b-istiod-ca-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:21:50.693524 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.693489    2562 generic.go:356] "Generic (PLEG): container finished" podID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerID="9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a" exitCode=0
Sep 10 16:21:50.693717 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.693535    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"
Sep 10 16:21:50.693717 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.693571    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" event={"ID":"c76d40da-6c2a-4cd5-90ea-43bc55021c7b","Type":"ContainerDied","Data":"9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a"}
Sep 10 16:21:50.693717 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.693620    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z" event={"ID":"c76d40da-6c2a-4cd5-90ea-43bc55021c7b","Type":"ContainerDied","Data":"70b4fceb7e9130e9b82e514a837a9332641204f71ea091ececdcb6473487f06d"}
Sep 10 16:21:50.693717 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.693643    2562 scope.go:117] "RemoveContainer" containerID="9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a"
Sep 10 16:21:50.703487 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.703472    2562 scope.go:117] "RemoveContainer" containerID="8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56"
Sep 10 16:21:50.711429 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.711412    2562 scope.go:117] "RemoveContainer" containerID="9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a"
Sep 10 16:21:50.711695 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:21:50.711674    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a\": container with ID starting with 9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a not found: ID does not exist" containerID="9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a"
Sep 10 16:21:50.711747 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.711704    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a"} err="failed to get container status \"9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a\": rpc error: code = NotFound desc = could not find container \"9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a\": container with ID starting with 9f42cb52a992310c4b816e74fb877690fda41eec5c5264c52f975ad6e110b81a not found: ID does not exist"
Sep 10 16:21:50.711747 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.711720    2562 scope.go:117] "RemoveContainer" containerID="8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56"
Sep 10 16:21:50.712000 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:21:50.711982    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56\": container with ID starting with 8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56 not found: ID does not exist" containerID="8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56"
Sep 10 16:21:50.712035 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.712006    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56"} err="failed to get container status \"8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56\": rpc error: code = NotFound desc = could not find container \"8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56\": container with ID starting with 8b09e889d83bb2a2a46f0c32b8bc867bf00711a9f9f4e93ee2de4936f50ccf56 not found: ID does not exist"
Sep 10 16:21:50.723012 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.722989    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"]
Sep 10 16:21:50.725802 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:50.725784    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0e28e849-openshift-default-55fc46fc8d-7zz8z"]
Sep 10 16:21:52.070938 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:21:52.070901    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" path="/var/lib/kubelet/pods/c76d40da-6c2a-4cd5-90ea-43bc55021c7b/volumes"
Sep 10 16:22:24.022527 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.022494    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"]
Sep 10 16:22:24.023014 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.022999    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001382cd-64f4-47f7-a591-b262c6206dec" containerName="payload-pre-processing"
Sep 10 16:22:24.023078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.023015    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="001382cd-64f4-47f7-a591-b262c6206dec" containerName="payload-pre-processing"
Sep 10 16:22:24.023078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.023025    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4f26ec8-c862-4122-a8a6-93fb69837358" containerName="payload-processing"
Sep 10 16:22:24.023078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.023031    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4f26ec8-c862-4122-a8a6-93fb69837358" containerName="payload-processing"
Sep 10 16:22:24.023078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.023041    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerName="istio-proxy"
Sep 10 16:22:24.023078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.023049    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerName="istio-proxy"
Sep 10 16:22:24.023240 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.023162    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerName="istio-proxy"
Sep 10 16:22:24.023240 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.023172    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerName="istio-proxy"
Sep 10 16:22:24.023240 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.023179    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="001382cd-64f4-47f7-a591-b262c6206dec" containerName="payload-pre-processing"
Sep 10 16:22:24.023240 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.023188    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4f26ec8-c862-4122-a8a6-93fb69837358" containerName="payload-processing"
Sep 10 16:22:24.026210 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.026193    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.029809 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.029785    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-555853\"/\"kube-root-ca.crt\""
Sep 10 16:22:24.030034 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.030015    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-555853\"/\"openshift-service-ca.crt\""
Sep 10 16:22:24.031269 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.031255    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-555853\"/\"default-dockercfg-dpzl8\""
Sep 10 16:22:24.031352 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.031327    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-555853\"/\"explicit-model-555853-kserve-self-signed-certs\""
Sep 10 16:22:24.048365 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.048342    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"]
Sep 10 16:22:24.048658 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.048639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-dshm\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.048717 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.048670    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-home\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.048717 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.048711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9476056c-248d-4f7f-b9e5-d59dbfd313e3-tls-certs\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.048864 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.048842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-tmp-dir\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.048910 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.048896    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-model-cache\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.048951 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.048936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slx4c\" (UniqueName: \"kubernetes.io/projected/9476056c-248d-4f7f-b9e5-d59dbfd313e3-kube-api-access-slx4c\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.149563 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.149525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-home\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.149786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.149591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9476056c-248d-4f7f-b9e5-d59dbfd313e3-tls-certs\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.149786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.149618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-tmp-dir\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.149786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.149646    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-model-cache\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.149786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.149688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slx4c\" (UniqueName: \"kubernetes.io/projected/9476056c-248d-4f7f-b9e5-d59dbfd313e3-kube-api-access-slx4c\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.149786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.149777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-dshm\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.150082 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.150004    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-home\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.150082 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.150059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-model-cache\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.150082 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.150073    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-tmp-dir\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.151993 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.151968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-dshm\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.152119 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.152102    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9476056c-248d-4f7f-b9e5-d59dbfd313e3-tls-certs\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.161187 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.161166    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slx4c\" (UniqueName: \"kubernetes.io/projected/9476056c-248d-4f7f-b9e5-d59dbfd313e3-kube-api-access-slx4c\") pod \"explicit-model-555853-kserve-67fc7f5d99-h6vnk\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") " pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.335639 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.335553    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:24.617125 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.617096    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"]
Sep 10 16:22:24.618654 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:22:24.618628    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9476056c_248d_4f7f_b9e5_d59dbfd313e3.slice/crio-1d3d166736a18055a6e738a98fe9f0f04b705e3b3e27044e1ca0c5a43c925a58 WatchSource:0}: Error finding container 1d3d166736a18055a6e738a98fe9f0f04b705e3b3e27044e1ca0c5a43c925a58: Status 404 returned error can't find the container with id 1d3d166736a18055a6e738a98fe9f0f04b705e3b3e27044e1ca0c5a43c925a58
Sep 10 16:22:24.886543 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.886457    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk" event={"ID":"9476056c-248d-4f7f-b9e5-d59dbfd313e3","Type":"ContainerStarted","Data":"2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c"}
Sep 10 16:22:24.886543 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.886500    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk" event={"ID":"9476056c-248d-4f7f-b9e5-d59dbfd313e3","Type":"ContainerStarted","Data":"1d3d166736a18055a6e738a98fe9f0f04b705e3b3e27044e1ca0c5a43c925a58"}
Sep 10 16:22:24.912107 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:24.912053    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk" podStartSLOduration=1.912036622 podStartE2EDuration="1.912036622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:22:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:22:24.910851263 +0000 UTC m=+1229.322937488" watchObservedRunningTime="2026-09-10 16:22:24.912036622 +0000 UTC m=+1229.324122870"
Sep 10 16:22:27.301559 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:27.301526    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"]
Sep 10 16:22:27.429432 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:27.429400    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz"]
Sep 10 16:22:27.429871 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:27.429855    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerName="istio-proxy"
Sep 10 16:22:27.429934 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:27.429872    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76d40da-6c2a-4cd5-90ea-43bc55021c7b" containerName="istio-proxy"
Sep 10 16:22:27.432170 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:27.432154    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz"
Sep 10 16:22:27.437089 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:27.437068    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l2dj2\""
Sep 10 16:22:27.445398 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:27.445375    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz"]
Sep 10 16:22:27.481804 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:27.481771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a00c1d-115d-4a69-8b71-2d9ac5cefe9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-555853-hhghz\" (UID: \"82a00c1d-115d-4a69-8b71-2d9ac5cefe9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz"
Sep 10 16:22:27.582433 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:27.582353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a00c1d-115d-4a69-8b71-2d9ac5cefe9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-555853-hhghz\" (UID: \"82a00c1d-115d-4a69-8b71-2d9ac5cefe9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz"
Sep 10 16:22:27.583075 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:27.583055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a00c1d-115d-4a69-8b71-2d9ac5cefe9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-555853-hhghz\" (UID: \"82a00c1d-115d-4a69-8b71-2d9ac5cefe9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz"
Sep 10 16:22:27.744012 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:27.743975    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz"
Sep 10 16:22:28.046158 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:28.046127    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz"]
Sep 10 16:22:28.046999 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:22:28.046970    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a00c1d_115d_4a69_8b71_2d9ac5cefe9d.slice/crio-5bf4c28bf48bbe6c4be5349c4a8dc9dc5cab1006985a99394451eb6c6c462cd2 WatchSource:0}: Error finding container 5bf4c28bf48bbe6c4be5349c4a8dc9dc5cab1006985a99394451eb6c6c462cd2: Status 404 returned error can't find the container with id 5bf4c28bf48bbe6c4be5349c4a8dc9dc5cab1006985a99394451eb6c6c462cd2
Sep 10 16:22:28.909772 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:28.909720    2562 generic.go:356] "Generic (PLEG): container finished" podID="82a00c1d-115d-4a69-8b71-2d9ac5cefe9d" containerID="eb735e468337ae186f6813b42fcb859264f0780625d335183352a3277f969f3b" exitCode=0
Sep 10 16:22:28.910143 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:28.909830    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz" event={"ID":"82a00c1d-115d-4a69-8b71-2d9ac5cefe9d","Type":"ContainerDied","Data":"eb735e468337ae186f6813b42fcb859264f0780625d335183352a3277f969f3b"}
Sep 10 16:22:28.910143 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:28.909887    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz" event={"ID":"82a00c1d-115d-4a69-8b71-2d9ac5cefe9d","Type":"ContainerStarted","Data":"5bf4c28bf48bbe6c4be5349c4a8dc9dc5cab1006985a99394451eb6c6c462cd2"}
Sep 10 16:22:30.042925 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.042899    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz"
Sep 10 16:22:30.109338 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.109303    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a00c1d-115d-4a69-8b71-2d9ac5cefe9d-maas-api-service-ca\") pod \"82a00c1d-115d-4a69-8b71-2d9ac5cefe9d\" (UID: \"82a00c1d-115d-4a69-8b71-2d9ac5cefe9d\") "
Sep 10 16:22:30.109706 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.109686    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a00c1d-115d-4a69-8b71-2d9ac5cefe9d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "82a00c1d-115d-4a69-8b71-2d9ac5cefe9d" (UID: "82a00c1d-115d-4a69-8b71-2d9ac5cefe9d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:22:30.210758 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.210660    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a00c1d-115d-4a69-8b71-2d9ac5cefe9d-maas-api-service-ca\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:30.472206 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.472116    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx"]
Sep 10 16:22:30.472604 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.472584    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82a00c1d-115d-4a69-8b71-2d9ac5cefe9d" containerName="revoke-keys"
Sep 10 16:22:30.472604 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.472602    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="82a00c1d-115d-4a69-8b71-2d9ac5cefe9d" containerName="revoke-keys"
Sep 10 16:22:30.472847 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.472714    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="82a00c1d-115d-4a69-8b71-2d9ac5cefe9d" containerName="revoke-keys"
Sep 10 16:22:30.476036 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.476016    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx"
Sep 10 16:22:30.491603 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.491571    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx"]
Sep 10 16:22:30.514272 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.514244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14836812-c61c-4a73-a75c-3a396d490dbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx\" (UID: \"14836812-c61c-4a73-a75c-3a396d490dbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx"
Sep 10 16:22:30.615533 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.615504    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14836812-c61c-4a73-a75c-3a396d490dbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx\" (UID: \"14836812-c61c-4a73-a75c-3a396d490dbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx"
Sep 10 16:22:30.616156 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.616138    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14836812-c61c-4a73-a75c-3a396d490dbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx\" (UID: \"14836812-c61c-4a73-a75c-3a396d490dbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx"
Sep 10 16:22:30.787692 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.787652    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx"
Sep 10 16:22:30.921678 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.921635    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz" event={"ID":"82a00c1d-115d-4a69-8b71-2d9ac5cefe9d","Type":"ContainerDied","Data":"5bf4c28bf48bbe6c4be5349c4a8dc9dc5cab1006985a99394451eb6c6c462cd2"}
Sep 10 16:22:30.921678 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.921681    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz"
Sep 10 16:22:30.921919 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:30.921703    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bf4c28bf48bbe6c4be5349c4a8dc9dc5cab1006985a99394451eb6c6c462cd2"
Sep 10 16:22:31.062017 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:31.061667    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx"]
Sep 10 16:22:31.064414 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:22:31.064385    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14836812_c61c_4a73_a75c_3a396d490dbb.slice/crio-dfe6771b5c106c9e62e11f65f353a3c3fb8838fc3852d185d2d9ce48821ebc3c WatchSource:0}: Error finding container dfe6771b5c106c9e62e11f65f353a3c3fb8838fc3852d185d2d9ce48821ebc3c: Status 404 returned error can't find the container with id dfe6771b5c106c9e62e11f65f353a3c3fb8838fc3852d185d2d9ce48821ebc3c
Sep 10 16:22:31.928841 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:31.928805    2562 generic.go:356] "Generic (PLEG): container finished" podID="14836812-c61c-4a73-a75c-3a396d490dbb" containerID="c3899c8e366bb08e99f0b47d2e625eb66928fb2a18e7c18a4d7b5d0d918cc3be" exitCode=0
Sep 10 16:22:31.929041 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:31.928892    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx" event={"ID":"14836812-c61c-4a73-a75c-3a396d490dbb","Type":"ContainerDied","Data":"c3899c8e366bb08e99f0b47d2e625eb66928fb2a18e7c18a4d7b5d0d918cc3be"}
Sep 10 16:22:31.929041 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:31.928955    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx" event={"ID":"14836812-c61c-4a73-a75c-3a396d490dbb","Type":"ContainerStarted","Data":"dfe6771b5c106c9e62e11f65f353a3c3fb8838fc3852d185d2d9ce48821ebc3c"}
Sep 10 16:22:33.071807 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:33.071778    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx"
Sep 10 16:22:33.138806 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:33.138770    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14836812-c61c-4a73-a75c-3a396d490dbb-maas-api-service-ca\") pod \"14836812-c61c-4a73-a75c-3a396d490dbb\" (UID: \"14836812-c61c-4a73-a75c-3a396d490dbb\") "
Sep 10 16:22:33.139112 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:33.139087    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14836812-c61c-4a73-a75c-3a396d490dbb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "14836812-c61c-4a73-a75c-3a396d490dbb" (UID: "14836812-c61c-4a73-a75c-3a396d490dbb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:22:33.239558 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:33.239532    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14836812-c61c-4a73-a75c-3a396d490dbb-maas-api-service-ca\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:33.941102 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:33.941066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx" event={"ID":"14836812-c61c-4a73-a75c-3a396d490dbb","Type":"ContainerDied","Data":"dfe6771b5c106c9e62e11f65f353a3c3fb8838fc3852d185d2d9ce48821ebc3c"}
Sep 10 16:22:33.941278 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:33.941143    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfe6771b5c106c9e62e11f65f353a3c3fb8838fc3852d185d2d9ce48821ebc3c"
Sep 10 16:22:33.941278 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:33.941080    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx"
Sep 10 16:22:34.336252 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:34.336220    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:38.333779 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.333706    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"]
Sep 10 16:22:38.334301 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.334013    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd" podUID="e3be546f-5cfe-410f-b3e6-ca3e378c6c9a" containerName="payload-processing" containerID="cri-o://39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a" gracePeriod=30
Sep 10 16:22:38.338518 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.338492    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"]
Sep 10 16:22:38.338976 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.338924    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j" podUID="58275423-1ef1-4386-b1d4-2530f989b963" containerName="payload-pre-processing" containerID="cri-o://b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f" gracePeriod=30
Sep 10 16:22:38.563837 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.563796    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz"]
Sep 10 16:22:38.569765 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.569716    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-555853-hhghz"]
Sep 10 16:22:38.625787 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.625762    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"
Sep 10 16:22:38.628436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.628418    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"
Sep 10 16:22:38.693810 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.693777    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv7rv\" (UniqueName: \"kubernetes.io/projected/58275423-1ef1-4386-b1d4-2530f989b963-kube-api-access-fv7rv\") pod \"58275423-1ef1-4386-b1d4-2530f989b963\" (UID: \"58275423-1ef1-4386-b1d4-2530f989b963\") "
Sep 10 16:22:38.693968 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.693818    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58275423-1ef1-4386-b1d4-2530f989b963-plugins-config-volume\") pod \"58275423-1ef1-4386-b1d4-2530f989b963\" (UID: \"58275423-1ef1-4386-b1d4-2530f989b963\") "
Sep 10 16:22:38.693968 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.693897    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtchp\" (UniqueName: \"kubernetes.io/projected/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a-kube-api-access-qtchp\") pod \"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a\" (UID: \"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a\") "
Sep 10 16:22:38.694061 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.693974    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a-plugins-config-volume\") pod \"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a\" (UID: \"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a\") "
Sep 10 16:22:38.694302 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.694274    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58275423-1ef1-4386-b1d4-2530f989b963-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "58275423-1ef1-4386-b1d4-2530f989b963" (UID: "58275423-1ef1-4386-b1d4-2530f989b963"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:22:38.694447 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.694379    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e3be546f-5cfe-410f-b3e6-ca3e378c6c9a" (UID: "e3be546f-5cfe-410f-b3e6-ca3e378c6c9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:22:38.695997 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.695974    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58275423-1ef1-4386-b1d4-2530f989b963-kube-api-access-fv7rv" (OuterVolumeSpecName: "kube-api-access-fv7rv") pod "58275423-1ef1-4386-b1d4-2530f989b963" (UID: "58275423-1ef1-4386-b1d4-2530f989b963"). InnerVolumeSpecName "kube-api-access-fv7rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:22:38.696107 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.696014    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a-kube-api-access-qtchp" (OuterVolumeSpecName: "kube-api-access-qtchp") pod "e3be546f-5cfe-410f-b3e6-ca3e378c6c9a" (UID: "e3be546f-5cfe-410f-b3e6-ca3e378c6c9a"). InnerVolumeSpecName "kube-api-access-qtchp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:22:38.795397 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.795343    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtchp\" (UniqueName: \"kubernetes.io/projected/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a-kube-api-access-qtchp\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:38.795397 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.795389    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:38.795397 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.795399    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv7rv\" (UniqueName: \"kubernetes.io/projected/58275423-1ef1-4386-b1d4-2530f989b963-kube-api-access-fv7rv\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:38.795397 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.795408    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58275423-1ef1-4386-b1d4-2530f989b963-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:38.971181 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.971092    2562 generic.go:356] "Generic (PLEG): container finished" podID="e3be546f-5cfe-410f-b3e6-ca3e378c6c9a" containerID="39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a" exitCode=0
Sep 10 16:22:38.971181 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.971134    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"
Sep 10 16:22:38.971386 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.971171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd" event={"ID":"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a","Type":"ContainerDied","Data":"39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a"}
Sep 10 16:22:38.971386 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.971253    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd" event={"ID":"e3be546f-5cfe-410f-b3e6-ca3e378c6c9a","Type":"ContainerDied","Data":"db90b5dae2d814199e4bd8852153103abb084d3e00c6dee99c9ae5b0009b6c5d"}
Sep 10 16:22:38.971386 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.971285    2562 scope.go:117] "RemoveContainer" containerID="39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a"
Sep 10 16:22:38.972647 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.972620    2562 generic.go:356] "Generic (PLEG): container finished" podID="58275423-1ef1-4386-b1d4-2530f989b963" containerID="b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f" exitCode=0
Sep 10 16:22:38.972778 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.972651    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"
Sep 10 16:22:38.972778 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.972698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j" event={"ID":"58275423-1ef1-4386-b1d4-2530f989b963","Type":"ContainerDied","Data":"b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f"}
Sep 10 16:22:38.972778 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.972762    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j" event={"ID":"58275423-1ef1-4386-b1d4-2530f989b963","Type":"ContainerDied","Data":"a3d5c8fb24cfee8ba482947aed925cfba611736807e40985f39f9bc907889d61"}
Sep 10 16:22:38.981957 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.981934    2562 scope.go:117] "RemoveContainer" containerID="39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a"
Sep 10 16:22:38.982217 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:22:38.982198    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a\": container with ID starting with 39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a not found: ID does not exist" containerID="39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a"
Sep 10 16:22:38.982308 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.982224    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a"} err="failed to get container status \"39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a\": rpc error: code = NotFound desc = could not find container \"39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a\": container with ID starting with 39c38f4a7fc07b7189dd3882cad1a997b1c6f2e8df333875411eb06ba562a80a not found: ID does not exist"
Sep 10 16:22:38.982308 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.982246    2562 scope.go:117] "RemoveContainer" containerID="b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f"
Sep 10 16:22:38.990651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.990632    2562 scope.go:117] "RemoveContainer" containerID="b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f"
Sep 10 16:22:38.990918 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:22:38.990897    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f\": container with ID starting with b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f not found: ID does not exist" containerID="b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f"
Sep 10 16:22:38.990969 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:38.990925    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f"} err="failed to get container status \"b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f\": rpc error: code = NotFound desc = could not find container \"b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f\": container with ID starting with b805e97257ead3196d43adc2e0161b84e05fcfb34862b2d626ce0db1655b970f not found: ID does not exist"
Sep 10 16:22:39.002325 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:39.002304    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"]
Sep 10 16:22:39.011353 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:39.011329    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-555853-7d9875c5c7-chsmd"]
Sep 10 16:22:39.034706 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:39.034682    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"]
Sep 10 16:22:39.043969 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:39.043946    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-555853-5b946d749d-cng4j"]
Sep 10 16:22:40.071375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:40.071342    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58275423-1ef1-4386-b1d4-2530f989b963" path="/var/lib/kubelet/pods/58275423-1ef1-4386-b1d4-2530f989b963/volumes"
Sep 10 16:22:40.071780 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:40.071654    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82a00c1d-115d-4a69-8b71-2d9ac5cefe9d" path="/var/lib/kubelet/pods/82a00c1d-115d-4a69-8b71-2d9ac5cefe9d/volumes"
Sep 10 16:22:40.071986 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:40.071973    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3be546f-5cfe-410f-b3e6-ca3e378c6c9a" path="/var/lib/kubelet/pods/e3be546f-5cfe-410f-b3e6-ca3e378c6c9a/volumes"
Sep 10 16:22:41.386788 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.386755    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"]
Sep 10 16:22:41.387189 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.386993    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf" podUID="841cb63d-1d2f-4056-ab6a-a645ac56ab67" containerName="payload-pre-processing" containerID="cri-o://6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5" gracePeriod=30
Sep 10 16:22:41.644554 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.644482    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx"]
Sep 10 16:22:41.649354 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.649327    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-37c805-f7fzx"]
Sep 10 16:22:41.651068 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.651051    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"
Sep 10 16:22:41.724523 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.724493    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kghcl\" (UniqueName: \"kubernetes.io/projected/841cb63d-1d2f-4056-ab6a-a645ac56ab67-kube-api-access-kghcl\") pod \"841cb63d-1d2f-4056-ab6a-a645ac56ab67\" (UID: \"841cb63d-1d2f-4056-ab6a-a645ac56ab67\") "
Sep 10 16:22:41.724773 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.724595    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/841cb63d-1d2f-4056-ab6a-a645ac56ab67-plugins-config-volume\") pod \"841cb63d-1d2f-4056-ab6a-a645ac56ab67\" (UID: \"841cb63d-1d2f-4056-ab6a-a645ac56ab67\") "
Sep 10 16:22:41.725274 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.725248    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841cb63d-1d2f-4056-ab6a-a645ac56ab67-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "841cb63d-1d2f-4056-ab6a-a645ac56ab67" (UID: "841cb63d-1d2f-4056-ab6a-a645ac56ab67"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:22:41.726816 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.726791    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/841cb63d-1d2f-4056-ab6a-a645ac56ab67-kube-api-access-kghcl" (OuterVolumeSpecName: "kube-api-access-kghcl") pod "841cb63d-1d2f-4056-ab6a-a645ac56ab67" (UID: "841cb63d-1d2f-4056-ab6a-a645ac56ab67"). InnerVolumeSpecName "kube-api-access-kghcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:22:41.825756 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.825699    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/841cb63d-1d2f-4056-ab6a-a645ac56ab67-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:41.825756 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.825758    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kghcl\" (UniqueName: \"kubernetes.io/projected/841cb63d-1d2f-4056-ab6a-a645ac56ab67-kube-api-access-kghcl\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:41.995418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.995384    2562 generic.go:356] "Generic (PLEG): container finished" podID="841cb63d-1d2f-4056-ab6a-a645ac56ab67" containerID="6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5" exitCode=0
Sep 10 16:22:41.995581 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.995430    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"
Sep 10 16:22:41.995581 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.995470    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf" event={"ID":"841cb63d-1d2f-4056-ab6a-a645ac56ab67","Type":"ContainerDied","Data":"6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5"}
Sep 10 16:22:41.995581 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.995524    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf" event={"ID":"841cb63d-1d2f-4056-ab6a-a645ac56ab67","Type":"ContainerDied","Data":"dcad0033d9e026eb2b116f1e91c4d7e38d28c12316b02dc1b51ebea4725cbbcc"}
Sep 10 16:22:41.995581 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:41.995554    2562 scope.go:117] "RemoveContainer" containerID="6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5"
Sep 10 16:22:42.004279 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.004257    2562 scope.go:117] "RemoveContainer" containerID="6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5"
Sep 10 16:22:42.004545 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:22:42.004527    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5\": container with ID starting with 6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5 not found: ID does not exist" containerID="6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5"
Sep 10 16:22:42.004600 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.004552    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5"} err="failed to get container status \"6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5\": rpc error: code = NotFound desc = could not find container \"6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5\": container with ID starting with 6aecd2513786375db09413d11eacc6a337e4f2dd9e23315bd9d8f8ccfc0530d5 not found: ID does not exist"
Sep 10 16:22:42.020617 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.020594    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"]
Sep 10 16:22:42.028898 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.028875    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-37c805-597f5f9cf8-frjwf"]
Sep 10 16:22:42.076461 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.076423    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14836812-c61c-4a73-a75c-3a396d490dbb" path="/var/lib/kubelet/pods/14836812-c61c-4a73-a75c-3a396d490dbb/volumes"
Sep 10 16:22:42.076805 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.076791    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="841cb63d-1d2f-4056-ab6a-a645ac56ab67" path="/var/lib/kubelet/pods/841cb63d-1d2f-4056-ab6a-a645ac56ab67/volumes"
Sep 10 16:22:42.321423 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.321336    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk" podUID="9476056c-248d-4f7f-b9e5-d59dbfd313e3" containerName="main" containerID="cri-o://2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c" gracePeriod=45
Sep 10 16:22:42.577557 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.577488    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:42.734652 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.734621    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9476056c-248d-4f7f-b9e5-d59dbfd313e3-tls-certs\") pod \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") "
Sep 10 16:22:42.734935 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.734661    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-dshm\") pod \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") "
Sep 10 16:22:42.734935 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.734694    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-home\") pod \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") "
Sep 10 16:22:42.734935 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.734798    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slx4c\" (UniqueName: \"kubernetes.io/projected/9476056c-248d-4f7f-b9e5-d59dbfd313e3-kube-api-access-slx4c\") pod \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") "
Sep 10 16:22:42.734935 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.734873    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-tmp-dir\") pod \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") "
Sep 10 16:22:42.734935 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.734915    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-model-cache\") pod \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\" (UID: \"9476056c-248d-4f7f-b9e5-d59dbfd313e3\") "
Sep 10 16:22:42.735187 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.734983    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-home" (OuterVolumeSpecName: "home") pod "9476056c-248d-4f7f-b9e5-d59dbfd313e3" (UID: "9476056c-248d-4f7f-b9e5-d59dbfd313e3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:22:42.735187 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.735152    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9476056c-248d-4f7f-b9e5-d59dbfd313e3" (UID: "9476056c-248d-4f7f-b9e5-d59dbfd313e3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:22:42.735275 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.735235    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-model-cache" (OuterVolumeSpecName: "model-cache") pod "9476056c-248d-4f7f-b9e5-d59dbfd313e3" (UID: "9476056c-248d-4f7f-b9e5-d59dbfd313e3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:22:42.735389 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.735370    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-model-cache\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:42.735436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.735393    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-home\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:42.735436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.735407    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-tmp-dir\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:42.736949 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.736924    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-dshm" (OuterVolumeSpecName: "dshm") pod "9476056c-248d-4f7f-b9e5-d59dbfd313e3" (UID: "9476056c-248d-4f7f-b9e5-d59dbfd313e3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:22:42.737053 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.736950    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9476056c-248d-4f7f-b9e5-d59dbfd313e3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9476056c-248d-4f7f-b9e5-d59dbfd313e3" (UID: "9476056c-248d-4f7f-b9e5-d59dbfd313e3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 16:22:42.737053 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.736983    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9476056c-248d-4f7f-b9e5-d59dbfd313e3-kube-api-access-slx4c" (OuterVolumeSpecName: "kube-api-access-slx4c") pod "9476056c-248d-4f7f-b9e5-d59dbfd313e3" (UID: "9476056c-248d-4f7f-b9e5-d59dbfd313e3"). InnerVolumeSpecName "kube-api-access-slx4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:22:42.836089 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.836000    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9476056c-248d-4f7f-b9e5-d59dbfd313e3-tls-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:42.836089 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.836031    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9476056c-248d-4f7f-b9e5-d59dbfd313e3-dshm\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:42.836089 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:42.836040    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slx4c\" (UniqueName: \"kubernetes.io/projected/9476056c-248d-4f7f-b9e5-d59dbfd313e3-kube-api-access-slx4c\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:43.003926 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:43.003892    2562 generic.go:356] "Generic (PLEG): container finished" podID="9476056c-248d-4f7f-b9e5-d59dbfd313e3" containerID="2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c" exitCode=0
Sep 10 16:22:43.004168 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:43.003937    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"
Sep 10 16:22:43.004168 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:43.003988    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk" event={"ID":"9476056c-248d-4f7f-b9e5-d59dbfd313e3","Type":"ContainerDied","Data":"2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c"}
Sep 10 16:22:43.004168 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:43.004016    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk" event={"ID":"9476056c-248d-4f7f-b9e5-d59dbfd313e3","Type":"ContainerDied","Data":"1d3d166736a18055a6e738a98fe9f0f04b705e3b3e27044e1ca0c5a43c925a58"}
Sep 10 16:22:43.004168 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:43.004038    2562 scope.go:117] "RemoveContainer" containerID="2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c"
Sep 10 16:22:43.014021 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:43.014000    2562 scope.go:117] "RemoveContainer" containerID="2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c"
Sep 10 16:22:43.014370 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:22:43.014347    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c\": container with ID starting with 2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c not found: ID does not exist" containerID="2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c"
Sep 10 16:22:43.014451 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:43.014378    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c"} err="failed to get container status \"2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c\": rpc error: code = NotFound desc = could not find container \"2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c\": container with ID starting with 2af7defb73b4f00f3931a56ef8bd909887c78d488734bed15e174858fa74f16c not found: ID does not exist"
Sep 10 16:22:43.041786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:43.041748    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"]
Sep 10 16:22:43.049503 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:43.049468    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-555853/explicit-model-555853-kserve-67fc7f5d99-h6vnk"]
Sep 10 16:22:44.070424 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:44.070385    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9476056c-248d-4f7f-b9e5-d59dbfd313e3" path="/var/lib/kubelet/pods/9476056c-248d-4f7f-b9e5-d59dbfd313e3/volumes"
Sep 10 16:22:47.238998 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.238962    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"]
Sep 10 16:22:47.239635 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239577    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3be546f-5cfe-410f-b3e6-ca3e378c6c9a" containerName="payload-processing"
Sep 10 16:22:47.239635 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239591    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3be546f-5cfe-410f-b3e6-ca3e378c6c9a" containerName="payload-processing"
Sep 10 16:22:47.239635 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239613    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58275423-1ef1-4386-b1d4-2530f989b963" containerName="payload-pre-processing"
Sep 10 16:22:47.239635 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239622    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="58275423-1ef1-4386-b1d4-2530f989b963" containerName="payload-pre-processing"
Sep 10 16:22:47.239967 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239641    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841cb63d-1d2f-4056-ab6a-a645ac56ab67" containerName="payload-pre-processing"
Sep 10 16:22:47.239967 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239651    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="841cb63d-1d2f-4056-ab6a-a645ac56ab67" containerName="payload-pre-processing"
Sep 10 16:22:47.239967 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239674    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9476056c-248d-4f7f-b9e5-d59dbfd313e3" containerName="main"
Sep 10 16:22:47.239967 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239682    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9476056c-248d-4f7f-b9e5-d59dbfd313e3" containerName="main"
Sep 10 16:22:47.239967 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239696    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14836812-c61c-4a73-a75c-3a396d490dbb" containerName="revoke-keys"
Sep 10 16:22:47.239967 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239704    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="14836812-c61c-4a73-a75c-3a396d490dbb" containerName="revoke-keys"
Sep 10 16:22:47.239967 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239807    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9476056c-248d-4f7f-b9e5-d59dbfd313e3" containerName="main"
Sep 10 16:22:47.239967 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239819    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="841cb63d-1d2f-4056-ab6a-a645ac56ab67" containerName="payload-pre-processing"
Sep 10 16:22:47.239967 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239834    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="58275423-1ef1-4386-b1d4-2530f989b963" containerName="payload-pre-processing"
Sep 10 16:22:47.239967 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239843    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="14836812-c61c-4a73-a75c-3a396d490dbb" containerName="revoke-keys"
Sep 10 16:22:47.239967 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.239853    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3be546f-5cfe-410f-b3e6-ca3e378c6c9a" containerName="payload-processing"
Sep 10 16:22:47.244868 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.244840    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.248934 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.248908    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-664dc8-openshift-default-dockercfg-bqkmn\""
Sep 10 16:22:47.267631 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.267600    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"]
Sep 10 16:22:47.384837 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.384801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f88960d-1897-4c06-bff2-4569858f2457-istiod-ca-cert\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.385019 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.384860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f88960d-1897-4c06-bff2-4569858f2457-istio-token\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.385019 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.384888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-workload-socket\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.385019 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.384923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f88960d-1897-4c06-bff2-4569858f2457-istio-podinfo\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.385019 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.384957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-workload-certs\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.385019 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.384990    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-credential-socket\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.385019 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.385004    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-istio-envoy\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.385225 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.385055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-istio-data\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.385225 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.385150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wrgk\" (UniqueName: \"kubernetes.io/projected/4f88960d-1897-4c06-bff2-4569858f2457-kube-api-access-6wrgk\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.486576 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.486536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f88960d-1897-4c06-bff2-4569858f2457-istio-token\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.486576 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.486581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-workload-socket\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.486877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.486603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f88960d-1897-4c06-bff2-4569858f2457-istio-podinfo\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.486877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.486639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-workload-certs\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.486877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.486665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-credential-socket\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.486877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.486679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-istio-envoy\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.486877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.486694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-istio-data\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.486877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.486769    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wrgk\" (UniqueName: \"kubernetes.io/projected/4f88960d-1897-4c06-bff2-4569858f2457-kube-api-access-6wrgk\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.486877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.486836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f88960d-1897-4c06-bff2-4569858f2457-istiod-ca-cert\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.487240 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.487043    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-workload-socket\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.487240 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.487086    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-workload-certs\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.487240 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.487106    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-credential-socket\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.487396 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.487268    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-istio-data\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.487509 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.487488    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f88960d-1897-4c06-bff2-4569858f2457-istiod-ca-cert\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.489255 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.489197    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-istio-envoy\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.489427 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.489411    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f88960d-1897-4c06-bff2-4569858f2457-istio-podinfo\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.498355 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.498332    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f88960d-1897-4c06-bff2-4569858f2457-istio-token\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.498450 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.498422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wrgk\" (UniqueName: \"kubernetes.io/projected/4f88960d-1897-4c06-bff2-4569858f2457-kube-api-access-6wrgk\") pod \"e2e-noten-664dc8-openshift-default-c494fd898-tzbjk\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") " pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.556243 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.556203    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:47.838899 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.838871    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"]
Sep 10 16:22:47.841092 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:22:47.841059    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f88960d_1897_4c06_bff2_4569858f2457.slice/crio-959f5f6c7bddb2732aa1e7fde691219bafa057b36b33a178bb011bb49b2b1821 WatchSource:0}: Error finding container 959f5f6c7bddb2732aa1e7fde691219bafa057b36b33a178bb011bb49b2b1821: Status 404 returned error can't find the container with id 959f5f6c7bddb2732aa1e7fde691219bafa057b36b33a178bb011bb49b2b1821
Sep 10 16:22:47.843397 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.843362    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:22:47.843497 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.843430    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:22:47.843497 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:47.843457    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:22:48.035686 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:48.035581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk" event={"ID":"4f88960d-1897-4c06-bff2-4569858f2457","Type":"ContainerStarted","Data":"64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071"}
Sep 10 16:22:48.035686 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:48.035685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk" event={"ID":"4f88960d-1897-4c06-bff2-4569858f2457","Type":"ContainerStarted","Data":"959f5f6c7bddb2732aa1e7fde691219bafa057b36b33a178bb011bb49b2b1821"}
Sep 10 16:22:48.062315 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:48.062254    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk" podStartSLOduration=1.062237038 podStartE2EDuration="1.062237038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:22:48.058611288 +0000 UTC m=+1252.470697498" watchObservedRunningTime="2026-09-10 16:22:48.062237038 +0000 UTC m=+1252.474323247"
Sep 10 16:22:48.556559 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:48.556518    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:48.561750 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:48.561697    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:49.040952 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:49.040919    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:49.042131 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:49.042109    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:22:49.991596 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:49.991558    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"]
Sep 10 16:22:49.992101 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:49.991850    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy" containerID="cri-o://b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347" gracePeriod=30
Sep 10 16:22:50.352261 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:50.352182    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp"]
Sep 10 16:22:50.356169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:50.356150    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp"
Sep 10 16:22:50.359816 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:50.359793    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l2dj2\""
Sep 10 16:22:50.378318 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:50.378285    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp"]
Sep 10 16:22:50.521954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:50.521912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9333b99-e6f4-4a74-847c-8490808e1e25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp\" (UID: \"e9333b99-e6f4-4a74-847c-8490808e1e25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp"
Sep 10 16:22:50.623453 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:50.623351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9333b99-e6f4-4a74-847c-8490808e1e25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp\" (UID: \"e9333b99-e6f4-4a74-847c-8490808e1e25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp"
Sep 10 16:22:50.624044 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:50.624022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9333b99-e6f4-4a74-847c-8490808e1e25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp\" (UID: \"e9333b99-e6f4-4a74-847c-8490808e1e25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp"
Sep 10 16:22:50.666421 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:50.666377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp"
Sep 10 16:22:50.952636 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:50.952605    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp"]
Sep 10 16:22:50.953635 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:22:50.953610    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9333b99_e6f4_4a74_847c_8490808e1e25.slice/crio-81fb39fc70a304db509f81a78530a8f09cd98cea0e78b030eb1d70c1923383a9 WatchSource:0}: Error finding container 81fb39fc70a304db509f81a78530a8f09cd98cea0e78b030eb1d70c1923383a9: Status 404 returned error can't find the container with id 81fb39fc70a304db509f81a78530a8f09cd98cea0e78b030eb1d70c1923383a9
Sep 10 16:22:51.053028 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:51.052994    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp" event={"ID":"e9333b99-e6f4-4a74-847c-8490808e1e25","Type":"ContainerStarted","Data":"81fb39fc70a304db509f81a78530a8f09cd98cea0e78b030eb1d70c1923383a9"}
Sep 10 16:22:52.060000 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:52.059961    2562 generic.go:356] "Generic (PLEG): container finished" podID="e9333b99-e6f4-4a74-847c-8490808e1e25" containerID="a727506ec83c2a2d16bbac9f248136ccfcf601b2368204dd2d6a75fe33311488" exitCode=0
Sep 10 16:22:52.060414 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:52.060047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp" event={"ID":"e9333b99-e6f4-4a74-847c-8490808e1e25","Type":"ContainerDied","Data":"a727506ec83c2a2d16bbac9f248136ccfcf601b2368204dd2d6a75fe33311488"}
Sep 10 16:22:53.203702 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:53.203666    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp"
Sep 10 16:22:53.353005 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:53.352915    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9333b99-e6f4-4a74-847c-8490808e1e25-maas-api-service-ca\") pod \"e9333b99-e6f4-4a74-847c-8490808e1e25\" (UID: \"e9333b99-e6f4-4a74-847c-8490808e1e25\") "
Sep 10 16:22:53.353338 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:53.353310    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9333b99-e6f4-4a74-847c-8490808e1e25-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9333b99-e6f4-4a74-847c-8490808e1e25" (UID: "e9333b99-e6f4-4a74-847c-8490808e1e25"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:22:53.353395 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:53.353381    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9333b99-e6f4-4a74-847c-8490808e1e25-maas-api-service-ca\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:54.072364 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:54.072338    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp"
Sep 10 16:22:54.072364 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:54.072353    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp" event={"ID":"e9333b99-e6f4-4a74-847c-8490808e1e25","Type":"ContainerDied","Data":"81fb39fc70a304db509f81a78530a8f09cd98cea0e78b030eb1d70c1923383a9"}
Sep 10 16:22:54.072607 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:54.072401    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81fb39fc70a304db509f81a78530a8f09cd98cea0e78b030eb1d70c1923383a9"
Sep 10 16:22:55.239257 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.239231    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:22:55.271093 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.270962    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-token\") pod \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") "
Sep 10 16:22:55.271093 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.271031    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-podinfo\") pod \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") "
Sep 10 16:22:55.271093 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.271072    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istiod-ca-cert\") pod \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") "
Sep 10 16:22:55.271378 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.271152    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-workload-certs\") pod \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") "
Sep 10 16:22:55.271378 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.271210    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htn59\" (UniqueName: \"kubernetes.io/projected/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-kube-api-access-htn59\") pod \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") "
Sep 10 16:22:55.271378 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.271244    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-envoy\") pod \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") "
Sep 10 16:22:55.271378 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.271278    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-credential-socket\") pod \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") "
Sep 10 16:22:55.271378 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.271320    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-workload-socket\") pod \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") "
Sep 10 16:22:55.271378 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.271344    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-data\") pod \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\" (UID: \"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0\") "
Sep 10 16:22:55.271906 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.271877    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" (UID: "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:22:55.272460 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.272426    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" (UID: "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:22:55.272662 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.272639    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" (UID: "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:22:55.273555 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.273351    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" (UID: "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:22:55.273555 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.273521    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" (UID: "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:22:55.275178 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.274872    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" (UID: "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:22:55.275178 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.275073    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" (UID: "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:22:55.275364 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.275288    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-kube-api-access-htn59" (OuterVolumeSpecName: "kube-api-access-htn59") pod "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" (UID: "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0"). InnerVolumeSpecName "kube-api-access-htn59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:22:55.275497 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.275478    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" (UID: "4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:22:55.372199 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.372164    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-workload-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:55.372199 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.372196    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htn59\" (UniqueName: \"kubernetes.io/projected/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-kube-api-access-htn59\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:55.372401 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.372209    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-envoy\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:55.372401 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.372221    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-credential-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:55.372401 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.372232    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-workload-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:55.372401 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.372242    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-data\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:55.372401 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.372253    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-token\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:55.372401 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.372264    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istio-podinfo\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:55.372401 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:55.372274    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0-istiod-ca-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:22:56.084680 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:56.084650    2562 generic.go:356] "Generic (PLEG): container finished" podID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerID="b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347" exitCode=0
Sep 10 16:22:56.084850 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:56.084698    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"
Sep 10 16:22:56.084850 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:56.084751    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" event={"ID":"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0","Type":"ContainerDied","Data":"b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347"}
Sep 10 16:22:56.084850 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:56.084814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57" event={"ID":"4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0","Type":"ContainerDied","Data":"13db80a0429c2e3a30184dd3cfaf53a89ed791e721251cf8a17b61639d1f69f8"}
Sep 10 16:22:56.084850 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:56.084843    2562 scope.go:117] "RemoveContainer" containerID="b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347"
Sep 10 16:22:56.093914 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:56.093895    2562 scope.go:117] "RemoveContainer" containerID="409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f"
Sep 10 16:22:56.102107 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:56.102090    2562 scope.go:117] "RemoveContainer" containerID="b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347"
Sep 10 16:22:56.102395 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:22:56.102373    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347\": container with ID starting with b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347 not found: ID does not exist" containerID="b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347"
Sep 10 16:22:56.102489 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:56.102402    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347"} err="failed to get container status \"b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347\": rpc error: code = NotFound desc = could not find container \"b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347\": container with ID starting with b382da2f3ba05c3b6d064e9d18172c01a54855ca73016b60c1e6a5b20baff347 not found: ID does not exist"
Sep 10 16:22:56.102489 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:56.102420    2562 scope.go:117] "RemoveContainer" containerID="409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f"
Sep 10 16:22:56.102673 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:22:56.102654    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f\": container with ID starting with 409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f not found: ID does not exist" containerID="409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f"
Sep 10 16:22:56.102714 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:56.102678    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f"} err="failed to get container status \"409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f\": rpc error: code = NotFound desc = could not find container \"409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f\": container with ID starting with 409c04f44dcf2e35b12c7175ba943860d4661fcb0bbea34a797d7ef6915db85f not found: ID does not exist"
Sep 10 16:22:56.115179 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:56.115155    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"]
Sep 10 16:22:56.123387 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:56.123364    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-37c805-openshift-default-599cdfb67d-b8c57"]
Sep 10 16:22:58.070881 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:22:58.070843    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" path="/var/lib/kubelet/pods/4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0/volumes"
Sep 10 16:23:01.387428 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:01.387391    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp"]
Sep 10 16:23:01.395631 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:01.395607    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e22c72-z74xp"]
Sep 10 16:23:02.070450 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:02.070416    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9333b99-e6f4-4a74-847c-8490808e1e25" path="/var/lib/kubelet/pods/e9333b99-e6f4-4a74-847c-8490808e1e25/volumes"
Sep 10 16:23:08.557662 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:08.557623    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"]
Sep 10 16:23:08.558185 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:08.557875    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy" containerID="cri-o://3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57" gracePeriod=30
Sep 10 16:23:13.808372 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.808348    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:23:13.957767 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.957663    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-workload-socket\") pod \"e9a67318-10bd-4607-a2b1-be4627ac01e4\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") "
Sep 10 16:23:13.957767 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.957710    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-token\") pod \"e9a67318-10bd-4607-a2b1-be4627ac01e4\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") "
Sep 10 16:23:13.957977 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.957799    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9a67318-10bd-4607-a2b1-be4627ac01e4-istiod-ca-cert\") pod \"e9a67318-10bd-4607-a2b1-be4627ac01e4\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") "
Sep 10 16:23:13.957977 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.957834    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-envoy\") pod \"e9a67318-10bd-4607-a2b1-be4627ac01e4\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") "
Sep 10 16:23:13.957977 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.957863    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-podinfo\") pod \"e9a67318-10bd-4607-a2b1-be4627ac01e4\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") "
Sep 10 16:23:13.957977 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.957890    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-data\") pod \"e9a67318-10bd-4607-a2b1-be4627ac01e4\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") "
Sep 10 16:23:13.957977 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.957919    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-credential-socket\") pod \"e9a67318-10bd-4607-a2b1-be4627ac01e4\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") "
Sep 10 16:23:13.957977 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.957951    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e9a67318-10bd-4607-a2b1-be4627ac01e4" (UID: "e9a67318-10bd-4607-a2b1-be4627ac01e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:23:13.958292 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.958015    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h62lm\" (UniqueName: \"kubernetes.io/projected/e9a67318-10bd-4607-a2b1-be4627ac01e4-kube-api-access-h62lm\") pod \"e9a67318-10bd-4607-a2b1-be4627ac01e4\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") "
Sep 10 16:23:13.958292 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.958067    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-workload-certs\") pod \"e9a67318-10bd-4607-a2b1-be4627ac01e4\" (UID: \"e9a67318-10bd-4607-a2b1-be4627ac01e4\") "
Sep 10 16:23:13.958292 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.958215    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "e9a67318-10bd-4607-a2b1-be4627ac01e4" (UID: "e9a67318-10bd-4607-a2b1-be4627ac01e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:23:13.958292 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.958244    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9a67318-10bd-4607-a2b1-be4627ac01e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e9a67318-10bd-4607-a2b1-be4627ac01e4" (UID: "e9a67318-10bd-4607-a2b1-be4627ac01e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:23:13.958491 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.958470    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e9a67318-10bd-4607-a2b1-be4627ac01e4" (UID: "e9a67318-10bd-4607-a2b1-be4627ac01e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:23:13.958544 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.958487    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e9a67318-10bd-4607-a2b1-be4627ac01e4" (UID: "e9a67318-10bd-4607-a2b1-be4627ac01e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:23:13.958663 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.958645    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-workload-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:13.958663 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.958663    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9a67318-10bd-4607-a2b1-be4627ac01e4-istiod-ca-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:13.958790 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.958672    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-data\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:13.958790 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.958680    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-credential-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:13.958790 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.958692    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-workload-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:13.960540 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.960511    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e9a67318-10bd-4607-a2b1-be4627ac01e4" (UID: "e9a67318-10bd-4607-a2b1-be4627ac01e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:23:13.960540 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.960520    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9a67318-10bd-4607-a2b1-be4627ac01e4-kube-api-access-h62lm" (OuterVolumeSpecName: "kube-api-access-h62lm") pod "e9a67318-10bd-4607-a2b1-be4627ac01e4" (UID: "e9a67318-10bd-4607-a2b1-be4627ac01e4"). InnerVolumeSpecName "kube-api-access-h62lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:23:13.960676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.960542    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "e9a67318-10bd-4607-a2b1-be4627ac01e4" (UID: "e9a67318-10bd-4607-a2b1-be4627ac01e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:23:13.960676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:13.960546    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e9a67318-10bd-4607-a2b1-be4627ac01e4" (UID: "e9a67318-10bd-4607-a2b1-be4627ac01e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:23:14.060313 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.060281    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-envoy\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:14.060313 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.060310    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-podinfo\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:14.060313 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.060319    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h62lm\" (UniqueName: \"kubernetes.io/projected/e9a67318-10bd-4607-a2b1-be4627ac01e4-kube-api-access-h62lm\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:14.060539 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.060328    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9a67318-10bd-4607-a2b1-be4627ac01e4-istio-token\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:14.184118 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.184084    2562 generic.go:356] "Generic (PLEG): container finished" podID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerID="3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57" exitCode=0
Sep 10 16:23:14.184297 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.184158    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"
Sep 10 16:23:14.184297 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.184169    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" event={"ID":"e9a67318-10bd-4607-a2b1-be4627ac01e4","Type":"ContainerDied","Data":"3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57"}
Sep 10 16:23:14.184297 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.184240    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c" event={"ID":"e9a67318-10bd-4607-a2b1-be4627ac01e4","Type":"ContainerDied","Data":"84189427fa6a1cb64a4f74685f8b08d084245de9148fd6084c824b4fae037044"}
Sep 10 16:23:14.184297 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.184272    2562 scope.go:117] "RemoveContainer" containerID="3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57"
Sep 10 16:23:14.194921 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.194880    2562 scope.go:117] "RemoveContainer" containerID="52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540"
Sep 10 16:23:14.204022 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.204001    2562 scope.go:117] "RemoveContainer" containerID="3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57"
Sep 10 16:23:14.204351 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:23:14.204326    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57\": container with ID starting with 3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57 not found: ID does not exist" containerID="3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57"
Sep 10 16:23:14.204420 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.204361    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57"} err="failed to get container status \"3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57\": rpc error: code = NotFound desc = could not find container \"3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57\": container with ID starting with 3cdaab29db7b479c1a330466040be3270dacd517f34cb22ec255745b8871eb57 not found: ID does not exist"
Sep 10 16:23:14.204420 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.204381    2562 scope.go:117] "RemoveContainer" containerID="52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540"
Sep 10 16:23:14.204674 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:23:14.204646    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540\": container with ID starting with 52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540 not found: ID does not exist" containerID="52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540"
Sep 10 16:23:14.204748 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.204680    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540"} err="failed to get container status \"52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540\": rpc error: code = NotFound desc = could not find container \"52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540\": container with ID starting with 52bbc37fae024d788b4a7ee510116d74049ca6309cc0dee7d8f3fd4a1eb0c540 not found: ID does not exist"
Sep 10 16:23:14.221834 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.221753    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"]
Sep 10 16:23:14.236884 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.236853    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e22c72-openshift-default-7c4b4f5b8b-5nx9c"]
Sep 10 16:23:14.932586 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.932555    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"]
Sep 10 16:23:14.933044 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.933030    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9333b99-e6f4-4a74-847c-8490808e1e25" containerName="revoke-keys"
Sep 10 16:23:14.933044 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.933045    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9333b99-e6f4-4a74-847c-8490808e1e25" containerName="revoke-keys"
Sep 10 16:23:14.933169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.933055    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy"
Sep 10 16:23:14.933169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.933061    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy"
Sep 10 16:23:14.933169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.933068    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy"
Sep 10 16:23:14.933169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.933074    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy"
Sep 10 16:23:14.933169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.933082    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy"
Sep 10 16:23:14.933169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.933087    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy"
Sep 10 16:23:14.933169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.933150    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy"
Sep 10 16:23:14.933169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.933158    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy"
Sep 10 16:23:14.933169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.933164    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" containerName="istio-proxy"
Sep 10 16:23:14.933169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.933172    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9333b99-e6f4-4a74-847c-8490808e1e25" containerName="revoke-keys"
Sep 10 16:23:14.936256 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.936229    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"
Sep 10 16:23:14.938991 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.938969    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-219fd6\""
Sep 10 16:23:14.949563 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.949539    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"]
Sep 10 16:23:14.960357 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.960327    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"]
Sep 10 16:23:14.960794 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.960779    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy"
Sep 10 16:23:14.960845 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.960795    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy"
Sep 10 16:23:14.960888 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.960863    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e7e7dd7-b9e2-4b6d-bf39-32068aa236b0" containerName="istio-proxy"
Sep 10 16:23:14.964052 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.964034    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"
Sep 10 16:23:14.966949 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.966931    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-219fd6-dockercfg-brhc2\""
Sep 10 16:23:14.979290 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:14.979266    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"]
Sep 10 16:23:15.071587 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.071552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hfwr\" (UniqueName: \"kubernetes.io/projected/2611a2f8-e770-4949-bacd-6ff069533469-kube-api-access-2hfwr\") pod \"payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c\" (UID: \"2611a2f8-e770-4949-bacd-6ff069533469\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"
Sep 10 16:23:15.071823 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.071596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c08cdca-82fc-4bf6-bff8-f691de4280c3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn\" (UID: \"5c08cdca-82fc-4bf6-bff8-f691de4280c3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"
Sep 10 16:23:15.071823 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.071706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9cjm\" (UniqueName: \"kubernetes.io/projected/5c08cdca-82fc-4bf6-bff8-f691de4280c3-kube-api-access-k9cjm\") pod \"payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn\" (UID: \"5c08cdca-82fc-4bf6-bff8-f691de4280c3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"
Sep 10 16:23:15.071969 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.071849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2611a2f8-e770-4949-bacd-6ff069533469-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c\" (UID: \"2611a2f8-e770-4949-bacd-6ff069533469\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"
Sep 10 16:23:15.173210 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.173174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2611a2f8-e770-4949-bacd-6ff069533469-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c\" (UID: \"2611a2f8-e770-4949-bacd-6ff069533469\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"
Sep 10 16:23:15.173394 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.173315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hfwr\" (UniqueName: \"kubernetes.io/projected/2611a2f8-e770-4949-bacd-6ff069533469-kube-api-access-2hfwr\") pod \"payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c\" (UID: \"2611a2f8-e770-4949-bacd-6ff069533469\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"
Sep 10 16:23:15.173394 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.173341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c08cdca-82fc-4bf6-bff8-f691de4280c3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn\" (UID: \"5c08cdca-82fc-4bf6-bff8-f691de4280c3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"
Sep 10 16:23:15.173394 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.173378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9cjm\" (UniqueName: \"kubernetes.io/projected/5c08cdca-82fc-4bf6-bff8-f691de4280c3-kube-api-access-k9cjm\") pod \"payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn\" (UID: \"5c08cdca-82fc-4bf6-bff8-f691de4280c3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"
Sep 10 16:23:15.173945 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.173924    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2611a2f8-e770-4949-bacd-6ff069533469-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c\" (UID: \"2611a2f8-e770-4949-bacd-6ff069533469\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"
Sep 10 16:23:15.174113 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.174093    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c08cdca-82fc-4bf6-bff8-f691de4280c3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn\" (UID: \"5c08cdca-82fc-4bf6-bff8-f691de4280c3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"
Sep 10 16:23:15.186361 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.186296    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hfwr\" (UniqueName: \"kubernetes.io/projected/2611a2f8-e770-4949-bacd-6ff069533469-kube-api-access-2hfwr\") pod \"payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c\" (UID: \"2611a2f8-e770-4949-bacd-6ff069533469\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"
Sep 10 16:23:15.186746 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.186704    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9cjm\" (UniqueName: \"kubernetes.io/projected/5c08cdca-82fc-4bf6-bff8-f691de4280c3-kube-api-access-k9cjm\") pod \"payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn\" (UID: \"5c08cdca-82fc-4bf6-bff8-f691de4280c3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"
Sep 10 16:23:15.251315 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.251281    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"
Sep 10 16:23:15.274510 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.274482    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"
Sep 10 16:23:15.534408 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.534353    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"]
Sep 10 16:23:15.536716 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:23:15.536690    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2611a2f8_e770_4949_bacd_6ff069533469.slice/crio-7fd178de287c81f9209d3a38e3c2b268840c270db6e6e5bd0d9deb24c577a993 WatchSource:0}: Error finding container 7fd178de287c81f9209d3a38e3c2b268840c270db6e6e5bd0d9deb24c577a993: Status 404 returned error can't find the container with id 7fd178de287c81f9209d3a38e3c2b268840c270db6e6e5bd0d9deb24c577a993
Sep 10 16:23:15.564683 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:15.564659    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"]
Sep 10 16:23:15.570946 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:23:15.570922    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c08cdca_82fc_4bf6_bff8_f691de4280c3.slice/crio-4e3599c4cd0e34c3b1459f904455a9d129ba0e8b054ab34b9178d6f7ab594d16 WatchSource:0}: Error finding container 4e3599c4cd0e34c3b1459f904455a9d129ba0e8b054ab34b9178d6f7ab594d16: Status 404 returned error can't find the container with id 4e3599c4cd0e34c3b1459f904455a9d129ba0e8b054ab34b9178d6f7ab594d16
Sep 10 16:23:16.074559 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:16.074516    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9a67318-10bd-4607-a2b1-be4627ac01e4" path="/var/lib/kubelet/pods/e9a67318-10bd-4607-a2b1-be4627ac01e4/volumes"
Sep 10 16:23:16.200100 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:16.200058    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c" event={"ID":"2611a2f8-e770-4949-bacd-6ff069533469","Type":"ContainerStarted","Data":"e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5"}
Sep 10 16:23:16.200265 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:16.200134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c" event={"ID":"2611a2f8-e770-4949-bacd-6ff069533469","Type":"ContainerStarted","Data":"7fd178de287c81f9209d3a38e3c2b268840c270db6e6e5bd0d9deb24c577a993"}
Sep 10 16:23:16.200265 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:16.200162    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"
Sep 10 16:23:16.201517 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:16.201494    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn" event={"ID":"5c08cdca-82fc-4bf6-bff8-f691de4280c3","Type":"ContainerStarted","Data":"f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4"}
Sep 10 16:23:16.201606 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:16.201540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn" event={"ID":"5c08cdca-82fc-4bf6-bff8-f691de4280c3","Type":"ContainerStarted","Data":"4e3599c4cd0e34c3b1459f904455a9d129ba0e8b054ab34b9178d6f7ab594d16"}
Sep 10 16:23:16.201663 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:16.201625    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"
Sep 10 16:23:16.224808 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:16.224759    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c" podStartSLOduration=2.224743344 podStartE2EDuration="2.224743344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:23:16.22002467 +0000 UTC m=+1280.632110880" watchObservedRunningTime="2026-09-10 16:23:16.224743344 +0000 UTC m=+1280.636829550"
Sep 10 16:23:16.245026 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:16.244958    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn" podStartSLOduration=2.244934296 podStartE2EDuration="2.244934296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:23:16.242194147 +0000 UTC m=+1280.654280359" watchObservedRunningTime="2026-09-10 16:23:16.244934296 +0000 UTC m=+1280.657020506"
Sep 10 16:23:18.656680 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:18.656645    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"]
Sep 10 16:23:18.657204 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:18.656897    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk" podUID="4f88960d-1897-4c06-bff2-4569858f2457" containerName="istio-proxy" containerID="cri-o://64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071" gracePeriod=30
Sep 10 16:23:19.043824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:19.043785    2562 patch_prober.go:28] interesting pod/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 16:23:19.043997 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:19.043856    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk" podUID="4f88960d-1897-4c06-bff2-4569858f2457" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 16:23:23.911806 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:23.911779    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:23:24.066252 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.066215    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wrgk\" (UniqueName: \"kubernetes.io/projected/4f88960d-1897-4c06-bff2-4569858f2457-kube-api-access-6wrgk\") pod \"4f88960d-1897-4c06-bff2-4569858f2457\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") "
Sep 10 16:23:24.066252 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.066253    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f88960d-1897-4c06-bff2-4569858f2457-istiod-ca-cert\") pod \"4f88960d-1897-4c06-bff2-4569858f2457\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") "
Sep 10 16:23:24.066528 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.066307    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f88960d-1897-4c06-bff2-4569858f2457-istio-podinfo\") pod \"4f88960d-1897-4c06-bff2-4569858f2457\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") "
Sep 10 16:23:24.066528 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.066329    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-istio-envoy\") pod \"4f88960d-1897-4c06-bff2-4569858f2457\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") "
Sep 10 16:23:24.066528 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.066368    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f88960d-1897-4c06-bff2-4569858f2457-istio-token\") pod \"4f88960d-1897-4c06-bff2-4569858f2457\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") "
Sep 10 16:23:24.066528 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.066459    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-istio-data\") pod \"4f88960d-1897-4c06-bff2-4569858f2457\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") "
Sep 10 16:23:24.066528 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.066496    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-workload-certs\") pod \"4f88960d-1897-4c06-bff2-4569858f2457\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") "
Sep 10 16:23:24.066821 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.066535    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-workload-socket\") pod \"4f88960d-1897-4c06-bff2-4569858f2457\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") "
Sep 10 16:23:24.066821 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.066581    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-credential-socket\") pod \"4f88960d-1897-4c06-bff2-4569858f2457\" (UID: \"4f88960d-1897-4c06-bff2-4569858f2457\") "
Sep 10 16:23:24.066821 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.066786    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f88960d-1897-4c06-bff2-4569858f2457-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f88960d-1897-4c06-bff2-4569858f2457" (UID: "4f88960d-1897-4c06-bff2-4569858f2457"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:23:24.067232 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.067005    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f88960d-1897-4c06-bff2-4569858f2457" (UID: "4f88960d-1897-4c06-bff2-4569858f2457"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:23:24.067232 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.067054    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f88960d-1897-4c06-bff2-4569858f2457-istiod-ca-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:24.067232 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.067185    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f88960d-1897-4c06-bff2-4569858f2457" (UID: "4f88960d-1897-4c06-bff2-4569858f2457"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:23:24.067232 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.067208    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f88960d-1897-4c06-bff2-4569858f2457" (UID: "4f88960d-1897-4c06-bff2-4569858f2457"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:23:24.068623 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.068596    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f88960d-1897-4c06-bff2-4569858f2457" (UID: "4f88960d-1897-4c06-bff2-4569858f2457"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:23:24.068912 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.068878    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f88960d-1897-4c06-bff2-4569858f2457-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f88960d-1897-4c06-bff2-4569858f2457" (UID: "4f88960d-1897-4c06-bff2-4569858f2457"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:23:24.069000 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.068938    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f88960d-1897-4c06-bff2-4569858f2457-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f88960d-1897-4c06-bff2-4569858f2457" (UID: "4f88960d-1897-4c06-bff2-4569858f2457"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:23:24.069045 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.068996    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f88960d-1897-4c06-bff2-4569858f2457-kube-api-access-6wrgk" (OuterVolumeSpecName: "kube-api-access-6wrgk") pod "4f88960d-1897-4c06-bff2-4569858f2457" (UID: "4f88960d-1897-4c06-bff2-4569858f2457"). InnerVolumeSpecName "kube-api-access-6wrgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:23:24.069083 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.069066    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f88960d-1897-4c06-bff2-4569858f2457" (UID: "4f88960d-1897-4c06-bff2-4569858f2457"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:23:24.167939 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.167904    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wrgk\" (UniqueName: \"kubernetes.io/projected/4f88960d-1897-4c06-bff2-4569858f2457-kube-api-access-6wrgk\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:24.167939 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.167933    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f88960d-1897-4c06-bff2-4569858f2457-istio-podinfo\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:24.167939 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.167943    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-istio-envoy\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:24.167939 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.167951    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f88960d-1897-4c06-bff2-4569858f2457-istio-token\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:24.168217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.167961    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-istio-data\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:24.168217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.167973    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-workload-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:24.168217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.167984    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-workload-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:24.168217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.167995    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f88960d-1897-4c06-bff2-4569858f2457-credential-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:23:24.245939 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.245907    2562 generic.go:356] "Generic (PLEG): container finished" podID="4f88960d-1897-4c06-bff2-4569858f2457" containerID="64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071" exitCode=0
Sep 10 16:23:24.246082 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.245957    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"
Sep 10 16:23:24.246082 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.245993    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk" event={"ID":"4f88960d-1897-4c06-bff2-4569858f2457","Type":"ContainerDied","Data":"64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071"}
Sep 10 16:23:24.246082 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.246052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk" event={"ID":"4f88960d-1897-4c06-bff2-4569858f2457","Type":"ContainerDied","Data":"959f5f6c7bddb2732aa1e7fde691219bafa057b36b33a178bb011bb49b2b1821"}
Sep 10 16:23:24.246082 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.246074    2562 scope.go:117] "RemoveContainer" containerID="64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071"
Sep 10 16:23:24.255132 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.255112    2562 scope.go:117] "RemoveContainer" containerID="64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071"
Sep 10 16:23:24.255452 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:23:24.255432    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071\": container with ID starting with 64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071 not found: ID does not exist" containerID="64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071"
Sep 10 16:23:24.255502 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.255461    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071"} err="failed to get container status \"64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071\": rpc error: code = NotFound desc = could not find container \"64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071\": container with ID starting with 64ec435ed61616be4b912a147981e5de949d6f77aff40ff4caec56c70c0ca071 not found: ID does not exist"
Sep 10 16:23:24.267542 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.267513    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"]
Sep 10 16:23:24.273858 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:24.273833    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-664dc8-openshift-default-c494fd898-tzbjk"]
Sep 10 16:23:26.071085 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:26.071053    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f88960d-1897-4c06-bff2-4569858f2457" path="/var/lib/kubelet/pods/4f88960d-1897-4c06-bff2-4569858f2457/volumes"
Sep 10 16:23:27.208438 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:27.208403    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"
Sep 10 16:23:27.208841 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:27.208490    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"
Sep 10 16:23:29.435603 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.435569    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"]
Sep 10 16:23:29.436045 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.436030    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f88960d-1897-4c06-bff2-4569858f2457" containerName="istio-proxy"
Sep 10 16:23:29.436087 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.436047    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f88960d-1897-4c06-bff2-4569858f2457" containerName="istio-proxy"
Sep 10 16:23:29.436123 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.436110    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f88960d-1897-4c06-bff2-4569858f2457" containerName="istio-proxy"
Sep 10 16:23:29.439250 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.439231    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.446687 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.446666    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-37c368a6-openshift-default-dockercfg-ld4gm\""
Sep 10 16:23:29.459250 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.459208    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"]
Sep 10 16:23:29.517424 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.517384    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-data\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.517424 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.517429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npv88\" (UniqueName: \"kubernetes.io/projected/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-kube-api-access-npv88\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.517674 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.517568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-envoy\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.517674 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.517605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istiod-ca-cert\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.517674 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.517646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-podinfo\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.517825 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.517681    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-credential-socket\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.517825 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.517795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-workload-certs\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.517825 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.517819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-workload-socket\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.517947 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.517843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-token\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.618313 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.618266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-podinfo\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.618313 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.618317    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-credential-socket\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.618592 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.618376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-workload-certs\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.618592 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.618396    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-workload-socket\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.618592 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.618419    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-token\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.618592 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.618473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-data\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.618592 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.618500    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npv88\" (UniqueName: \"kubernetes.io/projected/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-kube-api-access-npv88\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.618592 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.618579    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-envoy\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.618939 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.618602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istiod-ca-cert\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.618939 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.618852    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-workload-certs\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.618939 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.618880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-workload-socket\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.618939 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.618896    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-credential-socket\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.619184 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.619162    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-data\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.619317 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.619297    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istiod-ca-cert\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.620979 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.620953    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-envoy\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.621261 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.621241    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-podinfo\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.630612 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.630584    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-token\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.631937 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.631909    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npv88\" (UniqueName: \"kubernetes.io/projected/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-kube-api-access-npv88\") pod \"e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") " pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:29.749269 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:29.749229    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:30.032917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:30.032837    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"]
Sep 10 16:23:30.036188 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:23:30.036150    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5ad7de_b1fb_4bdc_8821_2f32eed2307c.slice/crio-44acd662c0aac224af53f265b33d1b89712d3105d461015f5668237e3c6b7172 WatchSource:0}: Error finding container 44acd662c0aac224af53f265b33d1b89712d3105d461015f5668237e3c6b7172: Status 404 returned error can't find the container with id 44acd662c0aac224af53f265b33d1b89712d3105d461015f5668237e3c6b7172
Sep 10 16:23:30.038506 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:30.038471    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:23:30.038573 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:30.038545    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:23:30.038611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:30.038579    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:23:30.282158 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:30.282112    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" event={"ID":"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c","Type":"ContainerStarted","Data":"774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec"}
Sep 10 16:23:30.282371 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:30.282182    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" event={"ID":"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c","Type":"ContainerStarted","Data":"44acd662c0aac224af53f265b33d1b89712d3105d461015f5668237e3c6b7172"}
Sep 10 16:23:30.307995 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:30.307887    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" podStartSLOduration=1.307868923 podStartE2EDuration="1.307868923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:23:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:23:30.305174424 +0000 UTC m=+1294.717260634" watchObservedRunningTime="2026-09-10 16:23:30.307868923 +0000 UTC m=+1294.719955131"
Sep 10 16:23:30.750069 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:30.750019    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:31.755134 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:31.755094    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:32.293966 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:32.293927    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:32.294853 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:32.294833    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:34.933381 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:34.933347    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"]
Sep 10 16:23:34.936878 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:34.936858    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"
Sep 10 16:23:34.939718 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:34.939697    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-37c368a6-dockercfg-2k6wm\""
Sep 10 16:23:34.939840 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:34.939696    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-37c368a6\""
Sep 10 16:23:34.962790 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:34.962758    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"]
Sep 10 16:23:34.969219 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:34.969188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s\" (UID: \"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"
Sep 10 16:23:34.969389 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:34.969276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsqmf\" (UniqueName: \"kubernetes.io/projected/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8-kube-api-access-tsqmf\") pod \"payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s\" (UID: \"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"
Sep 10 16:23:34.969852 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:34.969826    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"]
Sep 10 16:23:34.980870 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:34.980667    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"
Sep 10 16:23:34.991612 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:34.991306    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"]
Sep 10 16:23:35.070234 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.070197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s\" (UID: \"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"
Sep 10 16:23:35.070419 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.070254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvtm5\" (UniqueName: \"kubernetes.io/projected/95248d1b-6097-4c93-82ec-0891f3345583-kube-api-access-wvtm5\") pod \"payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l\" (UID: \"95248d1b-6097-4c93-82ec-0891f3345583\") " pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"
Sep 10 16:23:35.070419 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.070296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsqmf\" (UniqueName: \"kubernetes.io/projected/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8-kube-api-access-tsqmf\") pod \"payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s\" (UID: \"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"
Sep 10 16:23:35.070419 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.070319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95248d1b-6097-4c93-82ec-0891f3345583-plugins-config-volume\") pod \"payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l\" (UID: \"95248d1b-6097-4c93-82ec-0891f3345583\") " pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"
Sep 10 16:23:35.070869 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.070850    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s\" (UID: \"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"
Sep 10 16:23:35.082778 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.082749    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsqmf\" (UniqueName: \"kubernetes.io/projected/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8-kube-api-access-tsqmf\") pod \"payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s\" (UID: \"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"
Sep 10 16:23:35.171159 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.171116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvtm5\" (UniqueName: \"kubernetes.io/projected/95248d1b-6097-4c93-82ec-0891f3345583-kube-api-access-wvtm5\") pod \"payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l\" (UID: \"95248d1b-6097-4c93-82ec-0891f3345583\") " pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"
Sep 10 16:23:35.171378 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.171239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95248d1b-6097-4c93-82ec-0891f3345583-plugins-config-volume\") pod \"payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l\" (UID: \"95248d1b-6097-4c93-82ec-0891f3345583\") " pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"
Sep 10 16:23:35.172010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.171975    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95248d1b-6097-4c93-82ec-0891f3345583-plugins-config-volume\") pod \"payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l\" (UID: \"95248d1b-6097-4c93-82ec-0891f3345583\") " pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"
Sep 10 16:23:35.183954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.183874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvtm5\" (UniqueName: \"kubernetes.io/projected/95248d1b-6097-4c93-82ec-0891f3345583-kube-api-access-wvtm5\") pod \"payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l\" (UID: \"95248d1b-6097-4c93-82ec-0891f3345583\") " pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"
Sep 10 16:23:35.249341 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.249299    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"
Sep 10 16:23:35.297591 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.297286    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"
Sep 10 16:23:35.524977 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.524949    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"]
Sep 10 16:23:35.526421 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:23:35.526384    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f7e4b0_c7cf_4fa8_bc63_ff77ef9b30e8.slice/crio-df41f03b893abf60b7fea4d40e8be5fb4d6891a24a2e60482338e9219981692f WatchSource:0}: Error finding container df41f03b893abf60b7fea4d40e8be5fb4d6891a24a2e60482338e9219981692f: Status 404 returned error can't find the container with id df41f03b893abf60b7fea4d40e8be5fb4d6891a24a2e60482338e9219981692f
Sep 10 16:23:35.594024 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:35.593922    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"]
Sep 10 16:23:35.596043 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:23:35.596014    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95248d1b_6097_4c93_82ec_0891f3345583.slice/crio-0030fa8b66d7879792f451fe88cc857804aea352e7992cdddccc3ef304606168 WatchSource:0}: Error finding container 0030fa8b66d7879792f451fe88cc857804aea352e7992cdddccc3ef304606168: Status 404 returned error can't find the container with id 0030fa8b66d7879792f451fe88cc857804aea352e7992cdddccc3ef304606168
Sep 10 16:23:36.319933 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:36.319897    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s" event={"ID":"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8","Type":"ContainerStarted","Data":"d8e700f425b5e66ebbefab4e30648e25e71ddb2a380707ad1cb86eeb946290a8"}
Sep 10 16:23:36.320386 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:36.319959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s" event={"ID":"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8","Type":"ContainerStarted","Data":"df41f03b893abf60b7fea4d40e8be5fb4d6891a24a2e60482338e9219981692f"}
Sep 10 16:23:36.320386 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:36.319990    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"
Sep 10 16:23:36.321543 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:36.321517    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l" event={"ID":"95248d1b-6097-4c93-82ec-0891f3345583","Type":"ContainerStarted","Data":"a8c59342ee927beb285f97630f705ec1e42d50750f50fdc848d6b424a9ec82e7"}
Sep 10 16:23:36.321688 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:36.321568    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"
Sep 10 16:23:36.321688 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:36.321591    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l" event={"ID":"95248d1b-6097-4c93-82ec-0891f3345583","Type":"ContainerStarted","Data":"0030fa8b66d7879792f451fe88cc857804aea352e7992cdddccc3ef304606168"}
Sep 10 16:23:36.348489 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:36.348435    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s" podStartSLOduration=2.348419546 podStartE2EDuration="2.348419546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:23:36.34527306 +0000 UTC m=+1300.757359268" watchObservedRunningTime="2026-09-10 16:23:36.348419546 +0000 UTC m=+1300.760505754"
Sep 10 16:23:36.378798 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:36.378747    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l" podStartSLOduration=2.378719309 podStartE2EDuration="2.378719309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:23:36.377644505 +0000 UTC m=+1300.789730717" watchObservedRunningTime="2026-09-10 16:23:36.378719309 +0000 UTC m=+1300.790805518"
Sep 10 16:23:44.001863 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.001826    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"]
Sep 10 16:23:44.005844 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.005828    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"
Sep 10 16:23:44.009915 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.009896    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-b73303\""
Sep 10 16:23:44.010142 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.010126    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-b73303-dockercfg-ddc7f\""
Sep 10 16:23:44.019643 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.019622    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"]
Sep 10 16:23:44.081411 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.081383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe453df-3553-4a84-8784-1f7b1611da01-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97\" (UID: \"dfe453df-3553-4a84-8784-1f7b1611da01\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"
Sep 10 16:23:44.081592 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.081491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k62ls\" (UniqueName: \"kubernetes.io/projected/dfe453df-3553-4a84-8784-1f7b1611da01-kube-api-access-k62ls\") pod \"payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97\" (UID: \"dfe453df-3553-4a84-8784-1f7b1611da01\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"
Sep 10 16:23:44.081592 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.081585    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"]
Sep 10 16:23:44.085857 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.085475    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"
Sep 10 16:23:44.089565 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.089534    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"]
Sep 10 16:23:44.182115 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.182075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k62ls\" (UniqueName: \"kubernetes.io/projected/dfe453df-3553-4a84-8784-1f7b1611da01-kube-api-access-k62ls\") pod \"payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97\" (UID: \"dfe453df-3553-4a84-8784-1f7b1611da01\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"
Sep 10 16:23:44.182407 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.182387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8269eec-fc72-4cb1-bb49-61ec56304a48-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f\" (UID: \"b8269eec-fc72-4cb1-bb49-61ec56304a48\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"
Sep 10 16:23:44.182521 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.182508    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe453df-3553-4a84-8784-1f7b1611da01-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97\" (UID: \"dfe453df-3553-4a84-8784-1f7b1611da01\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"
Sep 10 16:23:44.182556 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.182543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pqlx\" (UniqueName: \"kubernetes.io/projected/b8269eec-fc72-4cb1-bb49-61ec56304a48-kube-api-access-6pqlx\") pod \"payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f\" (UID: \"b8269eec-fc72-4cb1-bb49-61ec56304a48\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"
Sep 10 16:23:44.183206 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.183184    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe453df-3553-4a84-8784-1f7b1611da01-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97\" (UID: \"dfe453df-3553-4a84-8784-1f7b1611da01\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"
Sep 10 16:23:44.192035 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.192016    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k62ls\" (UniqueName: \"kubernetes.io/projected/dfe453df-3553-4a84-8784-1f7b1611da01-kube-api-access-k62ls\") pod \"payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97\" (UID: \"dfe453df-3553-4a84-8784-1f7b1611da01\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"
Sep 10 16:23:44.283570 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.283478    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pqlx\" (UniqueName: \"kubernetes.io/projected/b8269eec-fc72-4cb1-bb49-61ec56304a48-kube-api-access-6pqlx\") pod \"payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f\" (UID: \"b8269eec-fc72-4cb1-bb49-61ec56304a48\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"
Sep 10 16:23:44.283713 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.283603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8269eec-fc72-4cb1-bb49-61ec56304a48-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f\" (UID: \"b8269eec-fc72-4cb1-bb49-61ec56304a48\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"
Sep 10 16:23:44.284315 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.284293    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8269eec-fc72-4cb1-bb49-61ec56304a48-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f\" (UID: \"b8269eec-fc72-4cb1-bb49-61ec56304a48\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"
Sep 10 16:23:44.292953 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.292930    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pqlx\" (UniqueName: \"kubernetes.io/projected/b8269eec-fc72-4cb1-bb49-61ec56304a48-kube-api-access-6pqlx\") pod \"payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f\" (UID: \"b8269eec-fc72-4cb1-bb49-61ec56304a48\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"
Sep 10 16:23:44.317431 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.317395    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"
Sep 10 16:23:44.397495 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.397255    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"
Sep 10 16:23:44.617188 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.617161    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"]
Sep 10 16:23:44.619156 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:23:44.619130    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe453df_3553_4a84_8784_1f7b1611da01.slice/crio-9ec96e8757b32233c954e3339a4bdc2374892ce9ca56bbcfaee695a54210d100 WatchSource:0}: Error finding container 9ec96e8757b32233c954e3339a4bdc2374892ce9ca56bbcfaee695a54210d100: Status 404 returned error can't find the container with id 9ec96e8757b32233c954e3339a4bdc2374892ce9ca56bbcfaee695a54210d100
Sep 10 16:23:44.709925 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:44.709848    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"]
Sep 10 16:23:44.711383 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:23:44.711331    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8269eec_fc72_4cb1_bb49_61ec56304a48.slice/crio-1fd825407fc4c13f2f3ee60c0d3ca62d585042e169271fceee176b39e5e8bbd0 WatchSource:0}: Error finding container 1fd825407fc4c13f2f3ee60c0d3ca62d585042e169271fceee176b39e5e8bbd0: Status 404 returned error can't find the container with id 1fd825407fc4c13f2f3ee60c0d3ca62d585042e169271fceee176b39e5e8bbd0
Sep 10 16:23:45.385588 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:45.385550    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f" event={"ID":"b8269eec-fc72-4cb1-bb49-61ec56304a48","Type":"ContainerStarted","Data":"a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98"}
Sep 10 16:23:45.386039 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:45.385611    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f" event={"ID":"b8269eec-fc72-4cb1-bb49-61ec56304a48","Type":"ContainerStarted","Data":"1fd825407fc4c13f2f3ee60c0d3ca62d585042e169271fceee176b39e5e8bbd0"}
Sep 10 16:23:45.386039 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:45.385644    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"
Sep 10 16:23:45.387348 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:45.387318    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97" event={"ID":"dfe453df-3553-4a84-8784-1f7b1611da01","Type":"ContainerStarted","Data":"fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d"}
Sep 10 16:23:45.387453 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:45.387362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97" event={"ID":"dfe453df-3553-4a84-8784-1f7b1611da01","Type":"ContainerStarted","Data":"9ec96e8757b32233c954e3339a4bdc2374892ce9ca56bbcfaee695a54210d100"}
Sep 10 16:23:45.387453 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:45.387383    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"
Sep 10 16:23:45.407884 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:45.407840    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f" podStartSLOduration=1.407825983 podStartE2EDuration="1.407825983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:23:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:23:45.405355158 +0000 UTC m=+1309.817441368" watchObservedRunningTime="2026-09-10 16:23:45.407825983 +0000 UTC m=+1309.819912191"
Sep 10 16:23:45.427244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:45.427164    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97" podStartSLOduration=2.427153521 podStartE2EDuration="2.427153521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:23:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:23:45.425141556 +0000 UTC m=+1309.837227767" watchObservedRunningTime="2026-09-10 16:23:45.427153521 +0000 UTC m=+1309.839239729"
Sep 10 16:23:47.330066 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:47.330032    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"
Sep 10 16:23:47.330499 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:47.330100    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"
Sep 10 16:23:48.277404 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:48.277365    2562 patch_prober.go:28] interesting pod/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": read tcp 10.134.0.2:47474->10.134.0.65:15021: read: connection reset by peer" start-of-body=
Sep 10 16:23:48.277698 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:48.277667    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": read tcp 10.134.0.2:47474->10.134.0.65:15021: read: connection reset by peer"
Sep 10 16:23:48.410091 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:48.410059    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerID="774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec" exitCode=0
Sep 10 16:23:48.410556 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:48.410138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" event={"ID":"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c","Type":"ContainerDied","Data":"774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec"}
Sep 10 16:23:48.410626 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:48.410612    2562 scope.go:117] "RemoveContainer" containerID="774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec"
Sep 10 16:23:48.412049 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:48.412005    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:23:48.412123 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:48.412105    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:23:48.412169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:48.412154    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:23:49.417534 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:49.417503    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" event={"ID":"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c","Type":"ContainerStarted","Data":"e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b"}
Sep 10 16:23:49.750480 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:49.750436    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:49.750825 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:49.750569    2562 patch_prober.go:28] interesting pod/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 10 16:23:49.750825 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:49.750617    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 10 16:23:50.751870 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:50.751833    2562 patch_prober.go:28] interesting pod/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 10 16:23:50.752457 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:50.752424    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 10 16:23:51.755227 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:51.755179    2562 patch_prober.go:28] interesting pod/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 10 16:23:51.755763 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:51.755254    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 10 16:23:52.750611 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:52.750570    2562 patch_prober.go:28] interesting pod/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 10 16:23:52.750949 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:52.750918    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 10 16:23:53.750739 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:53.750678    2562 patch_prober.go:28] interesting pod/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 10 16:23:53.751268 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:53.750782    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 10 16:23:54.753250 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:54.753218    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:54.753686 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:54.753598    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:54.754239 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:54.754222    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:23:56.396436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:56.396394    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"
Sep 10 16:23:56.396872 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:23:56.396469    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"
Sep 10 16:24:16.399946 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.399911    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"]
Sep 10 16:24:16.400420 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.400365    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l" podUID="95248d1b-6097-4c93-82ec-0891f3345583" containerName="payload-processing" containerID="cri-o://a8c59342ee927beb285f97630f705ec1e42d50750f50fdc848d6b424a9ec82e7" gracePeriod=30
Sep 10 16:24:16.412871 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.412843    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"]
Sep 10 16:24:16.413100 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.413074    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s" podUID="b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8" containerName="payload-pre-processing" containerID="cri-o://d8e700f425b5e66ebbefab4e30648e25e71ddb2a380707ad1cb86eeb946290a8" gracePeriod=30
Sep 10 16:24:16.570513 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.570477    2562 generic.go:356] "Generic (PLEG): container finished" podID="b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8" containerID="d8e700f425b5e66ebbefab4e30648e25e71ddb2a380707ad1cb86eeb946290a8" exitCode=0
Sep 10 16:24:16.570690 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.570555    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s" event={"ID":"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8","Type":"ContainerDied","Data":"d8e700f425b5e66ebbefab4e30648e25e71ddb2a380707ad1cb86eeb946290a8"}
Sep 10 16:24:16.572510 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.572476    2562 generic.go:356] "Generic (PLEG): container finished" podID="95248d1b-6097-4c93-82ec-0891f3345583" containerID="a8c59342ee927beb285f97630f705ec1e42d50750f50fdc848d6b424a9ec82e7" exitCode=0
Sep 10 16:24:16.572629 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.572526    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l" event={"ID":"95248d1b-6097-4c93-82ec-0891f3345583","Type":"ContainerDied","Data":"a8c59342ee927beb285f97630f705ec1e42d50750f50fdc848d6b424a9ec82e7"}
Sep 10 16:24:16.665272 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.665212    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"
Sep 10 16:24:16.696510 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.696476    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"
Sep 10 16:24:16.833004 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.832965    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsqmf\" (UniqueName: \"kubernetes.io/projected/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8-kube-api-access-tsqmf\") pod \"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8\" (UID: \"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8\") "
Sep 10 16:24:16.833004 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.833007    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvtm5\" (UniqueName: \"kubernetes.io/projected/95248d1b-6097-4c93-82ec-0891f3345583-kube-api-access-wvtm5\") pod \"95248d1b-6097-4c93-82ec-0891f3345583\" (UID: \"95248d1b-6097-4c93-82ec-0891f3345583\") "
Sep 10 16:24:16.833256 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.833036    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8-plugins-config-volume\") pod \"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8\" (UID: \"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8\") "
Sep 10 16:24:16.833256 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.833157    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95248d1b-6097-4c93-82ec-0891f3345583-plugins-config-volume\") pod \"95248d1b-6097-4c93-82ec-0891f3345583\" (UID: \"95248d1b-6097-4c93-82ec-0891f3345583\") "
Sep 10 16:24:16.833524 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.833492    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8" (UID: "b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:24:16.833590 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.833532    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95248d1b-6097-4c93-82ec-0891f3345583-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "95248d1b-6097-4c93-82ec-0891f3345583" (UID: "95248d1b-6097-4c93-82ec-0891f3345583"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:24:16.835141 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.835115    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95248d1b-6097-4c93-82ec-0891f3345583-kube-api-access-wvtm5" (OuterVolumeSpecName: "kube-api-access-wvtm5") pod "95248d1b-6097-4c93-82ec-0891f3345583" (UID: "95248d1b-6097-4c93-82ec-0891f3345583"). InnerVolumeSpecName "kube-api-access-wvtm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:24:16.835225 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.835166    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8-kube-api-access-tsqmf" (OuterVolumeSpecName: "kube-api-access-tsqmf") pod "b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8" (UID: "b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8"). InnerVolumeSpecName "kube-api-access-tsqmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:24:16.934573 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.934467    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsqmf\" (UniqueName: \"kubernetes.io/projected/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8-kube-api-access-tsqmf\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:16.934573 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.934507    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvtm5\" (UniqueName: \"kubernetes.io/projected/95248d1b-6097-4c93-82ec-0891f3345583-kube-api-access-wvtm5\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:16.934573 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.934521    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:16.934573 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:16.934532    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95248d1b-6097-4c93-82ec-0891f3345583-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:17.580946 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:17.580918    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"
Sep 10 16:24:17.581417 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:17.580936    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s" event={"ID":"b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8","Type":"ContainerDied","Data":"df41f03b893abf60b7fea4d40e8be5fb4d6891a24a2e60482338e9219981692f"}
Sep 10 16:24:17.581417 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:17.581010    2562 scope.go:117] "RemoveContainer" containerID="d8e700f425b5e66ebbefab4e30648e25e71ddb2a380707ad1cb86eeb946290a8"
Sep 10 16:24:17.582545 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:17.582470    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"
Sep 10 16:24:17.582545 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:17.582490    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l" event={"ID":"95248d1b-6097-4c93-82ec-0891f3345583","Type":"ContainerDied","Data":"0030fa8b66d7879792f451fe88cc857804aea352e7992cdddccc3ef304606168"}
Sep 10 16:24:17.596243 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:17.596072    2562 scope.go:117] "RemoveContainer" containerID="a8c59342ee927beb285f97630f705ec1e42d50750f50fdc848d6b424a9ec82e7"
Sep 10 16:24:17.608985 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:17.608960    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"]
Sep 10 16:24:17.614712 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:17.614685    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-37c368a6-7595d9b56b-rv28s"]
Sep 10 16:24:17.629561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:17.629521    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"]
Sep 10 16:24:17.638012 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:17.637989    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-37c368a6-57cdf8649-zdd5l"]
Sep 10 16:24:18.076434 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:18.076359    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95248d1b-6097-4c93-82ec-0891f3345583" path="/var/lib/kubelet/pods/95248d1b-6097-4c93-82ec-0891f3345583/volumes"
Sep 10 16:24:18.076820 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:18.076799    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8" path="/var/lib/kubelet/pods/b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8/volumes"
Sep 10 16:24:23.729636 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:23.729603    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"]
Sep 10 16:24:23.730186 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:23.729822    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy" containerID="cri-o://e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b" gracePeriod=30
Sep 10 16:24:24.756721 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:24.756682    2562 patch_prober.go:28] interesting pod/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 10 16:24:24.757147 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:24.756767    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 16:24:28.991587 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:28.991526    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:24:29.045766 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.045706    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-podinfo\") pod \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") "
Sep 10 16:24:29.045954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.045778    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-token\") pod \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") "
Sep 10 16:24:29.045954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.045814    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-credential-socket\") pod \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") "
Sep 10 16:24:29.045954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.045854    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-workload-socket\") pod \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") "
Sep 10 16:24:29.045954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.045914    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istiod-ca-cert\") pod \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") "
Sep 10 16:24:29.046177 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.045968    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-workload-certs\") pod \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") "
Sep 10 16:24:29.046177 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.045999    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-data\") pod \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") "
Sep 10 16:24:29.046177 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.046074    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-envoy\") pod \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") "
Sep 10 16:24:29.046177 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.046140    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npv88\" (UniqueName: \"kubernetes.io/projected/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-kube-api-access-npv88\") pod \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\" (UID: \"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c\") "
Sep 10 16:24:29.046177 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.046145    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" (UID: "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:24:29.047194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.047127    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-credential-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:29.047329 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.047265    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" (UID: "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:24:29.047329 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.047315    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" (UID: "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:24:29.048418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.048138    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" (UID: "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:24:29.048418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.048270    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" (UID: "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:24:29.050802 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.048933    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" (UID: "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:24:29.056528 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.056502    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" (UID: "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:24:29.056647 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.056489    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-kube-api-access-npv88" (OuterVolumeSpecName: "kube-api-access-npv88") pod "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" (UID: "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c"). InnerVolumeSpecName "kube-api-access-npv88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:24:29.057274 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.057254    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" (UID: "8a5ad7de-b1fb-4bdc-8821-2f32eed2307c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:24:29.147996 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.147960    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-envoy\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:29.147996 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.147991    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npv88\" (UniqueName: \"kubernetes.io/projected/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-kube-api-access-npv88\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:29.147996 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.148002    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-podinfo\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:29.148229 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.148010    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-token\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:29.148229 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.148018    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-workload-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:29.148229 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.148026    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istiod-ca-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:29.148229 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.148034    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-workload-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:29.148229 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.148041    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c-istio-data\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:24:29.651469 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.651434    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerID="e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b" exitCode=0
Sep 10 16:24:29.651682 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.651496    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"
Sep 10 16:24:29.651682 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.651528    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" event={"ID":"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c","Type":"ContainerDied","Data":"e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b"}
Sep 10 16:24:29.651682 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.651599    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp" event={"ID":"8a5ad7de-b1fb-4bdc-8821-2f32eed2307c","Type":"ContainerDied","Data":"44acd662c0aac224af53f265b33d1b89712d3105d461015f5668237e3c6b7172"}
Sep 10 16:24:29.651682 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.651632    2562 scope.go:117] "RemoveContainer" containerID="e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b"
Sep 10 16:24:29.661604 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.661584    2562 scope.go:117] "RemoveContainer" containerID="774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec"
Sep 10 16:24:29.671212 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.671194    2562 scope.go:117] "RemoveContainer" containerID="e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b"
Sep 10 16:24:29.671510 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:24:29.671479    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b\": container with ID starting with e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b not found: ID does not exist" containerID="e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b"
Sep 10 16:24:29.671624 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.671522    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b"} err="failed to get container status \"e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b\": rpc error: code = NotFound desc = could not find container \"e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b\": container with ID starting with e6ba86ee1b4751a2a1253cf4867346669c129e7d398c352ab148cd8ccc64429b not found: ID does not exist"
Sep 10 16:24:29.671624 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.671547    2562 scope.go:117] "RemoveContainer" containerID="774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec"
Sep 10 16:24:29.671929 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:24:29.671903    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec\": container with ID starting with 774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec not found: ID does not exist" containerID="774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec"
Sep 10 16:24:29.672006 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.671928    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec"} err="failed to get container status \"774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec\": rpc error: code = NotFound desc = could not find container \"774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec\": container with ID starting with 774c6452c0d3a1137d6e1ced31b20835407fb2055452f927ee8544ec352967ec not found: ID does not exist"
Sep 10 16:24:29.682257 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.682236    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"]
Sep 10 16:24:29.686512 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:29.686493    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-37c368a6-openshift-default-74cbd696d8-v4jgp"]
Sep 10 16:24:30.071390 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:30.071356    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" path="/var/lib/kubelet/pods/8a5ad7de-b1fb-4bdc-8821-2f32eed2307c/volumes"
Sep 10 16:24:39.791758 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.791714    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"]
Sep 10 16:24:39.792182 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.792168    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95248d1b-6097-4c93-82ec-0891f3345583" containerName="payload-processing"
Sep 10 16:24:39.792227 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.792184    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="95248d1b-6097-4c93-82ec-0891f3345583" containerName="payload-processing"
Sep 10 16:24:39.792227 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.792193    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy"
Sep 10 16:24:39.792227 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.792198    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy"
Sep 10 16:24:39.792227 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.792205    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy"
Sep 10 16:24:39.792227 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.792210    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy"
Sep 10 16:24:39.792227 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.792221    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8" containerName="payload-pre-processing"
Sep 10 16:24:39.792227 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.792227    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8" containerName="payload-pre-processing"
Sep 10 16:24:39.792434 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.792292    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f7e4b0-c7cf-4fa8-bc63-ff77ef9b30e8" containerName="payload-pre-processing"
Sep 10 16:24:39.792434 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.792300    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="95248d1b-6097-4c93-82ec-0891f3345583" containerName="payload-processing"
Sep 10 16:24:39.792434 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.792309    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy"
Sep 10 16:24:39.792434 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.792317    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a5ad7de-b1fb-4bdc-8821-2f32eed2307c" containerName="istio-proxy"
Sep 10 16:24:39.797130 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.797112    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.804270 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.804242    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-29fd7d-openshift-default-dockercfg-cs6dq\""
Sep 10 16:24:39.826652 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.826619    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"]
Sep 10 16:24:39.843954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.843918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9f7e98-554c-466a-a497-859cd7f51d33-istiod-ca-cert\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.844155 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.843980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-token\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.844155 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.844014    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8q6r\" (UniqueName: \"kubernetes.io/projected/eb9f7e98-554c-466a-a497-859cd7f51d33-kube-api-access-t8q6r\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.844155 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.844062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-workload-certs\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.844155 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.844120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-data\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.844155 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.844151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-envoy\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.844455 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.844181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-credential-socket\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.844455 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.844220    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-podinfo\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.844455 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.844249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-workload-socket\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.945072 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.945027    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-token\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.945072 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.945079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8q6r\" (UniqueName: \"kubernetes.io/projected/eb9f7e98-554c-466a-a497-859cd7f51d33-kube-api-access-t8q6r\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.945359 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.945117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-workload-certs\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.945359 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.945155    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-data\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.945359 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.945174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-envoy\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.945359 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.945193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-credential-socket\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.945359 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.945229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-podinfo\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.945359 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.945258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-workload-socket\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.945359 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.945339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9f7e98-554c-466a-a497-859cd7f51d33-istiod-ca-cert\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.945833 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.945653    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-data\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.946047 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.946018    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-workload-certs\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.946140 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.946104    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9f7e98-554c-466a-a497-859cd7f51d33-istiod-ca-cert\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.946203 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.946158    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-credential-socket\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.946269 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.946246    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-workload-socket\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.947905 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.947874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-podinfo\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.948013 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.947989    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-envoy\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.961062 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.961033    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-token\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:39.961154 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:39.961071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8q6r\" (UniqueName: \"kubernetes.io/projected/eb9f7e98-554c-466a-a497-859cd7f51d33-kube-api-access-t8q6r\") pod \"e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") " pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:40.108658 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:40.108573    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:40.409590 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:40.409511    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"]
Sep 10 16:24:40.412851 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:24:40.412822    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9f7e98_554c_466a_a497_859cd7f51d33.slice/crio-4883b3eaff305fb624146fc2abf3cb5dc50d83bead4c81ebed8c6b7af1e1b1c9 WatchSource:0}: Error finding container 4883b3eaff305fb624146fc2abf3cb5dc50d83bead4c81ebed8c6b7af1e1b1c9: Status 404 returned error can't find the container with id 4883b3eaff305fb624146fc2abf3cb5dc50d83bead4c81ebed8c6b7af1e1b1c9
Sep 10 16:24:40.414980 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:40.414943    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:24:40.415062 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:40.415010    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:24:40.415062 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:40.415040    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:24:40.716780 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:40.716662    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" event={"ID":"eb9f7e98-554c-466a-a497-859cd7f51d33","Type":"ContainerStarted","Data":"687c91587a3168170ea96d1b3417f9361f47c362e306f0b147e0919254a73d65"}
Sep 10 16:24:40.716780 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:40.716744    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" event={"ID":"eb9f7e98-554c-466a-a497-859cd7f51d33","Type":"ContainerStarted","Data":"4883b3eaff305fb624146fc2abf3cb5dc50d83bead4c81ebed8c6b7af1e1b1c9"}
Sep 10 16:24:40.750535 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:40.750477    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" podStartSLOduration=1.750459694 podStartE2EDuration="1.750459694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:24:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:24:40.747589817 +0000 UTC m=+1365.159676027" watchObservedRunningTime="2026-09-10 16:24:40.750459694 +0000 UTC m=+1365.162545902"
Sep 10 16:24:41.109555 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:41.109519    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:41.114582 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:41.114556    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:41.722506 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:41.722474    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:41.723432 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:41.723404    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:24:44.672648 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.672611    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"]
Sep 10 16:24:44.676349 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.676312    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"
Sep 10 16:24:44.679284 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.679259    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-29fd7d\""
Sep 10 16:24:44.697065 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.697026    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"]
Sep 10 16:24:44.700910 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.700883    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"]
Sep 10 16:24:44.701064 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.700992    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"
Sep 10 16:24:44.706196 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.706175    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-29fd7d-dockercfg-6l9gd\""
Sep 10 16:24:44.720290 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.720261    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"]
Sep 10 16:24:44.793438 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.793392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d5f2827-3c7b-49b4-80b1-543791551a59-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp\" (UID: \"9d5f2827-3c7b-49b4-80b1-543791551a59\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"
Sep 10 16:24:44.793655 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.793520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4wlr\" (UniqueName: \"kubernetes.io/projected/757c3c32-7882-4fb6-8dd4-d3ec34ee7644-kube-api-access-t4wlr\") pod \"payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp\" (UID: \"757c3c32-7882-4fb6-8dd4-d3ec34ee7644\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"
Sep 10 16:24:44.793655 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.793568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/757c3c32-7882-4fb6-8dd4-d3ec34ee7644-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp\" (UID: \"757c3c32-7882-4fb6-8dd4-d3ec34ee7644\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"
Sep 10 16:24:44.793772 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.793660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsfrm\" (UniqueName: \"kubernetes.io/projected/9d5f2827-3c7b-49b4-80b1-543791551a59-kube-api-access-hsfrm\") pod \"payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp\" (UID: \"9d5f2827-3c7b-49b4-80b1-543791551a59\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"
Sep 10 16:24:44.894460 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.894424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4wlr\" (UniqueName: \"kubernetes.io/projected/757c3c32-7882-4fb6-8dd4-d3ec34ee7644-kube-api-access-t4wlr\") pod \"payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp\" (UID: \"757c3c32-7882-4fb6-8dd4-d3ec34ee7644\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"
Sep 10 16:24:44.894665 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.894478    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/757c3c32-7882-4fb6-8dd4-d3ec34ee7644-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp\" (UID: \"757c3c32-7882-4fb6-8dd4-d3ec34ee7644\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"
Sep 10 16:24:44.894665 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.894549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsfrm\" (UniqueName: \"kubernetes.io/projected/9d5f2827-3c7b-49b4-80b1-543791551a59-kube-api-access-hsfrm\") pod \"payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp\" (UID: \"9d5f2827-3c7b-49b4-80b1-543791551a59\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"
Sep 10 16:24:44.894665 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.894620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d5f2827-3c7b-49b4-80b1-543791551a59-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp\" (UID: \"9d5f2827-3c7b-49b4-80b1-543791551a59\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"
Sep 10 16:24:44.895280 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.895257    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/757c3c32-7882-4fb6-8dd4-d3ec34ee7644-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp\" (UID: \"757c3c32-7882-4fb6-8dd4-d3ec34ee7644\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"
Sep 10 16:24:44.895345 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.895326    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d5f2827-3c7b-49b4-80b1-543791551a59-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp\" (UID: \"9d5f2827-3c7b-49b4-80b1-543791551a59\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"
Sep 10 16:24:44.904553 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.904528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsfrm\" (UniqueName: \"kubernetes.io/projected/9d5f2827-3c7b-49b4-80b1-543791551a59-kube-api-access-hsfrm\") pod \"payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp\" (UID: \"9d5f2827-3c7b-49b4-80b1-543791551a59\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"
Sep 10 16:24:44.904892 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.904869    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4wlr\" (UniqueName: \"kubernetes.io/projected/757c3c32-7882-4fb6-8dd4-d3ec34ee7644-kube-api-access-t4wlr\") pod \"payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp\" (UID: \"757c3c32-7882-4fb6-8dd4-d3ec34ee7644\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"
Sep 10 16:24:44.987843 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:44.987753    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"
Sep 10 16:24:45.011775 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:45.011740    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"
Sep 10 16:24:45.285856 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:45.285827    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"]
Sep 10 16:24:45.288486 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:24:45.288456    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod757c3c32_7882_4fb6_8dd4_d3ec34ee7644.slice/crio-d73ba7da9845b37d5a26a7194ed415cec900c6c52fcdf38c52d27e96ef03af92 WatchSource:0}: Error finding container d73ba7da9845b37d5a26a7194ed415cec900c6c52fcdf38c52d27e96ef03af92: Status 404 returned error can't find the container with id d73ba7da9845b37d5a26a7194ed415cec900c6c52fcdf38c52d27e96ef03af92
Sep 10 16:24:45.324568 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:45.324515    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"]
Sep 10 16:24:45.327000 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:24:45.326978    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5f2827_3c7b_49b4_80b1_543791551a59.slice/crio-ed4e42471e7ae5f6ff224c254f2c7983f0e7755a924cb5f45ec40577088a82ea WatchSource:0}: Error finding container ed4e42471e7ae5f6ff224c254f2c7983f0e7755a924cb5f45ec40577088a82ea: Status 404 returned error can't find the container with id ed4e42471e7ae5f6ff224c254f2c7983f0e7755a924cb5f45ec40577088a82ea
Sep 10 16:24:45.756668 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:45.756632    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp" event={"ID":"9d5f2827-3c7b-49b4-80b1-543791551a59","Type":"ContainerStarted","Data":"41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed"}
Sep 10 16:24:45.757168 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:45.756684    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp" event={"ID":"9d5f2827-3c7b-49b4-80b1-543791551a59","Type":"ContainerStarted","Data":"ed4e42471e7ae5f6ff224c254f2c7983f0e7755a924cb5f45ec40577088a82ea"}
Sep 10 16:24:45.757168 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:45.756832    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"
Sep 10 16:24:45.758482 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:45.758459    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp" event={"ID":"757c3c32-7882-4fb6-8dd4-d3ec34ee7644","Type":"ContainerStarted","Data":"02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a"}
Sep 10 16:24:45.758591 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:45.758502    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp" event={"ID":"757c3c32-7882-4fb6-8dd4-d3ec34ee7644","Type":"ContainerStarted","Data":"d73ba7da9845b37d5a26a7194ed415cec900c6c52fcdf38c52d27e96ef03af92"}
Sep 10 16:24:45.758591 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:45.758552    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"
Sep 10 16:24:45.806068 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:45.806014    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp" podStartSLOduration=1.8059975499999998 podStartE2EDuration="1.80599755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:24:45.805194956 +0000 UTC m=+1370.217281169" watchObservedRunningTime="2026-09-10 16:24:45.80599755 +0000 UTC m=+1370.218083759"
Sep 10 16:24:45.806246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:45.806098    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp" podStartSLOduration=1.806093228 podStartE2EDuration="1.806093228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:24:45.780667897 +0000 UTC m=+1370.192754107" watchObservedRunningTime="2026-09-10 16:24:45.806093228 +0000 UTC m=+1370.218179448"
Sep 10 16:24:56.767788 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:56.767747    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"
Sep 10 16:24:56.768695 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:24:56.768669    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"
Sep 10 16:25:01.859384 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:01.859298    2562 generic.go:356] "Generic (PLEG): container finished" podID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerID="687c91587a3168170ea96d1b3417f9361f47c362e306f0b147e0919254a73d65" exitCode=0
Sep 10 16:25:01.859806 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:01.859381    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" event={"ID":"eb9f7e98-554c-466a-a497-859cd7f51d33","Type":"ContainerDied","Data":"687c91587a3168170ea96d1b3417f9361f47c362e306f0b147e0919254a73d65"}
Sep 10 16:25:01.859854 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:01.859832    2562 scope.go:117] "RemoveContainer" containerID="687c91587a3168170ea96d1b3417f9361f47c362e306f0b147e0919254a73d65"
Sep 10 16:25:01.860998 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:01.860971    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:25:01.861074 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:01.861037    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:25:01.861074 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:01.861071    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:25:02.870606 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:02.870569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" event={"ID":"eb9f7e98-554c-466a-a497-859cd7f51d33","Type":"ContainerStarted","Data":"00f70d8615a51a3c02e2cfc351e83672d860cc2372efe36a2f56f201ba6dff0f"}
Sep 10 16:25:03.109436 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:03.109393    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:25:03.109694 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:03.109663    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 16:25:03.109786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:03.109761    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 16:25:04.109966 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:04.109932    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 16:25:04.110456 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:04.110005    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 16:25:05.109064 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:05.109023    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 16:25:05.109244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:05.109081    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 16:25:06.109455 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:06.109421    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 16:25:06.109888 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:06.109482    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 16:25:07.109708 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:07.109651    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 16:25:07.110228 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:07.109759    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 16:25:08.141457 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:08.141422    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:25:08.141971 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:08.141837    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:25:08.142622 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:08.142599    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:25:13.343263 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.343229    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"]
Sep 10 16:25:13.346172 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.346150    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"
Sep 10 16:25:13.352177 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.352155    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-90bd7e\""
Sep 10 16:25:13.352488 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.352472    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-90bd7e-dockercfg-vbjsx\""
Sep 10 16:25:13.369893 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.369866    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"]
Sep 10 16:25:13.392746 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.392701    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/280d8fe9-704a-4424-b02f-c2dca2dd99d3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s\" (UID: \"280d8fe9-704a-4424-b02f-c2dca2dd99d3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"
Sep 10 16:25:13.392856 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.392750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9mfp\" (UniqueName: \"kubernetes.io/projected/280d8fe9-704a-4424-b02f-c2dca2dd99d3-kube-api-access-m9mfp\") pod \"payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s\" (UID: \"280d8fe9-704a-4424-b02f-c2dca2dd99d3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"
Sep 10 16:25:13.494208 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.494165    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/280d8fe9-704a-4424-b02f-c2dca2dd99d3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s\" (UID: \"280d8fe9-704a-4424-b02f-c2dca2dd99d3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"
Sep 10 16:25:13.494208 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.494206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9mfp\" (UniqueName: \"kubernetes.io/projected/280d8fe9-704a-4424-b02f-c2dca2dd99d3-kube-api-access-m9mfp\") pod \"payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s\" (UID: \"280d8fe9-704a-4424-b02f-c2dca2dd99d3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"
Sep 10 16:25:13.494873 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.494854    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/280d8fe9-704a-4424-b02f-c2dca2dd99d3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s\" (UID: \"280d8fe9-704a-4424-b02f-c2dca2dd99d3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"
Sep 10 16:25:13.510756 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.506747    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9mfp\" (UniqueName: \"kubernetes.io/projected/280d8fe9-704a-4424-b02f-c2dca2dd99d3-kube-api-access-m9mfp\") pod \"payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s\" (UID: \"280d8fe9-704a-4424-b02f-c2dca2dd99d3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"
Sep 10 16:25:13.656392 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.656303    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"
Sep 10 16:25:13.932377 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:13.932344    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"]
Sep 10 16:25:13.933668 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:25:13.933627    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280d8fe9_704a_4424_b02f_c2dca2dd99d3.slice/crio-78dc89ad13d9eeb071ab633d3054390a54d10165fb4d893668385a99f8abe575 WatchSource:0}: Error finding container 78dc89ad13d9eeb071ab633d3054390a54d10165fb4d893668385a99f8abe575: Status 404 returned error can't find the container with id 78dc89ad13d9eeb071ab633d3054390a54d10165fb4d893668385a99f8abe575
Sep 10 16:25:14.941003 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:14.940962    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s" event={"ID":"280d8fe9-704a-4424-b02f-c2dca2dd99d3","Type":"ContainerStarted","Data":"ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a"}
Sep 10 16:25:14.941484 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:14.941026    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s" event={"ID":"280d8fe9-704a-4424-b02f-c2dca2dd99d3","Type":"ContainerStarted","Data":"78dc89ad13d9eeb071ab633d3054390a54d10165fb4d893668385a99f8abe575"}
Sep 10 16:25:14.941484 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:14.941167    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"
Sep 10 16:25:14.961668 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:14.961606    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s" podStartSLOduration=1.961586798 podStartE2EDuration="1.961586798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:25:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:25:14.959079081 +0000 UTC m=+1399.371165291" watchObservedRunningTime="2026-09-10 16:25:14.961586798 +0000 UTC m=+1399.373673010"
Sep 10 16:25:25.949609 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:25.949573    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"
Sep 10 16:25:52.871284 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:52.871208    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"]
Sep 10 16:25:52.875111 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:52.875094    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"
Sep 10 16:25:52.887801 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:52.887781    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7dabb3eb\""
Sep 10 16:25:52.900340 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:52.900310    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"]
Sep 10 16:25:52.940718 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:52.940690    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"]
Sep 10 16:25:52.944290 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:52.944265    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"
Sep 10 16:25:52.947952 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:52.947932    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7dabb3eb-dockercfg-m72wr\""
Sep 10 16:25:52.958626 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:52.958600    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"]
Sep 10 16:25:52.988175 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:52.988144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k4p6\" (UniqueName: \"kubernetes.io/projected/2608efdf-db35-456f-9807-500cdf670a57-kube-api-access-7k4p6\") pod \"payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d\" (UID: \"2608efdf-db35-456f-9807-500cdf670a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"
Sep 10 16:25:52.988316 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:52.988200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a84cc65-2f6a-44c8-8d36-b92737122041-plugins-config-volume\") pod \"payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd\" (UID: \"6a84cc65-2f6a-44c8-8d36-b92737122041\") " pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"
Sep 10 16:25:52.988387 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:52.988362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2608efdf-db35-456f-9807-500cdf670a57-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d\" (UID: \"2608efdf-db35-456f-9807-500cdf670a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"
Sep 10 16:25:52.988445 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:52.988402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4knj\" (UniqueName: \"kubernetes.io/projected/6a84cc65-2f6a-44c8-8d36-b92737122041-kube-api-access-g4knj\") pod \"payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd\" (UID: \"6a84cc65-2f6a-44c8-8d36-b92737122041\") " pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"
Sep 10 16:25:53.089913 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:53.089870    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2608efdf-db35-456f-9807-500cdf670a57-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d\" (UID: \"2608efdf-db35-456f-9807-500cdf670a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"
Sep 10 16:25:53.090070 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:53.089918    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4knj\" (UniqueName: \"kubernetes.io/projected/6a84cc65-2f6a-44c8-8d36-b92737122041-kube-api-access-g4knj\") pod \"payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd\" (UID: \"6a84cc65-2f6a-44c8-8d36-b92737122041\") " pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"
Sep 10 16:25:53.090070 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:53.089958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k4p6\" (UniqueName: \"kubernetes.io/projected/2608efdf-db35-456f-9807-500cdf670a57-kube-api-access-7k4p6\") pod \"payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d\" (UID: \"2608efdf-db35-456f-9807-500cdf670a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"
Sep 10 16:25:53.090070 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:53.089984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a84cc65-2f6a-44c8-8d36-b92737122041-plugins-config-volume\") pod \"payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd\" (UID: \"6a84cc65-2f6a-44c8-8d36-b92737122041\") " pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"
Sep 10 16:25:53.090622 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:53.090600    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2608efdf-db35-456f-9807-500cdf670a57-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d\" (UID: \"2608efdf-db35-456f-9807-500cdf670a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"
Sep 10 16:25:53.090664 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:53.090646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a84cc65-2f6a-44c8-8d36-b92737122041-plugins-config-volume\") pod \"payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd\" (UID: \"6a84cc65-2f6a-44c8-8d36-b92737122041\") " pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"
Sep 10 16:25:53.106124 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:53.106102    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4knj\" (UniqueName: \"kubernetes.io/projected/6a84cc65-2f6a-44c8-8d36-b92737122041-kube-api-access-g4knj\") pod \"payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd\" (UID: \"6a84cc65-2f6a-44c8-8d36-b92737122041\") " pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"
Sep 10 16:25:53.106243 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:53.106103    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k4p6\" (UniqueName: \"kubernetes.io/projected/2608efdf-db35-456f-9807-500cdf670a57-kube-api-access-7k4p6\") pod \"payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d\" (UID: \"2608efdf-db35-456f-9807-500cdf670a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"
Sep 10 16:25:53.185534 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:53.185448    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"
Sep 10 16:25:53.255110 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:53.255077    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"
Sep 10 16:25:53.462132 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:53.462101    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"]
Sep 10 16:25:53.463805 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:25:53.463779    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2608efdf_db35_456f_9807_500cdf670a57.slice/crio-610754be416ca84fefd7ae3293ce19ce0380d6b35794f56c48499a5a5fab0e0e WatchSource:0}: Error finding container 610754be416ca84fefd7ae3293ce19ce0380d6b35794f56c48499a5a5fab0e0e: Status 404 returned error can't find the container with id 610754be416ca84fefd7ae3293ce19ce0380d6b35794f56c48499a5a5fab0e0e
Sep 10 16:25:53.545106 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:53.545080    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"]
Sep 10 16:25:53.547116 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:25:53.547090    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a84cc65_2f6a_44c8_8d36_b92737122041.slice/crio-fdc3879030e48011a70af703f72054c9b9f9e43d5d13f4ec88a9bc698c5f07d2 WatchSource:0}: Error finding container fdc3879030e48011a70af703f72054c9b9f9e43d5d13f4ec88a9bc698c5f07d2: Status 404 returned error can't find the container with id fdc3879030e48011a70af703f72054c9b9f9e43d5d13f4ec88a9bc698c5f07d2
Sep 10 16:25:54.171278 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:54.171235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d" event={"ID":"2608efdf-db35-456f-9807-500cdf670a57","Type":"ContainerStarted","Data":"833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16"}
Sep 10 16:25:54.171772 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:54.171303    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d" event={"ID":"2608efdf-db35-456f-9807-500cdf670a57","Type":"ContainerStarted","Data":"610754be416ca84fefd7ae3293ce19ce0380d6b35794f56c48499a5a5fab0e0e"}
Sep 10 16:25:54.171772 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:54.171333    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"
Sep 10 16:25:54.173005 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:54.172979    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd" event={"ID":"6a84cc65-2f6a-44c8-8d36-b92737122041","Type":"ContainerStarted","Data":"fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9"}
Sep 10 16:25:54.173111 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:54.173023    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd" event={"ID":"6a84cc65-2f6a-44c8-8d36-b92737122041","Type":"ContainerStarted","Data":"fdc3879030e48011a70af703f72054c9b9f9e43d5d13f4ec88a9bc698c5f07d2"}
Sep 10 16:25:54.173111 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:54.173071    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"
Sep 10 16:25:54.202134 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:54.202091    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d" podStartSLOduration=2.202075933 podStartE2EDuration="2.202075933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:25:54.200077372 +0000 UTC m=+1438.612163581" watchObservedRunningTime="2026-09-10 16:25:54.202075933 +0000 UTC m=+1438.614162142"
Sep 10 16:25:54.225340 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:54.225296    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd" podStartSLOduration=2.22528211 podStartE2EDuration="2.22528211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:25:54.223349786 +0000 UTC m=+1438.635436017" watchObservedRunningTime="2026-09-10 16:25:54.22528211 +0000 UTC m=+1438.637368319"
Sep 10 16:25:56.250130 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:25:56.250095    2562 scope.go:117] "RemoveContainer" containerID="39b15be8025f33d47ded4b36a9a6ef89caf5ebb581b8e6c38e1c929294bb9851"
Sep 10 16:26:05.180226 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:05.180191    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"
Sep 10 16:26:05.180636 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:05.180549    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"
Sep 10 16:26:55.121291 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:55.121252    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8"]
Sep 10 16:26:55.124811 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:55.124794    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8"
Sep 10 16:26:55.127997 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:55.127970    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l2dj2\""
Sep 10 16:26:55.134712 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:55.134686    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8"]
Sep 10 16:26:55.214330 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:55.214295    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf5b0bcc-35b2-47f4-ab31-321b6375a169-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8\" (UID: \"bf5b0bcc-35b2-47f4-ab31-321b6375a169\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8"
Sep 10 16:26:55.315670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:55.315638    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf5b0bcc-35b2-47f4-ab31-321b6375a169-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8\" (UID: \"bf5b0bcc-35b2-47f4-ab31-321b6375a169\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8"
Sep 10 16:26:55.316335 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:55.316313    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf5b0bcc-35b2-47f4-ab31-321b6375a169-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8\" (UID: \"bf5b0bcc-35b2-47f4-ab31-321b6375a169\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8"
Sep 10 16:26:55.436104 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:55.436022    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8"
Sep 10 16:26:55.711040 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:55.711014    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8"]
Sep 10 16:26:55.713493 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:26:55.713464    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5b0bcc_35b2_47f4_ab31_321b6375a169.slice/crio-744619563c69a3b10a7b22709adf264ca88644581c8263526e3c792d25bda3c3 WatchSource:0}: Error finding container 744619563c69a3b10a7b22709adf264ca88644581c8263526e3c792d25bda3c3: Status 404 returned error can't find the container with id 744619563c69a3b10a7b22709adf264ca88644581c8263526e3c792d25bda3c3
Sep 10 16:26:56.271237 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:56.271201    2562 scope.go:117] "RemoveContainer" containerID="1e16098671cf84d35b28f31b1bf83180a51a5a5febbc18a14abfcd8eb2ec98ab"
Sep 10 16:26:56.279871 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:56.279848    2562 scope.go:117] "RemoveContainer" containerID="6946c907893234afa3ebf081f82c67d2b6735218355327b942bf9600a610fb6f"
Sep 10 16:26:56.529787 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:56.529720    2562 generic.go:356] "Generic (PLEG): container finished" podID="bf5b0bcc-35b2-47f4-ab31-321b6375a169" containerID="3565a3e419d22a755392177e0acf3fff47b4011ee3a6f1ef74c7c72833787696" exitCode=0
Sep 10 16:26:56.529949 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:56.529828    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8" event={"ID":"bf5b0bcc-35b2-47f4-ab31-321b6375a169","Type":"ContainerDied","Data":"3565a3e419d22a755392177e0acf3fff47b4011ee3a6f1ef74c7c72833787696"}
Sep 10 16:26:56.529949 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:56.529906    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8" event={"ID":"bf5b0bcc-35b2-47f4-ab31-321b6375a169","Type":"ContainerStarted","Data":"744619563c69a3b10a7b22709adf264ca88644581c8263526e3c792d25bda3c3"}
Sep 10 16:26:57.678747 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:57.678712    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8"
Sep 10 16:26:57.840478 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:57.840379    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf5b0bcc-35b2-47f4-ab31-321b6375a169-maas-api-service-ca\") pod \"bf5b0bcc-35b2-47f4-ab31-321b6375a169\" (UID: \"bf5b0bcc-35b2-47f4-ab31-321b6375a169\") "
Sep 10 16:26:57.840803 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:57.840768    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf5b0bcc-35b2-47f4-ab31-321b6375a169-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bf5b0bcc-35b2-47f4-ab31-321b6375a169" (UID: "bf5b0bcc-35b2-47f4-ab31-321b6375a169"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:26:57.941269 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:57.941234    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf5b0bcc-35b2-47f4-ab31-321b6375a169-maas-api-service-ca\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:26:58.541697 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:58.541666    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8"
Sep 10 16:26:58.541901 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:58.541657    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8" event={"ID":"bf5b0bcc-35b2-47f4-ab31-321b6375a169","Type":"ContainerDied","Data":"744619563c69a3b10a7b22709adf264ca88644581c8263526e3c792d25bda3c3"}
Sep 10 16:26:58.541901 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:26:58.541790    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="744619563c69a3b10a7b22709adf264ca88644581c8263526e3c792d25bda3c3"
Sep 10 16:27:11.032437 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.032404    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"]
Sep 10 16:27:11.032927 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.032637    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd" podUID="6a84cc65-2f6a-44c8-8d36-b92737122041" containerName="payload-processing" containerID="cri-o://fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9" gracePeriod=30
Sep 10 16:27:11.040684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.040653    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"]
Sep 10 16:27:11.040965 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.040915    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d" podUID="2608efdf-db35-456f-9807-500cdf670a57" containerName="payload-pre-processing" containerID="cri-o://833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16" gracePeriod=30
Sep 10 16:27:11.333655 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.333629    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"
Sep 10 16:27:11.336353 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.336331    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"
Sep 10 16:27:11.368211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.368176    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a84cc65-2f6a-44c8-8d36-b92737122041-plugins-config-volume\") pod \"6a84cc65-2f6a-44c8-8d36-b92737122041\" (UID: \"6a84cc65-2f6a-44c8-8d36-b92737122041\") "
Sep 10 16:27:11.368373 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.368277    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2608efdf-db35-456f-9807-500cdf670a57-plugins-config-volume\") pod \"2608efdf-db35-456f-9807-500cdf670a57\" (UID: \"2608efdf-db35-456f-9807-500cdf670a57\") "
Sep 10 16:27:11.368412 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.368384    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k4p6\" (UniqueName: \"kubernetes.io/projected/2608efdf-db35-456f-9807-500cdf670a57-kube-api-access-7k4p6\") pod \"2608efdf-db35-456f-9807-500cdf670a57\" (UID: \"2608efdf-db35-456f-9807-500cdf670a57\") "
Sep 10 16:27:11.368449 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.368420    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4knj\" (UniqueName: \"kubernetes.io/projected/6a84cc65-2f6a-44c8-8d36-b92737122041-kube-api-access-g4knj\") pod \"6a84cc65-2f6a-44c8-8d36-b92737122041\" (UID: \"6a84cc65-2f6a-44c8-8d36-b92737122041\") "
Sep 10 16:27:11.368652 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.368626    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a84cc65-2f6a-44c8-8d36-b92737122041-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a84cc65-2f6a-44c8-8d36-b92737122041" (UID: "6a84cc65-2f6a-44c8-8d36-b92737122041"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:27:11.368705 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.368658    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2608efdf-db35-456f-9807-500cdf670a57-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2608efdf-db35-456f-9807-500cdf670a57" (UID: "2608efdf-db35-456f-9807-500cdf670a57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:27:11.368866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.368850    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2608efdf-db35-456f-9807-500cdf670a57-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:27:11.368916 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.368869    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a84cc65-2f6a-44c8-8d36-b92737122041-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:27:11.370581 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.370559    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2608efdf-db35-456f-9807-500cdf670a57-kube-api-access-7k4p6" (OuterVolumeSpecName: "kube-api-access-7k4p6") pod "2608efdf-db35-456f-9807-500cdf670a57" (UID: "2608efdf-db35-456f-9807-500cdf670a57"). InnerVolumeSpecName "kube-api-access-7k4p6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:27:11.370700 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.370586    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a84cc65-2f6a-44c8-8d36-b92737122041-kube-api-access-g4knj" (OuterVolumeSpecName: "kube-api-access-g4knj") pod "6a84cc65-2f6a-44c8-8d36-b92737122041" (UID: "6a84cc65-2f6a-44c8-8d36-b92737122041"). InnerVolumeSpecName "kube-api-access-g4knj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:27:11.386916 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.386881    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8"]
Sep 10 16:27:11.392443 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.392415    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7dabb3eb-zhbz8"]
Sep 10 16:27:11.470084 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.470049    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k4p6\" (UniqueName: \"kubernetes.io/projected/2608efdf-db35-456f-9807-500cdf670a57-kube-api-access-7k4p6\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:27:11.470084 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.470076    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4knj\" (UniqueName: \"kubernetes.io/projected/6a84cc65-2f6a-44c8-8d36-b92737122041-kube-api-access-g4knj\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:27:11.614856 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.614757    2562 generic.go:356] "Generic (PLEG): container finished" podID="2608efdf-db35-456f-9807-500cdf670a57" containerID="833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16" exitCode=0
Sep 10 16:27:11.614856 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.614813    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"
Sep 10 16:27:11.615081 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.614846    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d" event={"ID":"2608efdf-db35-456f-9807-500cdf670a57","Type":"ContainerDied","Data":"833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16"}
Sep 10 16:27:11.615081 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.614913    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d" event={"ID":"2608efdf-db35-456f-9807-500cdf670a57","Type":"ContainerDied","Data":"610754be416ca84fefd7ae3293ce19ce0380d6b35794f56c48499a5a5fab0e0e"}
Sep 10 16:27:11.615081 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.614948    2562 scope.go:117] "RemoveContainer" containerID="833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16"
Sep 10 16:27:11.616248 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.616230    2562 generic.go:356] "Generic (PLEG): container finished" podID="6a84cc65-2f6a-44c8-8d36-b92737122041" containerID="fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9" exitCode=0
Sep 10 16:27:11.616353 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.616269    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"
Sep 10 16:27:11.616353 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.616304    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd" event={"ID":"6a84cc65-2f6a-44c8-8d36-b92737122041","Type":"ContainerDied","Data":"fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9"}
Sep 10 16:27:11.616353 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.616339    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd" event={"ID":"6a84cc65-2f6a-44c8-8d36-b92737122041","Type":"ContainerDied","Data":"fdc3879030e48011a70af703f72054c9b9f9e43d5d13f4ec88a9bc698c5f07d2"}
Sep 10 16:27:11.625419 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.625400    2562 scope.go:117] "RemoveContainer" containerID="833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16"
Sep 10 16:27:11.625720 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:27:11.625700    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16\": container with ID starting with 833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16 not found: ID does not exist" containerID="833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16"
Sep 10 16:27:11.625720 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.625754    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16"} err="failed to get container status \"833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16\": rpc error: code = NotFound desc = could not find container \"833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16\": container with ID starting with 833f56f548577d52e1e2da15f7a37aec7137db75b8d5b0336e18ac438b832b16 not found: ID does not exist"
Sep 10 16:27:11.625873 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.625772    2562 scope.go:117] "RemoveContainer" containerID="fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9"
Sep 10 16:27:11.634610 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.634591    2562 scope.go:117] "RemoveContainer" containerID="fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9"
Sep 10 16:27:11.634906 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:27:11.634888    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9\": container with ID starting with fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9 not found: ID does not exist" containerID="fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9"
Sep 10 16:27:11.634945 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.634915    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9"} err="failed to get container status \"fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9\": rpc error: code = NotFound desc = could not find container \"fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9\": container with ID starting with fbd7622911328b615fec04c4bb6404391cabcca0fe7cc1b33be2a2993c735bc9 not found: ID does not exist"
Sep 10 16:27:11.645893 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.645866    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"]
Sep 10 16:27:11.649670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.649639    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7dabb3eb-5596c69c6f-ws9nd"]
Sep 10 16:27:11.665883 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.665856    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"]
Sep 10 16:27:11.671734 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:11.671686    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7dabb3eb-84d45cd878-5k94d"]
Sep 10 16:27:12.072211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:12.072179    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2608efdf-db35-456f-9807-500cdf670a57" path="/var/lib/kubelet/pods/2608efdf-db35-456f-9807-500cdf670a57/volumes"
Sep 10 16:27:12.072640 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:12.072624    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a84cc65-2f6a-44c8-8d36-b92737122041" path="/var/lib/kubelet/pods/6a84cc65-2f6a-44c8-8d36-b92737122041/volumes"
Sep 10 16:27:12.073018 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:27:12.073004    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf5b0bcc-35b2-47f4-ab31-321b6375a169" path="/var/lib/kubelet/pods/bf5b0bcc-35b2-47f4-ab31-321b6375a169/volumes"
Sep 10 16:28:56.327958 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:28:56.327926    2562 scope.go:117] "RemoveContainer" containerID="c3899c8e366bb08e99f0b47d2e625eb66928fb2a18e7c18a4d7b5d0d918cc3be"
Sep 10 16:28:56.336441 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:28:56.336420    2562 scope.go:117] "RemoveContainer" containerID="eb735e468337ae186f6813b42fcb859264f0780625d335183352a3277f969f3b"
Sep 10 16:28:56.344107 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:28:56.344089    2562 scope.go:117] "RemoveContainer" containerID="a727506ec83c2a2d16bbac9f248136ccfcf601b2368204dd2d6a75fe33311488"
Sep 10 16:29:07.051927 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.051893    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"]
Sep 10 16:29:07.052336 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.052323    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf5b0bcc-35b2-47f4-ab31-321b6375a169" containerName="revoke-keys"
Sep 10 16:29:07.052336 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.052337    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf5b0bcc-35b2-47f4-ab31-321b6375a169" containerName="revoke-keys"
Sep 10 16:29:07.052412 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.052353    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a84cc65-2f6a-44c8-8d36-b92737122041" containerName="payload-processing"
Sep 10 16:29:07.052412 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.052360    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a84cc65-2f6a-44c8-8d36-b92737122041" containerName="payload-processing"
Sep 10 16:29:07.052412 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.052386    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2608efdf-db35-456f-9807-500cdf670a57" containerName="payload-pre-processing"
Sep 10 16:29:07.052412 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.052391    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2608efdf-db35-456f-9807-500cdf670a57" containerName="payload-pre-processing"
Sep 10 16:29:07.052531 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.052447    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a84cc65-2f6a-44c8-8d36-b92737122041" containerName="payload-processing"
Sep 10 16:29:07.052531 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.052455    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf5b0bcc-35b2-47f4-ab31-321b6375a169" containerName="revoke-keys"
Sep 10 16:29:07.052531 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.052464    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2608efdf-db35-456f-9807-500cdf670a57" containerName="payload-pre-processing"
Sep 10 16:29:07.055437 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.055420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"
Sep 10 16:29:07.058449 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.058432    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-ab677e\""
Sep 10 16:29:07.070764 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.070741    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"]
Sep 10 16:29:07.118960 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.118919    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"]
Sep 10 16:29:07.122290 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.122273    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"
Sep 10 16:29:07.125487 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.125466    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-ab677e-dockercfg-hbkm5\""
Sep 10 16:29:07.130574 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.130539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76b7bcdf-7f98-459c-a411-0a39cc2985af-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls\" (UID: \"76b7bcdf-7f98-459c-a411-0a39cc2985af\") " pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"
Sep 10 16:29:07.130670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.130623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqdv2\" (UniqueName: \"kubernetes.io/projected/76b7bcdf-7f98-459c-a411-0a39cc2985af-kube-api-access-lqdv2\") pod \"payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls\" (UID: \"76b7bcdf-7f98-459c-a411-0a39cc2985af\") " pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"
Sep 10 16:29:07.136910 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.136885    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"]
Sep 10 16:29:07.231941 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.231903    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76b7bcdf-7f98-459c-a411-0a39cc2985af-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls\" (UID: \"76b7bcdf-7f98-459c-a411-0a39cc2985af\") " pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"
Sep 10 16:29:07.232101 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.231954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd69a330-9469-4644-906a-a355ec6f4c76-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45\" (UID: \"dd69a330-9469-4644-906a-a355ec6f4c76\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"
Sep 10 16:29:07.232101 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.231982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqdv2\" (UniqueName: \"kubernetes.io/projected/76b7bcdf-7f98-459c-a411-0a39cc2985af-kube-api-access-lqdv2\") pod \"payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls\" (UID: \"76b7bcdf-7f98-459c-a411-0a39cc2985af\") " pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"
Sep 10 16:29:07.232101 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.232010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkbh9\" (UniqueName: \"kubernetes.io/projected/dd69a330-9469-4644-906a-a355ec6f4c76-kube-api-access-mkbh9\") pod \"payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45\" (UID: \"dd69a330-9469-4644-906a-a355ec6f4c76\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"
Sep 10 16:29:07.232600 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.232582    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76b7bcdf-7f98-459c-a411-0a39cc2985af-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls\" (UID: \"76b7bcdf-7f98-459c-a411-0a39cc2985af\") " pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"
Sep 10 16:29:07.246590 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.246560    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqdv2\" (UniqueName: \"kubernetes.io/projected/76b7bcdf-7f98-459c-a411-0a39cc2985af-kube-api-access-lqdv2\") pod \"payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls\" (UID: \"76b7bcdf-7f98-459c-a411-0a39cc2985af\") " pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"
Sep 10 16:29:07.333044 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.332978    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd69a330-9469-4644-906a-a355ec6f4c76-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45\" (UID: \"dd69a330-9469-4644-906a-a355ec6f4c76\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"
Sep 10 16:29:07.333044 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.333025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkbh9\" (UniqueName: \"kubernetes.io/projected/dd69a330-9469-4644-906a-a355ec6f4c76-kube-api-access-mkbh9\") pod \"payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45\" (UID: \"dd69a330-9469-4644-906a-a355ec6f4c76\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"
Sep 10 16:29:07.333843 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.333817    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd69a330-9469-4644-906a-a355ec6f4c76-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45\" (UID: \"dd69a330-9469-4644-906a-a355ec6f4c76\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"
Sep 10 16:29:07.347911 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.347885    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkbh9\" (UniqueName: \"kubernetes.io/projected/dd69a330-9469-4644-906a-a355ec6f4c76-kube-api-access-mkbh9\") pod \"payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45\" (UID: \"dd69a330-9469-4644-906a-a355ec6f4c76\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"
Sep 10 16:29:07.365001 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.364979    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"
Sep 10 16:29:07.432328 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.432170    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"
Sep 10 16:29:07.643178 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.643152    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"]
Sep 10 16:29:07.644834 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:29:07.644806    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b7bcdf_7f98_459c_a411_0a39cc2985af.slice/crio-f317e9b1dae92103ca9e7ff83cadee63f838e5999b6e8b79f1cd1e0196543147 WatchSource:0}: Error finding container f317e9b1dae92103ca9e7ff83cadee63f838e5999b6e8b79f1cd1e0196543147: Status 404 returned error can't find the container with id f317e9b1dae92103ca9e7ff83cadee63f838e5999b6e8b79f1cd1e0196543147
Sep 10 16:29:07.726123 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:07.726102    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"]
Sep 10 16:29:07.729050 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:29:07.729029    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd69a330_9469_4644_906a_a355ec6f4c76.slice/crio-703e76ce97d35f9857a10fe4ba1be1fe5619e656154f580584edce7c3e4ab4aa WatchSource:0}: Error finding container 703e76ce97d35f9857a10fe4ba1be1fe5619e656154f580584edce7c3e4ab4aa: Status 404 returned error can't find the container with id 703e76ce97d35f9857a10fe4ba1be1fe5619e656154f580584edce7c3e4ab4aa
Sep 10 16:29:08.257681 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:08.257637    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45" event={"ID":"dd69a330-9469-4644-906a-a355ec6f4c76","Type":"ContainerStarted","Data":"5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d"}
Sep 10 16:29:08.258171 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:08.257719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45" event={"ID":"dd69a330-9469-4644-906a-a355ec6f4c76","Type":"ContainerStarted","Data":"703e76ce97d35f9857a10fe4ba1be1fe5619e656154f580584edce7c3e4ab4aa"}
Sep 10 16:29:08.258171 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:08.257850    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"
Sep 10 16:29:08.259483 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:08.259458    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls" event={"ID":"76b7bcdf-7f98-459c-a411-0a39cc2985af","Type":"ContainerStarted","Data":"1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b"}
Sep 10 16:29:08.259617 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:08.259496    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls" event={"ID":"76b7bcdf-7f98-459c-a411-0a39cc2985af","Type":"ContainerStarted","Data":"f317e9b1dae92103ca9e7ff83cadee63f838e5999b6e8b79f1cd1e0196543147"}
Sep 10 16:29:08.259617 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:08.259530    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"
Sep 10 16:29:08.278792 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:08.278751    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45" podStartSLOduration=1.278713783 podStartE2EDuration="1.278713783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:29:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:29:08.278019668 +0000 UTC m=+1632.690105881" watchObservedRunningTime="2026-09-10 16:29:08.278713783 +0000 UTC m=+1632.690799983"
Sep 10 16:29:08.303467 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:08.303418    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls" podStartSLOduration=1.303404295 podStartE2EDuration="1.303404295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:29:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:29:08.301214564 +0000 UTC m=+1632.713300773" watchObservedRunningTime="2026-09-10 16:29:08.303404295 +0000 UTC m=+1632.715490541"
Sep 10 16:29:19.266860 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:19.266822    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"
Sep 10 16:29:19.267328 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:19.266999    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"
Sep 10 16:29:36.219802 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.219765    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"]
Sep 10 16:29:36.223720 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.223696    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"
Sep 10 16:29:36.229057 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.229036    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-cde4a2\""
Sep 10 16:29:36.229260 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.229245    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-cde4a2-dockercfg-pjhgp\""
Sep 10 16:29:36.242309 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.242284    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"]
Sep 10 16:29:36.303890 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.303856    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"]
Sep 10 16:29:36.307871 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.307854    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"
Sep 10 16:29:36.321075 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.321052    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q9wl\" (UniqueName: \"kubernetes.io/projected/941424d1-e50f-4b0f-b6ee-ab7bc1051202-kube-api-access-7q9wl\") pod \"payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn\" (UID: \"941424d1-e50f-4b0f-b6ee-ab7bc1051202\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"
Sep 10 16:29:36.321189 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.321113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/941424d1-e50f-4b0f-b6ee-ab7bc1051202-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn\" (UID: \"941424d1-e50f-4b0f-b6ee-ab7bc1051202\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"
Sep 10 16:29:36.322109 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.322091    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"]
Sep 10 16:29:36.422453 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.422419    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q9wl\" (UniqueName: \"kubernetes.io/projected/941424d1-e50f-4b0f-b6ee-ab7bc1051202-kube-api-access-7q9wl\") pod \"payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn\" (UID: \"941424d1-e50f-4b0f-b6ee-ab7bc1051202\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"
Sep 10 16:29:36.422612 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.422493    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/941424d1-e50f-4b0f-b6ee-ab7bc1051202-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn\" (UID: \"941424d1-e50f-4b0f-b6ee-ab7bc1051202\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"
Sep 10 16:29:36.422612 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.422569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx475\" (UniqueName: \"kubernetes.io/projected/7f2d2917-a016-4f05-a819-6e908447cdbb-kube-api-access-dx475\") pod \"payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx\" (UID: \"7f2d2917-a016-4f05-a819-6e908447cdbb\") " pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"
Sep 10 16:29:36.422717 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.422636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f2d2917-a016-4f05-a819-6e908447cdbb-plugins-config-volume\") pod \"payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx\" (UID: \"7f2d2917-a016-4f05-a819-6e908447cdbb\") " pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"
Sep 10 16:29:36.423200 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.423180    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/941424d1-e50f-4b0f-b6ee-ab7bc1051202-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn\" (UID: \"941424d1-e50f-4b0f-b6ee-ab7bc1051202\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"
Sep 10 16:29:36.433075 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.433053    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q9wl\" (UniqueName: \"kubernetes.io/projected/941424d1-e50f-4b0f-b6ee-ab7bc1051202-kube-api-access-7q9wl\") pod \"payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn\" (UID: \"941424d1-e50f-4b0f-b6ee-ab7bc1051202\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"
Sep 10 16:29:36.523504 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.523470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx475\" (UniqueName: \"kubernetes.io/projected/7f2d2917-a016-4f05-a819-6e908447cdbb-kube-api-access-dx475\") pod \"payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx\" (UID: \"7f2d2917-a016-4f05-a819-6e908447cdbb\") " pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"
Sep 10 16:29:36.523655 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.523527    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f2d2917-a016-4f05-a819-6e908447cdbb-plugins-config-volume\") pod \"payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx\" (UID: \"7f2d2917-a016-4f05-a819-6e908447cdbb\") " pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"
Sep 10 16:29:36.524195 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.524176    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f2d2917-a016-4f05-a819-6e908447cdbb-plugins-config-volume\") pod \"payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx\" (UID: \"7f2d2917-a016-4f05-a819-6e908447cdbb\") " pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"
Sep 10 16:29:36.533096 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.533071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx475\" (UniqueName: \"kubernetes.io/projected/7f2d2917-a016-4f05-a819-6e908447cdbb-kube-api-access-dx475\") pod \"payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx\" (UID: \"7f2d2917-a016-4f05-a819-6e908447cdbb\") " pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"
Sep 10 16:29:36.534057 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.534037    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"
Sep 10 16:29:36.618190 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.618162    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"
Sep 10 16:29:36.808245 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.808222    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"]
Sep 10 16:29:36.809957 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:29:36.809931    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod941424d1_e50f_4b0f_b6ee_ab7bc1051202.slice/crio-9dc4e0a04040279d504d6d449e41d6d69c1ca4fd8c319997465286cb42757c59 WatchSource:0}: Error finding container 9dc4e0a04040279d504d6d449e41d6d69c1ca4fd8c319997465286cb42757c59: Status 404 returned error can't find the container with id 9dc4e0a04040279d504d6d449e41d6d69c1ca4fd8c319997465286cb42757c59
Sep 10 16:29:36.894755 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:36.894715    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"]
Sep 10 16:29:36.896188 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:29:36.896161    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2d2917_a016_4f05_a819_6e908447cdbb.slice/crio-75b18b4aba7cfc3f4fef7cbbaaff110e2d7f26cc75f91dc392783c379e896fbf WatchSource:0}: Error finding container 75b18b4aba7cfc3f4fef7cbbaaff110e2d7f26cc75f91dc392783c379e896fbf: Status 404 returned error can't find the container with id 75b18b4aba7cfc3f4fef7cbbaaff110e2d7f26cc75f91dc392783c379e896fbf
Sep 10 16:29:37.416932 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:37.416901    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn" event={"ID":"941424d1-e50f-4b0f-b6ee-ab7bc1051202","Type":"ContainerStarted","Data":"23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163"}
Sep 10 16:29:37.417375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:37.416960    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn" event={"ID":"941424d1-e50f-4b0f-b6ee-ab7bc1051202","Type":"ContainerStarted","Data":"9dc4e0a04040279d504d6d449e41d6d69c1ca4fd8c319997465286cb42757c59"}
Sep 10 16:29:37.417375 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:37.417076    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"
Sep 10 16:29:37.418373 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:37.418352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx" event={"ID":"7f2d2917-a016-4f05-a819-6e908447cdbb","Type":"ContainerStarted","Data":"00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf"}
Sep 10 16:29:37.418471 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:37.418387    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx" event={"ID":"7f2d2917-a016-4f05-a819-6e908447cdbb","Type":"ContainerStarted","Data":"75b18b4aba7cfc3f4fef7cbbaaff110e2d7f26cc75f91dc392783c379e896fbf"}
Sep 10 16:29:37.418510 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:37.418469    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"
Sep 10 16:29:37.445821 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:37.445772    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn" podStartSLOduration=1.44575519 podStartE2EDuration="1.44575519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:29:37.442538816 +0000 UTC m=+1661.854625023" watchObservedRunningTime="2026-09-10 16:29:37.44575519 +0000 UTC m=+1661.857841396"
Sep 10 16:29:37.471813 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:37.471766    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx" podStartSLOduration=1.471754159 podStartE2EDuration="1.471754159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:29:37.468669175 +0000 UTC m=+1661.880755383" watchObservedRunningTime="2026-09-10 16:29:37.471754159 +0000 UTC m=+1661.883840366"
Sep 10 16:29:48.425253 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:48.425221    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"
Sep 10 16:29:48.425717 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:29:48.425327    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"
Sep 10 16:30:00.173968 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.173933    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817630-9lmx9"]
Sep 10 16:30:00.177552 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.177529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817630-9lmx9"
Sep 10 16:30:00.178144 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.178125    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-90bd7e-29817630-5fd5j"]
Sep 10 16:30:00.181053 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.181033    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l2dj2\""
Sep 10 16:30:00.181350 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.181335    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-90bd7e-29817630-5fd5j"
Sep 10 16:30:00.188964 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.188941    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817630-9lmx9"
Sep 10 16:30:00.190511 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.190491    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817630-9lmx9"]
Sep 10 16:30:00.198509 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.198488    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-90bd7e-29817630-5fd5j"
Sep 10 16:30:00.210361 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.210337    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw"]
Sep 10 16:30:00.215305 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.215282    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw"
Sep 10 16:30:00.223861 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.223832    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-90bd7e-29817630-5fd5j"]
Sep 10 16:30:00.228877 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.228513    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw"]
Sep 10 16:30:00.252074 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.251882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw"
Sep 10 16:30:00.489257 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.489208    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-90bd7e-29817630-5fd5j"]
Sep 10 16:30:00.492144 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:30:00.492051    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0bd0b9_78c2_43a1_a514_2002e5870cfd.slice/crio-819db789bec92f5eedd5ebc64aa24b97a969f8926ed669a7bea39d60712dbba7 WatchSource:0}: Error finding container 819db789bec92f5eedd5ebc64aa24b97a969f8926ed669a7bea39d60712dbba7: Status 404 returned error can't find the container with id 819db789bec92f5eedd5ebc64aa24b97a969f8926ed669a7bea39d60712dbba7
Sep 10 16:30:00.492774 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.492750    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817630-9lmx9"]
Sep 10 16:30:00.494275 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:30:00.494135    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d1a628_1158_4ebb_95f1_9e70ef202955.slice/crio-b0a96f2ec039a06a7440b075e47185fe6fa783c307b1ef4811e357e3eb3fef9c WatchSource:0}: Error finding container b0a96f2ec039a06a7440b075e47185fe6fa783c307b1ef4811e357e3eb3fef9c: Status 404 returned error can't find the container with id b0a96f2ec039a06a7440b075e47185fe6fa783c307b1ef4811e357e3eb3fef9c
Sep 10 16:30:00.543949 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.543920    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-90bd7e-29817630-5fd5j" event={"ID":"9c0bd0b9-78c2-43a1-a514-2002e5870cfd","Type":"ContainerStarted","Data":"819db789bec92f5eedd5ebc64aa24b97a969f8926ed669a7bea39d60712dbba7"}
Sep 10 16:30:00.544765 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.544602    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw"]
Sep 10 16:30:00.545778 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:00.545748    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817630-9lmx9" event={"ID":"f4d1a628-1158-4ebb-95f1-9e70ef202955","Type":"ContainerStarted","Data":"b0a96f2ec039a06a7440b075e47185fe6fa783c307b1ef4811e357e3eb3fef9c"}
Sep 10 16:30:00.546962 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:30:00.546934    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e05be48_937f_4129_8be1_8b9e88072a6f.slice/crio-6634c9e295bebb57d09e0ba78561363a0de08c7397a14b4fbde11369f345bbc6 WatchSource:0}: Error finding container 6634c9e295bebb57d09e0ba78561363a0de08c7397a14b4fbde11369f345bbc6: Status 404 returned error can't find the container with id 6634c9e295bebb57d09e0ba78561363a0de08c7397a14b4fbde11369f345bbc6
Sep 10 16:30:01.552950 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:01.552924    2562 generic.go:356] "Generic (PLEG): container finished" podID="f4d1a628-1158-4ebb-95f1-9e70ef202955" containerID="e99843ece35d3f4fdfafea292b95203867a7543b52df177e194d592deeb37ab1" exitCode=0
Sep 10 16:30:01.553313 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:01.553000    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817630-9lmx9" event={"ID":"f4d1a628-1158-4ebb-95f1-9e70ef202955","Type":"ContainerDied","Data":"e99843ece35d3f4fdfafea292b95203867a7543b52df177e194d592deeb37ab1"}
Sep 10 16:30:01.554658 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:01.554631    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw" event={"ID":"6e05be48-937f-4129-8be1-8b9e88072a6f","Type":"ContainerStarted","Data":"f91cf8f6f18beb012edc076cbef4650f0a6c591d647ea4fc42955582e3ca4654"}
Sep 10 16:30:01.554780 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:01.554682    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw" event={"ID":"6e05be48-937f-4129-8be1-8b9e88072a6f","Type":"ContainerStarted","Data":"6634c9e295bebb57d09e0ba78561363a0de08c7397a14b4fbde11369f345bbc6"}
Sep 10 16:30:01.556128 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:01.556099    2562 generic.go:356] "Generic (PLEG): container finished" podID="9c0bd0b9-78c2-43a1-a514-2002e5870cfd" containerID="8ede9e01e63b6af9a4d48cd0c951d3fda3430da2033e988420e5b2708a1be092" exitCode=0
Sep 10 16:30:01.556201 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:01.556165    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-90bd7e-29817630-5fd5j" event={"ID":"9c0bd0b9-78c2-43a1-a514-2002e5870cfd","Type":"ContainerDied","Data":"8ede9e01e63b6af9a4d48cd0c951d3fda3430da2033e988420e5b2708a1be092"}
Sep 10 16:30:01.602481 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:01.602438    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw" podStartSLOduration=1.602423385 podStartE2EDuration="1.602423385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:30:01.600471533 +0000 UTC m=+1686.012557743" watchObservedRunningTime="2026-09-10 16:30:01.602423385 +0000 UTC m=+1686.014509593"
Sep 10 16:30:01.871559 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:01.871525    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7"]
Sep 10 16:30:01.875391 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:01.875369    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7"
Sep 10 16:30:01.885687 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:01.885653    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7"]
Sep 10 16:30:01.953652 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:01.953625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63ff6af-af6e-45a5-965d-c4bac535d5c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ab677e-stcw7\" (UID: \"a63ff6af-af6e-45a5-965d-c4bac535d5c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7"
Sep 10 16:30:02.054946 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:02.054920    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63ff6af-af6e-45a5-965d-c4bac535d5c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ab677e-stcw7\" (UID: \"a63ff6af-af6e-45a5-965d-c4bac535d5c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7"
Sep 10 16:30:02.055508 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:02.055487    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63ff6af-af6e-45a5-965d-c4bac535d5c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ab677e-stcw7\" (UID: \"a63ff6af-af6e-45a5-965d-c4bac535d5c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7"
Sep 10 16:30:02.185760 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:02.185656    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7"
Sep 10 16:30:02.461766 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:02.460245    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7"]
Sep 10 16:30:02.462632 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:30:02.462587    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda63ff6af_af6e_45a5_965d_c4bac535d5c2.slice/crio-0a618fc776e02bd6f923d8eb6b6d5b275b88920f2e6acf87928ae59ad9fdc40b WatchSource:0}: Error finding container 0a618fc776e02bd6f923d8eb6b6d5b275b88920f2e6acf87928ae59ad9fdc40b: Status 404 returned error can't find the container with id 0a618fc776e02bd6f923d8eb6b6d5b275b88920f2e6acf87928ae59ad9fdc40b
Sep 10 16:30:02.565153 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:02.565119    2562 generic.go:356] "Generic (PLEG): container finished" podID="6e05be48-937f-4129-8be1-8b9e88072a6f" containerID="f91cf8f6f18beb012edc076cbef4650f0a6c591d647ea4fc42955582e3ca4654" exitCode=0
Sep 10 16:30:02.565582 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:02.565213    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw" event={"ID":"6e05be48-937f-4129-8be1-8b9e88072a6f","Type":"ContainerDied","Data":"f91cf8f6f18beb012edc076cbef4650f0a6c591d647ea4fc42955582e3ca4654"}
Sep 10 16:30:02.566544 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:02.566520    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7" event={"ID":"a63ff6af-af6e-45a5-965d-c4bac535d5c2","Type":"ContainerStarted","Data":"0a618fc776e02bd6f923d8eb6b6d5b275b88920f2e6acf87928ae59ad9fdc40b"}
Sep 10 16:30:02.704612 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:02.704589    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-90bd7e-29817630-5fd5j"
Sep 10 16:30:02.723306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:02.723285    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817630-9lmx9"
Sep 10 16:30:03.575366 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:03.575338    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817630-9lmx9"
Sep 10 16:30:03.575843 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:03.575370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817630-9lmx9" event={"ID":"f4d1a628-1158-4ebb-95f1-9e70ef202955","Type":"ContainerDied","Data":"b0a96f2ec039a06a7440b075e47185fe6fa783c307b1ef4811e357e3eb3fef9c"}
Sep 10 16:30:03.575843 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:03.575430    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0a96f2ec039a06a7440b075e47185fe6fa783c307b1ef4811e357e3eb3fef9c"
Sep 10 16:30:03.577067 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:03.577046    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-90bd7e-29817630-5fd5j"
Sep 10 16:30:03.577205 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:03.577044    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-90bd7e-29817630-5fd5j" event={"ID":"9c0bd0b9-78c2-43a1-a514-2002e5870cfd","Type":"ContainerDied","Data":"819db789bec92f5eedd5ebc64aa24b97a969f8926ed669a7bea39d60712dbba7"}
Sep 10 16:30:03.577205 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:03.577177    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="819db789bec92f5eedd5ebc64aa24b97a969f8926ed669a7bea39d60712dbba7"
Sep 10 16:30:03.578858 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:03.578834    2562 generic.go:356] "Generic (PLEG): container finished" podID="a63ff6af-af6e-45a5-965d-c4bac535d5c2" containerID="fbfd676ce7e90f7b9b399761a25358d539b2e1b30d3cebe790a7256c863fe344" exitCode=0
Sep 10 16:30:03.578980 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:03.578881    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7" event={"ID":"a63ff6af-af6e-45a5-965d-c4bac535d5c2","Type":"ContainerDied","Data":"fbfd676ce7e90f7b9b399761a25358d539b2e1b30d3cebe790a7256c863fe344"}
Sep 10 16:30:03.730353 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:03.730331    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw"
Sep 10 16:30:04.586152 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:04.586121    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw"
Sep 10 16:30:04.586526 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:04.586157    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw" event={"ID":"6e05be48-937f-4129-8be1-8b9e88072a6f","Type":"ContainerDied","Data":"6634c9e295bebb57d09e0ba78561363a0de08c7397a14b4fbde11369f345bbc6"}
Sep 10 16:30:04.586526 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:04.586197    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6634c9e295bebb57d09e0ba78561363a0de08c7397a14b4fbde11369f345bbc6"
Sep 10 16:30:04.723452 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:04.723428    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7"
Sep 10 16:30:04.781187 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:04.781148    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63ff6af-af6e-45a5-965d-c4bac535d5c2-maas-api-service-ca\") pod \"a63ff6af-af6e-45a5-965d-c4bac535d5c2\" (UID: \"a63ff6af-af6e-45a5-965d-c4bac535d5c2\") "
Sep 10 16:30:04.781672 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:04.781637    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a63ff6af-af6e-45a5-965d-c4bac535d5c2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a63ff6af-af6e-45a5-965d-c4bac535d5c2" (UID: "a63ff6af-af6e-45a5-965d-c4bac535d5c2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:30:04.882480 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:04.882406    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63ff6af-af6e-45a5-965d-c4bac535d5c2-maas-api-service-ca\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:30:05.592786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:05.592746    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7" event={"ID":"a63ff6af-af6e-45a5-965d-c4bac535d5c2","Type":"ContainerDied","Data":"0a618fc776e02bd6f923d8eb6b6d5b275b88920f2e6acf87928ae59ad9fdc40b"}
Sep 10 16:30:05.593157 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:05.592811    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a618fc776e02bd6f923d8eb6b6d5b275b88920f2e6acf87928ae59ad9fdc40b"
Sep 10 16:30:05.593157 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:05.592761    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7"
Sep 10 16:30:18.144961 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.144879    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"]
Sep 10 16:30:18.145371 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.145134    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls" podUID="76b7bcdf-7f98-459c-a411-0a39cc2985af" containerName="payload-processing" containerID="cri-o://1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b" gracePeriod=30
Sep 10 16:30:18.152716 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.152691    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"]
Sep 10 16:30:18.152981 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.152941    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45" podUID="dd69a330-9469-4644-906a-a355ec6f4c76" containerName="payload-pre-processing" containerID="cri-o://5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d" gracePeriod=30
Sep 10 16:30:18.417280 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.417253    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"
Sep 10 16:30:18.439869 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.439849    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"
Sep 10 16:30:18.466390 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.466361    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7"]
Sep 10 16:30:18.471565 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.471542    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ab677e-stcw7"]
Sep 10 16:30:18.515141 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.515104    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd69a330-9469-4644-906a-a355ec6f4c76-plugins-config-volume\") pod \"dd69a330-9469-4644-906a-a355ec6f4c76\" (UID: \"dd69a330-9469-4644-906a-a355ec6f4c76\") "
Sep 10 16:30:18.515334 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.515259    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqdv2\" (UniqueName: \"kubernetes.io/projected/76b7bcdf-7f98-459c-a411-0a39cc2985af-kube-api-access-lqdv2\") pod \"76b7bcdf-7f98-459c-a411-0a39cc2985af\" (UID: \"76b7bcdf-7f98-459c-a411-0a39cc2985af\") "
Sep 10 16:30:18.515334 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.515321    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76b7bcdf-7f98-459c-a411-0a39cc2985af-plugins-config-volume\") pod \"76b7bcdf-7f98-459c-a411-0a39cc2985af\" (UID: \"76b7bcdf-7f98-459c-a411-0a39cc2985af\") "
Sep 10 16:30:18.515455 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.515381    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkbh9\" (UniqueName: \"kubernetes.io/projected/dd69a330-9469-4644-906a-a355ec6f4c76-kube-api-access-mkbh9\") pod \"dd69a330-9469-4644-906a-a355ec6f4c76\" (UID: \"dd69a330-9469-4644-906a-a355ec6f4c76\") "
Sep 10 16:30:18.515686 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.515536    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd69a330-9469-4644-906a-a355ec6f4c76-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dd69a330-9469-4644-906a-a355ec6f4c76" (UID: "dd69a330-9469-4644-906a-a355ec6f4c76"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:30:18.515800 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.515769    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd69a330-9469-4644-906a-a355ec6f4c76-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:30:18.515800 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.515779    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76b7bcdf-7f98-459c-a411-0a39cc2985af-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "76b7bcdf-7f98-459c-a411-0a39cc2985af" (UID: "76b7bcdf-7f98-459c-a411-0a39cc2985af"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:30:18.517696 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.517663    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76b7bcdf-7f98-459c-a411-0a39cc2985af-kube-api-access-lqdv2" (OuterVolumeSpecName: "kube-api-access-lqdv2") pod "76b7bcdf-7f98-459c-a411-0a39cc2985af" (UID: "76b7bcdf-7f98-459c-a411-0a39cc2985af"). InnerVolumeSpecName "kube-api-access-lqdv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:30:18.517799 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.517693    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd69a330-9469-4644-906a-a355ec6f4c76-kube-api-access-mkbh9" (OuterVolumeSpecName: "kube-api-access-mkbh9") pod "dd69a330-9469-4644-906a-a355ec6f4c76" (UID: "dd69a330-9469-4644-906a-a355ec6f4c76"). InnerVolumeSpecName "kube-api-access-mkbh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:30:18.616404 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.616371    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqdv2\" (UniqueName: \"kubernetes.io/projected/76b7bcdf-7f98-459c-a411-0a39cc2985af-kube-api-access-lqdv2\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:30:18.616404 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.616398    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76b7bcdf-7f98-459c-a411-0a39cc2985af-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:30:18.616576 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.616412    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkbh9\" (UniqueName: \"kubernetes.io/projected/dd69a330-9469-4644-906a-a355ec6f4c76-kube-api-access-mkbh9\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:30:18.663808 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.663708    2562 generic.go:356] "Generic (PLEG): container finished" podID="76b7bcdf-7f98-459c-a411-0a39cc2985af" containerID="1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b" exitCode=0
Sep 10 16:30:18.663808 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.663785    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"
Sep 10 16:30:18.663999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.663790    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls" event={"ID":"76b7bcdf-7f98-459c-a411-0a39cc2985af","Type":"ContainerDied","Data":"1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b"}
Sep 10 16:30:18.663999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.663902    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls" event={"ID":"76b7bcdf-7f98-459c-a411-0a39cc2985af","Type":"ContainerDied","Data":"f317e9b1dae92103ca9e7ff83cadee63f838e5999b6e8b79f1cd1e0196543147"}
Sep 10 16:30:18.663999 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.663925    2562 scope.go:117] "RemoveContainer" containerID="1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b"
Sep 10 16:30:18.665209 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.665187    2562 generic.go:356] "Generic (PLEG): container finished" podID="dd69a330-9469-4644-906a-a355ec6f4c76" containerID="5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d" exitCode=0
Sep 10 16:30:18.665312 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.665220    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"
Sep 10 16:30:18.665312 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.665272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45" event={"ID":"dd69a330-9469-4644-906a-a355ec6f4c76","Type":"ContainerDied","Data":"5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d"}
Sep 10 16:30:18.665400 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.665312    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45" event={"ID":"dd69a330-9469-4644-906a-a355ec6f4c76","Type":"ContainerDied","Data":"703e76ce97d35f9857a10fe4ba1be1fe5619e656154f580584edce7c3e4ab4aa"}
Sep 10 16:30:18.680864 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.680840    2562 scope.go:117] "RemoveContainer" containerID="1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b"
Sep 10 16:30:18.681333 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:30:18.681311    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b\": container with ID starting with 1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b not found: ID does not exist" containerID="1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b"
Sep 10 16:30:18.681437 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.681345    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b"} err="failed to get container status \"1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b\": rpc error: code = NotFound desc = could not find container \"1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b\": container with ID starting with 1f65b49760988cb053afdd2941bb5e60498de8cda9c9f1f4884bf3c88c84d56b not found: ID does not exist"
Sep 10 16:30:18.681437 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.681368    2562 scope.go:117] "RemoveContainer" containerID="5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d"
Sep 10 16:30:18.689770 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.689750    2562 scope.go:117] "RemoveContainer" containerID="5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d"
Sep 10 16:30:18.690059 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:30:18.690042    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d\": container with ID starting with 5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d not found: ID does not exist" containerID="5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d"
Sep 10 16:30:18.690121 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.690071    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d"} err="failed to get container status \"5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d\": rpc error: code = NotFound desc = could not find container \"5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d\": container with ID starting with 5c55a828055ae73cfb0039bb5cce46f305b1038a3cd12fe7e59ee2872bfbe79d not found: ID does not exist"
Sep 10 16:30:18.699914 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.699891    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"]
Sep 10 16:30:18.704783 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.704763    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ab677e-64b6448854-gsk45"]
Sep 10 16:30:18.719006 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.718985    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"]
Sep 10 16:30:18.727681 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:18.727658    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ab677e-55d8f57747-t69ls"]
Sep 10 16:30:20.071364 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:20.071330    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76b7bcdf-7f98-459c-a411-0a39cc2985af" path="/var/lib/kubelet/pods/76b7bcdf-7f98-459c-a411-0a39cc2985af/volumes"
Sep 10 16:30:20.071746 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:20.071637    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a63ff6af-af6e-45a5-965d-c4bac535d5c2" path="/var/lib/kubelet/pods/a63ff6af-af6e-45a5-965d-c4bac535d5c2/volumes"
Sep 10 16:30:20.071979 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:20.071966    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd69a330-9469-4644-906a-a355ec6f4c76" path="/var/lib/kubelet/pods/dd69a330-9469-4644-906a-a355ec6f4c76/volumes"
Sep 10 16:30:23.940017 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.939984    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"]
Sep 10 16:30:23.940457 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940437    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d1a628-1158-4ebb-95f1-9e70ef202955" containerName="cleanup"
Sep 10 16:30:23.940457 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940448    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d1a628-1158-4ebb-95f1-9e70ef202955" containerName="cleanup"
Sep 10 16:30:23.940457 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940458    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76b7bcdf-7f98-459c-a411-0a39cc2985af" containerName="payload-processing"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940464    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="76b7bcdf-7f98-459c-a411-0a39cc2985af" containerName="payload-processing"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940472    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e05be48-937f-4129-8be1-8b9e88072a6f" containerName="cleanup"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940477    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e05be48-937f-4129-8be1-8b9e88072a6f" containerName="cleanup"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940486    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a63ff6af-af6e-45a5-965d-c4bac535d5c2" containerName="revoke-keys"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940493    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a63ff6af-af6e-45a5-965d-c4bac535d5c2" containerName="revoke-keys"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940506    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0bd0b9-78c2-43a1-a514-2002e5870cfd" containerName="cleanup"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940511    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0bd0b9-78c2-43a1-a514-2002e5870cfd" containerName="cleanup"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940523    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd69a330-9469-4644-906a-a355ec6f4c76" containerName="payload-pre-processing"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940528    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd69a330-9469-4644-906a-a355ec6f4c76" containerName="payload-pre-processing"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940594    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c0bd0b9-78c2-43a1-a514-2002e5870cfd" containerName="cleanup"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940603    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd69a330-9469-4644-906a-a355ec6f4c76" containerName="payload-pre-processing"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940609    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d1a628-1158-4ebb-95f1-9e70ef202955" containerName="cleanup"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940617    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="76b7bcdf-7f98-459c-a411-0a39cc2985af" containerName="payload-processing"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940624    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a63ff6af-af6e-45a5-965d-c4bac535d5c2" containerName="revoke-keys"
Sep 10 16:30:23.940627 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.940631    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e05be48-937f-4129-8be1-8b9e88072a6f" containerName="cleanup"
Sep 10 16:30:23.945214 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.945193    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:23.948684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.948659    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-814d40-openshift-default-dockercfg-x8brc\""
Sep 10 16:30:23.959964 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:23.959942    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"]
Sep 10 16:30:24.064403 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.064368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-data\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.064561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.064428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istiod-ca-cert\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.064561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.064480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-token\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.064561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.064507    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-workload-certs\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.064561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.064534    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-podinfo\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.064561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.064557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svmd2\" (UniqueName: \"kubernetes.io/projected/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-kube-api-access-svmd2\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.064785 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.064632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-workload-socket\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.064785 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.064679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-credential-socket\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.064785 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.064758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-envoy\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.165527 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.165488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-data\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.165684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.165554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istiod-ca-cert\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.165684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.165601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-token\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.165684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.165624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-workload-certs\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.165684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.165644    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-podinfo\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.165684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.165673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svmd2\" (UniqueName: \"kubernetes.io/projected/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-kube-api-access-svmd2\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.166002 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.165706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-workload-socket\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.166002 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.165754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-credential-socket\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.166002 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.165830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-envoy\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.166002 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.165931    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-data\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.166002 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.165989    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-workload-certs\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.166303 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.166273    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-workload-socket\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.166384 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.166320    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istiod-ca-cert\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.166437 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.166415    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-credential-socket\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.168072 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.168051    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-envoy\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.168258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.168239    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-podinfo\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.177246 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.177203    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-token\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.200799 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.188068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svmd2\" (UniqueName: \"kubernetes.io/projected/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-kube-api-access-svmd2\") pod \"e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") " pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.257555 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.257527    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:24.538162 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.538131    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"]
Sep 10 16:30:24.539386 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:30:24.539361    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ded5c1_d43f_4ce6_bf08_6ccf5fc407a2.slice/crio-773576961ca11258c0ed5bd98ab394fa2dca7d016bff8af1f442f74cba6d6204 WatchSource:0}: Error finding container 773576961ca11258c0ed5bd98ab394fa2dca7d016bff8af1f442f74cba6d6204: Status 404 returned error can't find the container with id 773576961ca11258c0ed5bd98ab394fa2dca7d016bff8af1f442f74cba6d6204
Sep 10 16:30:24.542139 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.542098    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:30:24.542258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.542182    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:30:24.542258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.542225    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:30:24.699709 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.699670    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" event={"ID":"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2","Type":"ContainerStarted","Data":"2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470"}
Sep 10 16:30:24.699900 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.699761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" event={"ID":"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2","Type":"ContainerStarted","Data":"773576961ca11258c0ed5bd98ab394fa2dca7d016bff8af1f442f74cba6d6204"}
Sep 10 16:30:24.723290 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:24.723233    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" podStartSLOduration=1.723212966 podStartE2EDuration="1.723212966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:30:24.721436332 +0000 UTC m=+1709.133522539" watchObservedRunningTime="2026-09-10 16:30:24.723212966 +0000 UTC m=+1709.135299177"
Sep 10 16:30:25.258030 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:25.257997    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:25.262857 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:25.262833    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:25.706468 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:25.706380    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:25.707502 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:25.707467    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:28.747052 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:28.747019    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"]
Sep 10 16:30:28.750505 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:28.750486    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"
Sep 10 16:30:28.755239 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:28.755212    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-814d40-dockercfg-5cvzs\""
Sep 10 16:30:28.755239 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:28.755232    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-814d40\""
Sep 10 16:30:28.765197 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:28.765175    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"]
Sep 10 16:30:28.876863 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:28.876830    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"]
Sep 10 16:30:28.880539 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:28.880519    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"
Sep 10 16:30:28.900914 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:28.900881    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"]
Sep 10 16:30:28.912651 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:28.912620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvzmp\" (UniqueName: \"kubernetes.io/projected/150f0b7c-582d-4030-9c3f-52b341e36c91-kube-api-access-hvzmp\") pod \"payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb\" (UID: \"150f0b7c-582d-4030-9c3f-52b341e36c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"
Sep 10 16:30:28.912819 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:28.912788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/150f0b7c-582d-4030-9c3f-52b341e36c91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb\" (UID: \"150f0b7c-582d-4030-9c3f-52b341e36c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"
Sep 10 16:30:29.014316 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.014225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd64cfcc-088c-4fa1-bcda-0c7783528a8a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f\" (UID: \"fd64cfcc-088c-4fa1-bcda-0c7783528a8a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"
Sep 10 16:30:29.014316 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.014274    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvzmp\" (UniqueName: \"kubernetes.io/projected/150f0b7c-582d-4030-9c3f-52b341e36c91-kube-api-access-hvzmp\") pod \"payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb\" (UID: \"150f0b7c-582d-4030-9c3f-52b341e36c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"
Sep 10 16:30:29.014316 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.014312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46d7l\" (UniqueName: \"kubernetes.io/projected/fd64cfcc-088c-4fa1-bcda-0c7783528a8a-kube-api-access-46d7l\") pod \"payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f\" (UID: \"fd64cfcc-088c-4fa1-bcda-0c7783528a8a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"
Sep 10 16:30:29.014601 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.014361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/150f0b7c-582d-4030-9c3f-52b341e36c91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb\" (UID: \"150f0b7c-582d-4030-9c3f-52b341e36c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"
Sep 10 16:30:29.015037 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.015017    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/150f0b7c-582d-4030-9c3f-52b341e36c91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb\" (UID: \"150f0b7c-582d-4030-9c3f-52b341e36c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"
Sep 10 16:30:29.025647 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.025623    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvzmp\" (UniqueName: \"kubernetes.io/projected/150f0b7c-582d-4030-9c3f-52b341e36c91-kube-api-access-hvzmp\") pod \"payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb\" (UID: \"150f0b7c-582d-4030-9c3f-52b341e36c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"
Sep 10 16:30:29.061269 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.061237    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"
Sep 10 16:30:29.117252 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.115503    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46d7l\" (UniqueName: \"kubernetes.io/projected/fd64cfcc-088c-4fa1-bcda-0c7783528a8a-kube-api-access-46d7l\") pod \"payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f\" (UID: \"fd64cfcc-088c-4fa1-bcda-0c7783528a8a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"
Sep 10 16:30:29.117252 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.115686    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd64cfcc-088c-4fa1-bcda-0c7783528a8a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f\" (UID: \"fd64cfcc-088c-4fa1-bcda-0c7783528a8a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"
Sep 10 16:30:29.117252 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.116607    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd64cfcc-088c-4fa1-bcda-0c7783528a8a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f\" (UID: \"fd64cfcc-088c-4fa1-bcda-0c7783528a8a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"
Sep 10 16:30:29.129746 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.129699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46d7l\" (UniqueName: \"kubernetes.io/projected/fd64cfcc-088c-4fa1-bcda-0c7783528a8a-kube-api-access-46d7l\") pod \"payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f\" (UID: \"fd64cfcc-088c-4fa1-bcda-0c7783528a8a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"
Sep 10 16:30:29.190384 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.190360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"
Sep 10 16:30:29.335118 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.335093    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"]
Sep 10 16:30:29.336551 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:30:29.336525    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150f0b7c_582d_4030_9c3f_52b341e36c91.slice/crio-c9c13261b480a74d12ddd1f3d65139fa609be6c1e537880747dd80fde89305da WatchSource:0}: Error finding container c9c13261b480a74d12ddd1f3d65139fa609be6c1e537880747dd80fde89305da: Status 404 returned error can't find the container with id c9c13261b480a74d12ddd1f3d65139fa609be6c1e537880747dd80fde89305da
Sep 10 16:30:29.492239 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.492207    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"]
Sep 10 16:30:29.493080 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:30:29.493046    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd64cfcc_088c_4fa1_bcda_0c7783528a8a.slice/crio-0bb6f95fe7371cf8b4e6f0598190709bfc52347872f04e1dbbcdf3497b7e4a5b WatchSource:0}: Error finding container 0bb6f95fe7371cf8b4e6f0598190709bfc52347872f04e1dbbcdf3497b7e4a5b: Status 404 returned error can't find the container with id 0bb6f95fe7371cf8b4e6f0598190709bfc52347872f04e1dbbcdf3497b7e4a5b
Sep 10 16:30:29.742188 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.742138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f" event={"ID":"fd64cfcc-088c-4fa1-bcda-0c7783528a8a","Type":"ContainerStarted","Data":"a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a"}
Sep 10 16:30:29.742361 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.742213    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f" event={"ID":"fd64cfcc-088c-4fa1-bcda-0c7783528a8a","Type":"ContainerStarted","Data":"0bb6f95fe7371cf8b4e6f0598190709bfc52347872f04e1dbbcdf3497b7e4a5b"}
Sep 10 16:30:29.742361 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.742303    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"
Sep 10 16:30:29.744396 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.744370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb" event={"ID":"150f0b7c-582d-4030-9c3f-52b341e36c91","Type":"ContainerStarted","Data":"f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff"}
Sep 10 16:30:29.744545 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.744414    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb" event={"ID":"150f0b7c-582d-4030-9c3f-52b341e36c91","Type":"ContainerStarted","Data":"c9c13261b480a74d12ddd1f3d65139fa609be6c1e537880747dd80fde89305da"}
Sep 10 16:30:29.744545 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.744499    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"
Sep 10 16:30:29.765614 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.765562    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f" podStartSLOduration=1.765543402 podStartE2EDuration="1.765543402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:30:29.764152665 +0000 UTC m=+1714.176238874" watchObservedRunningTime="2026-09-10 16:30:29.765543402 +0000 UTC m=+1714.177629616"
Sep 10 16:30:29.788786 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:29.788738    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb" podStartSLOduration=1.7887103610000001 podStartE2EDuration="1.788710361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:30:29.785590515 +0000 UTC m=+1714.197676723" watchObservedRunningTime="2026-09-10 16:30:29.788710361 +0000 UTC m=+1714.200796570"
Sep 10 16:30:40.753944 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:40.753904    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"
Sep 10 16:30:40.754450 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:40.754006    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"
Sep 10 16:30:41.748909 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:41.748861    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 16:30:41.749101 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:41.748927    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 16:30:41.938907 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:41.938864    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"]
Sep 10 16:30:41.939393 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:41.939091    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx" podUID="7f2d2917-a016-4f05-a819-6e908447cdbb" containerName="payload-processing" containerID="cri-o://00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf" gracePeriod=30
Sep 10 16:30:41.944612 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:41.944500    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"]
Sep 10 16:30:41.945525 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:41.944745    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn" podUID="941424d1-e50f-4b0f-b6ee-ab7bc1051202" containerName="payload-pre-processing" containerID="cri-o://23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163" gracePeriod=30
Sep 10 16:30:42.251403 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.251370    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"
Sep 10 16:30:42.255228 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.255201    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"
Sep 10 16:30:42.356058 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.355974    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q9wl\" (UniqueName: \"kubernetes.io/projected/941424d1-e50f-4b0f-b6ee-ab7bc1051202-kube-api-access-7q9wl\") pod \"941424d1-e50f-4b0f-b6ee-ab7bc1051202\" (UID: \"941424d1-e50f-4b0f-b6ee-ab7bc1051202\") "
Sep 10 16:30:42.356058 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.356009    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/941424d1-e50f-4b0f-b6ee-ab7bc1051202-plugins-config-volume\") pod \"941424d1-e50f-4b0f-b6ee-ab7bc1051202\" (UID: \"941424d1-e50f-4b0f-b6ee-ab7bc1051202\") "
Sep 10 16:30:42.356058 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.356026    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx475\" (UniqueName: \"kubernetes.io/projected/7f2d2917-a016-4f05-a819-6e908447cdbb-kube-api-access-dx475\") pod \"7f2d2917-a016-4f05-a819-6e908447cdbb\" (UID: \"7f2d2917-a016-4f05-a819-6e908447cdbb\") "
Sep 10 16:30:42.356365 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.356087    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f2d2917-a016-4f05-a819-6e908447cdbb-plugins-config-volume\") pod \"7f2d2917-a016-4f05-a819-6e908447cdbb\" (UID: \"7f2d2917-a016-4f05-a819-6e908447cdbb\") "
Sep 10 16:30:42.356482 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.356454    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/941424d1-e50f-4b0f-b6ee-ab7bc1051202-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "941424d1-e50f-4b0f-b6ee-ab7bc1051202" (UID: "941424d1-e50f-4b0f-b6ee-ab7bc1051202"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:30:42.356553 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.356509    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f2d2917-a016-4f05-a819-6e908447cdbb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7f2d2917-a016-4f05-a819-6e908447cdbb" (UID: "7f2d2917-a016-4f05-a819-6e908447cdbb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:30:42.358718 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.358690    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f2d2917-a016-4f05-a819-6e908447cdbb-kube-api-access-dx475" (OuterVolumeSpecName: "kube-api-access-dx475") pod "7f2d2917-a016-4f05-a819-6e908447cdbb" (UID: "7f2d2917-a016-4f05-a819-6e908447cdbb"). InnerVolumeSpecName "kube-api-access-dx475". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:30:42.358853 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.358745    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/941424d1-e50f-4b0f-b6ee-ab7bc1051202-kube-api-access-7q9wl" (OuterVolumeSpecName: "kube-api-access-7q9wl") pod "941424d1-e50f-4b0f-b6ee-ab7bc1051202" (UID: "941424d1-e50f-4b0f-b6ee-ab7bc1051202"). InnerVolumeSpecName "kube-api-access-7q9wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:30:42.457040 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.457007    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f2d2917-a016-4f05-a819-6e908447cdbb-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:30:42.457040 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.457035    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q9wl\" (UniqueName: \"kubernetes.io/projected/941424d1-e50f-4b0f-b6ee-ab7bc1051202-kube-api-access-7q9wl\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:30:42.457277 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.457050    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/941424d1-e50f-4b0f-b6ee-ab7bc1051202-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:30:42.457277 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.457062    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx475\" (UniqueName: \"kubernetes.io/projected/7f2d2917-a016-4f05-a819-6e908447cdbb-kube-api-access-dx475\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:30:42.834468 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.834432    2562 generic.go:356] "Generic (PLEG): container finished" podID="941424d1-e50f-4b0f-b6ee-ab7bc1051202" containerID="23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163" exitCode=0
Sep 10 16:30:42.834670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.834479    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"
Sep 10 16:30:42.834670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.834515    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn" event={"ID":"941424d1-e50f-4b0f-b6ee-ab7bc1051202","Type":"ContainerDied","Data":"23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163"}
Sep 10 16:30:42.834670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.834580    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn" event={"ID":"941424d1-e50f-4b0f-b6ee-ab7bc1051202","Type":"ContainerDied","Data":"9dc4e0a04040279d504d6d449e41d6d69c1ca4fd8c319997465286cb42757c59"}
Sep 10 16:30:42.834670 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.834610    2562 scope.go:117] "RemoveContainer" containerID="23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163"
Sep 10 16:30:42.836070 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.836045    2562 generic.go:356] "Generic (PLEG): container finished" podID="7f2d2917-a016-4f05-a819-6e908447cdbb" containerID="00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf" exitCode=0
Sep 10 16:30:42.836200 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.836071    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx" event={"ID":"7f2d2917-a016-4f05-a819-6e908447cdbb","Type":"ContainerDied","Data":"00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf"}
Sep 10 16:30:42.836200 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.836097    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"
Sep 10 16:30:42.836200 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.836128    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx" event={"ID":"7f2d2917-a016-4f05-a819-6e908447cdbb","Type":"ContainerDied","Data":"75b18b4aba7cfc3f4fef7cbbaaff110e2d7f26cc75f91dc392783c379e896fbf"}
Sep 10 16:30:42.850406 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.850381    2562 scope.go:117] "RemoveContainer" containerID="23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163"
Sep 10 16:30:42.850789 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:30:42.850766    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163\": container with ID starting with 23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163 not found: ID does not exist" containerID="23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163"
Sep 10 16:30:42.850890 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.850797    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163"} err="failed to get container status \"23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163\": rpc error: code = NotFound desc = could not find container \"23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163\": container with ID starting with 23d3da85bd42fdda2f16874b78c9d26d437d68e475907d9905483167149a0163 not found: ID does not exist"
Sep 10 16:30:42.850890 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.850815    2562 scope.go:117] "RemoveContainer" containerID="00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf"
Sep 10 16:30:42.860621 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.860594    2562 scope.go:117] "RemoveContainer" containerID="00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf"
Sep 10 16:30:42.861437 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:30:42.861409    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf\": container with ID starting with 00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf not found: ID does not exist" containerID="00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf"
Sep 10 16:30:42.861540 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.861447    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf"} err="failed to get container status \"00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf\": rpc error: code = NotFound desc = could not find container \"00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf\": container with ID starting with 00d870d8772106692ad55513e992dec782a8b4e464658f94c187f11084338ebf not found: ID does not exist"
Sep 10 16:30:42.864145 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.864123    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"]
Sep 10 16:30:42.870767 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.870741    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cde4a2-686d45b87d-bwqnn"]
Sep 10 16:30:42.882312 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.882284    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"]
Sep 10 16:30:42.884492 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:42.884473    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cde4a2-5cd4f67587-w4kjx"]
Sep 10 16:30:43.845775 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:43.845741    2562 generic.go:356] "Generic (PLEG): container finished" podID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerID="2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470" exitCode=0
Sep 10 16:30:43.846200 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:43.845794    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" event={"ID":"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2","Type":"ContainerDied","Data":"2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470"}
Sep 10 16:30:43.846200 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:43.846189    2562 scope.go:117] "RemoveContainer" containerID="2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470"
Sep 10 16:30:43.847336 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:43.847308    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:30:43.847396 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:43.847382    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:30:43.847432 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:43.847415    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 16:30:44.073613 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:44.073566    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f2d2917-a016-4f05-a819-6e908447cdbb" path="/var/lib/kubelet/pods/7f2d2917-a016-4f05-a819-6e908447cdbb/volumes"
Sep 10 16:30:44.073989 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:44.073968    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="941424d1-e50f-4b0f-b6ee-ab7bc1051202" path="/var/lib/kubelet/pods/941424d1-e50f-4b0f-b6ee-ab7bc1051202/volumes"
Sep 10 16:30:44.858429 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:44.858383    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" event={"ID":"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2","Type":"ContainerStarted","Data":"65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd"}
Sep 10 16:30:45.257820 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:45.257771    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:45.258234 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:45.258203    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 10 16:30:45.258377 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:45.258274    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 10 16:30:46.258068 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:46.258027    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 10 16:30:46.258666 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:46.258633    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 10 16:30:47.258568 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:47.258524    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 10 16:30:47.259226 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:47.259193    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 10 16:30:48.258669 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:48.258627    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 10 16:30:48.259738 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:48.259294    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 10 16:30:49.258594 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:49.258555    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 10 16:30:49.258926 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:49.258892    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 10 16:30:50.261975 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:50.261938    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:50.262366 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:50.262216    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:30:50.262992 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:30:50.262976    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:31:01.411476 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.411438    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw"]
Sep 10 16:31:01.416584 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.416554    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-29fd7d-29817630-nkprw"]
Sep 10 16:31:01.441782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.441744    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"]
Sep 10 16:31:01.442316 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.442264    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp" podUID="9d5f2827-3c7b-49b4-80b1-543791551a59" containerName="payload-processing" containerID="cri-o://41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed" gracePeriod=30
Sep 10 16:31:01.455970 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.455943    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"]
Sep 10 16:31:01.456235 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.456191    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp" podUID="757c3c32-7882-4fb6-8dd4-d3ec34ee7644" containerName="payload-pre-processing" containerID="cri-o://02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a" gracePeriod=30
Sep 10 16:31:01.747501 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.747408    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"
Sep 10 16:31:01.757412 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.757380    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"
Sep 10 16:31:01.868882 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.868845    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4wlr\" (UniqueName: \"kubernetes.io/projected/757c3c32-7882-4fb6-8dd4-d3ec34ee7644-kube-api-access-t4wlr\") pod \"757c3c32-7882-4fb6-8dd4-d3ec34ee7644\" (UID: \"757c3c32-7882-4fb6-8dd4-d3ec34ee7644\") "
Sep 10 16:31:01.869078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.868891    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d5f2827-3c7b-49b4-80b1-543791551a59-plugins-config-volume\") pod \"9d5f2827-3c7b-49b4-80b1-543791551a59\" (UID: \"9d5f2827-3c7b-49b4-80b1-543791551a59\") "
Sep 10 16:31:01.869078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.868942    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsfrm\" (UniqueName: \"kubernetes.io/projected/9d5f2827-3c7b-49b4-80b1-543791551a59-kube-api-access-hsfrm\") pod \"9d5f2827-3c7b-49b4-80b1-543791551a59\" (UID: \"9d5f2827-3c7b-49b4-80b1-543791551a59\") "
Sep 10 16:31:01.869078 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.869054    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/757c3c32-7882-4fb6-8dd4-d3ec34ee7644-plugins-config-volume\") pod \"757c3c32-7882-4fb6-8dd4-d3ec34ee7644\" (UID: \"757c3c32-7882-4fb6-8dd4-d3ec34ee7644\") "
Sep 10 16:31:01.869364 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.869335    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d5f2827-3c7b-49b4-80b1-543791551a59-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9d5f2827-3c7b-49b4-80b1-543791551a59" (UID: "9d5f2827-3c7b-49b4-80b1-543791551a59"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:31:01.869430 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.869404    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/757c3c32-7882-4fb6-8dd4-d3ec34ee7644-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "757c3c32-7882-4fb6-8dd4-d3ec34ee7644" (UID: "757c3c32-7882-4fb6-8dd4-d3ec34ee7644"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:31:01.871031 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.871009    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/757c3c32-7882-4fb6-8dd4-d3ec34ee7644-kube-api-access-t4wlr" (OuterVolumeSpecName: "kube-api-access-t4wlr") pod "757c3c32-7882-4fb6-8dd4-d3ec34ee7644" (UID: "757c3c32-7882-4fb6-8dd4-d3ec34ee7644"). InnerVolumeSpecName "kube-api-access-t4wlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:31:01.871150 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.871089    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d5f2827-3c7b-49b4-80b1-543791551a59-kube-api-access-hsfrm" (OuterVolumeSpecName: "kube-api-access-hsfrm") pod "9d5f2827-3c7b-49b4-80b1-543791551a59" (UID: "9d5f2827-3c7b-49b4-80b1-543791551a59"). InnerVolumeSpecName "kube-api-access-hsfrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:31:01.970076 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.969888    2562 generic.go:356] "Generic (PLEG): container finished" podID="9d5f2827-3c7b-49b4-80b1-543791551a59" containerID="41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed" exitCode=0
Sep 10 16:31:01.970076 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.969942    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"
Sep 10 16:31:01.970076 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.969934    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp" event={"ID":"9d5f2827-3c7b-49b4-80b1-543791551a59","Type":"ContainerDied","Data":"41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed"}
Sep 10 16:31:01.970374 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.970118    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp" event={"ID":"9d5f2827-3c7b-49b4-80b1-543791551a59","Type":"ContainerDied","Data":"ed4e42471e7ae5f6ff224c254f2c7983f0e7755a924cb5f45ec40577088a82ea"}
Sep 10 16:31:01.970374 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.970150    2562 scope.go:117] "RemoveContainer" containerID="41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed"
Sep 10 16:31:01.970374 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.969942    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d5f2827-3c7b-49b4-80b1-543791551a59-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:01.970374 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.970272    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsfrm\" (UniqueName: \"kubernetes.io/projected/9d5f2827-3c7b-49b4-80b1-543791551a59-kube-api-access-hsfrm\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:01.970374 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.970291    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/757c3c32-7882-4fb6-8dd4-d3ec34ee7644-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:01.970374 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.970307    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4wlr\" (UniqueName: \"kubernetes.io/projected/757c3c32-7882-4fb6-8dd4-d3ec34ee7644-kube-api-access-t4wlr\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:01.972306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.972248    2562 generic.go:356] "Generic (PLEG): container finished" podID="757c3c32-7882-4fb6-8dd4-d3ec34ee7644" containerID="02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a" exitCode=0
Sep 10 16:31:01.972542 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.972298    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp" event={"ID":"757c3c32-7882-4fb6-8dd4-d3ec34ee7644","Type":"ContainerDied","Data":"02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a"}
Sep 10 16:31:01.972623 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.972585    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp" event={"ID":"757c3c32-7882-4fb6-8dd4-d3ec34ee7644","Type":"ContainerDied","Data":"d73ba7da9845b37d5a26a7194ed415cec900c6c52fcdf38c52d27e96ef03af92"}
Sep 10 16:31:01.972623 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.972380    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"
Sep 10 16:31:01.983701 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.983677    2562 scope.go:117] "RemoveContainer" containerID="41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed"
Sep 10 16:31:01.985259 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:31:01.984545    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed\": container with ID starting with 41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed not found: ID does not exist" containerID="41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed"
Sep 10 16:31:01.985259 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.984582    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed"} err="failed to get container status \"41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed\": rpc error: code = NotFound desc = could not find container \"41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed\": container with ID starting with 41f919d65a127f7c4a7b7c552b6385597023e4989e4fd58e1aecd330a60b8eed not found: ID does not exist"
Sep 10 16:31:01.985259 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.984606    2562 scope.go:117] "RemoveContainer" containerID="02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a"
Sep 10 16:31:01.995536 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.995513    2562 scope.go:117] "RemoveContainer" containerID="02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a"
Sep 10 16:31:01.995928 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:31:01.995905    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a\": container with ID starting with 02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a not found: ID does not exist" containerID="02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a"
Sep 10 16:31:01.996096 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:01.995937    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a"} err="failed to get container status \"02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a\": rpc error: code = NotFound desc = could not find container \"02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a\": container with ID starting with 02cf438e9c3e4cee59a65952116203c5f2e3dd980a8f9eef1a990240bd1a843a not found: ID does not exist"
Sep 10 16:31:02.017590 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.017547    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"]
Sep 10 16:31:02.024954 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.024916    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-29fd7d-b767fbf7c-dndpp"]
Sep 10 16:31:02.038223 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.038187    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"]
Sep 10 16:31:02.044511 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.044477    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-29fd7d-77b7d44c7d-vqnjp"]
Sep 10 16:31:02.071996 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.071960    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e05be48-937f-4129-8be1-8b9e88072a6f" path="/var/lib/kubelet/pods/6e05be48-937f-4129-8be1-8b9e88072a6f/volumes"
Sep 10 16:31:02.072337 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.072322    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="757c3c32-7882-4fb6-8dd4-d3ec34ee7644" path="/var/lib/kubelet/pods/757c3c32-7882-4fb6-8dd4-d3ec34ee7644/volumes"
Sep 10 16:31:02.072687 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.072675    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d5f2827-3c7b-49b4-80b1-543791551a59" path="/var/lib/kubelet/pods/9d5f2827-3c7b-49b4-80b1-543791551a59/volumes"
Sep 10 16:31:02.790348 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.790311    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"]
Sep 10 16:31:02.790935 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.790916    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f2d2917-a016-4f05-a819-6e908447cdbb" containerName="payload-processing"
Sep 10 16:31:02.790987 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.790938    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f2d2917-a016-4f05-a819-6e908447cdbb" containerName="payload-processing"
Sep 10 16:31:02.790987 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.790953    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d5f2827-3c7b-49b4-80b1-543791551a59" containerName="payload-processing"
Sep 10 16:31:02.790987 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.790959    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d5f2827-3c7b-49b4-80b1-543791551a59" containerName="payload-processing"
Sep 10 16:31:02.790987 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.790966    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941424d1-e50f-4b0f-b6ee-ab7bc1051202" containerName="payload-pre-processing"
Sep 10 16:31:02.790987 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.790973    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="941424d1-e50f-4b0f-b6ee-ab7bc1051202" containerName="payload-pre-processing"
Sep 10 16:31:02.791140 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.790990    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="757c3c32-7882-4fb6-8dd4-d3ec34ee7644" containerName="payload-pre-processing"
Sep 10 16:31:02.791140 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.790995    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="757c3c32-7882-4fb6-8dd4-d3ec34ee7644" containerName="payload-pre-processing"
Sep 10 16:31:02.791140 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.791064    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f2d2917-a016-4f05-a819-6e908447cdbb" containerName="payload-processing"
Sep 10 16:31:02.791140 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.791075    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="757c3c32-7882-4fb6-8dd4-d3ec34ee7644" containerName="payload-pre-processing"
Sep 10 16:31:02.791140 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.791083    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d5f2827-3c7b-49b4-80b1-543791551a59" containerName="payload-processing"
Sep 10 16:31:02.791140 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.791091    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="941424d1-e50f-4b0f-b6ee-ab7bc1051202" containerName="payload-pre-processing"
Sep 10 16:31:02.795484 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.795464    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"
Sep 10 16:31:02.798217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.798194    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-275a06-dockercfg-gkwbf\""
Sep 10 16:31:02.798334 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.798234    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-275a06\""
Sep 10 16:31:02.809907 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.809878    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"]
Sep 10 16:31:02.878527 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.878458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shjx8\" (UniqueName: \"kubernetes.io/projected/253d580e-35cd-4822-99d0-dcc201d65b5d-kube-api-access-shjx8\") pod \"payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85\" (UID: \"253d580e-35cd-4822-99d0-dcc201d65b5d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"
Sep 10 16:31:02.878704 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.878571    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/253d580e-35cd-4822-99d0-dcc201d65b5d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85\" (UID: \"253d580e-35cd-4822-99d0-dcc201d65b5d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"
Sep 10 16:31:02.979447 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.979402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shjx8\" (UniqueName: \"kubernetes.io/projected/253d580e-35cd-4822-99d0-dcc201d65b5d-kube-api-access-shjx8\") pod \"payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85\" (UID: \"253d580e-35cd-4822-99d0-dcc201d65b5d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"
Sep 10 16:31:02.979662 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.979480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/253d580e-35cd-4822-99d0-dcc201d65b5d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85\" (UID: \"253d580e-35cd-4822-99d0-dcc201d65b5d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"
Sep 10 16:31:02.980240 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.980219    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/253d580e-35cd-4822-99d0-dcc201d65b5d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85\" (UID: \"253d580e-35cd-4822-99d0-dcc201d65b5d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"
Sep 10 16:31:02.990234 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:02.990206    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shjx8\" (UniqueName: \"kubernetes.io/projected/253d580e-35cd-4822-99d0-dcc201d65b5d-kube-api-access-shjx8\") pod \"payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85\" (UID: \"253d580e-35cd-4822-99d0-dcc201d65b5d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"
Sep 10 16:31:03.106102 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:03.106006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"
Sep 10 16:31:03.383637 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:03.383602    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"]
Sep 10 16:31:03.385030 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:31:03.385003    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253d580e_35cd_4822_99d0_dcc201d65b5d.slice/crio-a4a0d601063755edcc137acb50a510ebea8dd9e34e919962006fdf7c149657dc WatchSource:0}: Error finding container a4a0d601063755edcc137acb50a510ebea8dd9e34e919962006fdf7c149657dc: Status 404 returned error can't find the container with id a4a0d601063755edcc137acb50a510ebea8dd9e34e919962006fdf7c149657dc
Sep 10 16:31:03.991475 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:03.991439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85" event={"ID":"253d580e-35cd-4822-99d0-dcc201d65b5d","Type":"ContainerStarted","Data":"dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6"}
Sep 10 16:31:03.991908 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:03.991496    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85" event={"ID":"253d580e-35cd-4822-99d0-dcc201d65b5d","Type":"ContainerStarted","Data":"a4a0d601063755edcc137acb50a510ebea8dd9e34e919962006fdf7c149657dc"}
Sep 10 16:31:03.991908 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:03.991523    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"
Sep 10 16:31:04.015135 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:04.015064    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85" podStartSLOduration=2.015047823 podStartE2EDuration="2.015047823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:31:04.012747765 +0000 UTC m=+1748.424833975" watchObservedRunningTime="2026-09-10 16:31:04.015047823 +0000 UTC m=+1748.427134031"
Sep 10 16:31:08.840081 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:08.840041    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"]
Sep 10 16:31:08.840470 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:08.840329    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerName="istio-proxy" containerID="cri-o://00f70d8615a51a3c02e2cfc351e83672d860cc2372efe36a2f56f201ba6dff0f" gracePeriod=30
Sep 10 16:31:14.052506 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.052473    2562 generic.go:356] "Generic (PLEG): container finished" podID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerID="00f70d8615a51a3c02e2cfc351e83672d860cc2372efe36a2f56f201ba6dff0f" exitCode=0
Sep 10 16:31:14.052916 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.052554    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" event={"ID":"eb9f7e98-554c-466a-a497-859cd7f51d33","Type":"ContainerDied","Data":"00f70d8615a51a3c02e2cfc351e83672d860cc2372efe36a2f56f201ba6dff0f"}
Sep 10 16:31:14.052916 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.052645    2562 scope.go:117] "RemoveContainer" containerID="687c91587a3168170ea96d1b3417f9361f47c362e306f0b147e0919254a73d65"
Sep 10 16:31:14.100513 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.100486    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:31:14.195962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.195850    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-podinfo\") pod \"eb9f7e98-554c-466a-a497-859cd7f51d33\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") "
Sep 10 16:31:14.195962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.195903    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-envoy\") pod \"eb9f7e98-554c-466a-a497-859cd7f51d33\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") "
Sep 10 16:31:14.195962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.195930    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-workload-socket\") pod \"eb9f7e98-554c-466a-a497-859cd7f51d33\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") "
Sep 10 16:31:14.196254 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196003    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-workload-certs\") pod \"eb9f7e98-554c-466a-a497-859cd7f51d33\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") "
Sep 10 16:31:14.196254 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196029    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-data\") pod \"eb9f7e98-554c-466a-a497-859cd7f51d33\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") "
Sep 10 16:31:14.196254 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196052    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-credential-socket\") pod \"eb9f7e98-554c-466a-a497-859cd7f51d33\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") "
Sep 10 16:31:14.196254 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196082    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-token\") pod \"eb9f7e98-554c-466a-a497-859cd7f51d33\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") "
Sep 10 16:31:14.196254 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196163    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9f7e98-554c-466a-a497-859cd7f51d33-istiod-ca-cert\") pod \"eb9f7e98-554c-466a-a497-859cd7f51d33\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") "
Sep 10 16:31:14.196254 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196213    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8q6r\" (UniqueName: \"kubernetes.io/projected/eb9f7e98-554c-466a-a497-859cd7f51d33-kube-api-access-t8q6r\") pod \"eb9f7e98-554c-466a-a497-859cd7f51d33\" (UID: \"eb9f7e98-554c-466a-a497-859cd7f51d33\") "
Sep 10 16:31:14.196555 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196353    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb9f7e98-554c-466a-a497-859cd7f51d33" (UID: "eb9f7e98-554c-466a-a497-859cd7f51d33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:31:14.196555 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196387    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb9f7e98-554c-466a-a497-859cd7f51d33" (UID: "eb9f7e98-554c-466a-a497-859cd7f51d33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:31:14.196555 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196362    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb9f7e98-554c-466a-a497-859cd7f51d33" (UID: "eb9f7e98-554c-466a-a497-859cd7f51d33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:31:14.196697 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196574    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb9f7e98-554c-466a-a497-859cd7f51d33" (UID: "eb9f7e98-554c-466a-a497-859cd7f51d33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:31:14.196697 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196645    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb9f7e98-554c-466a-a497-859cd7f51d33-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb9f7e98-554c-466a-a497-859cd7f51d33" (UID: "eb9f7e98-554c-466a-a497-859cd7f51d33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:31:14.196697 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196655    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-workload-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:14.196697 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196677    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-workload-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:14.196697 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.196691    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-data\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:14.198187 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.198158    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb9f7e98-554c-466a-a497-859cd7f51d33" (UID: "eb9f7e98-554c-466a-a497-859cd7f51d33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:31:14.198314 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.198252    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb9f7e98-554c-466a-a497-859cd7f51d33" (UID: "eb9f7e98-554c-466a-a497-859cd7f51d33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:31:14.198417 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.198398    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb9f7e98-554c-466a-a497-859cd7f51d33" (UID: "eb9f7e98-554c-466a-a497-859cd7f51d33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:31:14.198456 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.198426    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9f7e98-554c-466a-a497-859cd7f51d33-kube-api-access-t8q6r" (OuterVolumeSpecName: "kube-api-access-t8q6r") pod "eb9f7e98-554c-466a-a497-859cd7f51d33" (UID: "eb9f7e98-554c-466a-a497-859cd7f51d33"). InnerVolumeSpecName "kube-api-access-t8q6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:31:14.297888 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.297849    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-credential-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:14.297888 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.297882    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-token\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:14.297888 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.297891    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9f7e98-554c-466a-a497-859cd7f51d33-istiod-ca-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:14.298133 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.297900    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8q6r\" (UniqueName: \"kubernetes.io/projected/eb9f7e98-554c-466a-a497-859cd7f51d33-kube-api-access-t8q6r\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:14.298133 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.297912    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-podinfo\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:14.298133 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:14.297919    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9f7e98-554c-466a-a497-859cd7f51d33-istio-envoy\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:15.000162 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:15.000128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"
Sep 10 16:31:15.060169 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:15.060142    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"
Sep 10 16:31:15.060621 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:15.060193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn" event={"ID":"eb9f7e98-554c-466a-a497-859cd7f51d33","Type":"ContainerDied","Data":"4883b3eaff305fb624146fc2abf3cb5dc50d83bead4c81ebed8c6b7af1e1b1c9"}
Sep 10 16:31:15.060621 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:15.060262    2562 scope.go:117] "RemoveContainer" containerID="00f70d8615a51a3c02e2cfc351e83672d860cc2372efe36a2f56f201ba6dff0f"
Sep 10 16:31:15.097560 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:15.097529    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"]
Sep 10 16:31:15.108658 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:15.108627    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-29fd7d-openshift-default-747486d658-m9lcn"]
Sep 10 16:31:16.072131 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:16.072088    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" path="/var/lib/kubelet/pods/eb9f7e98-554c-466a-a497-859cd7f51d33/volumes"
Sep 10 16:31:19.727794 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:19.727752    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-90bd7e-29817630-5fd5j"]
Sep 10 16:31:19.730334 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:19.730307    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-90bd7e-29817630-5fd5j"]
Sep 10 16:31:19.765319 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:19.765279    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"]
Sep 10 16:31:19.765600 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:19.765571    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s" podUID="280d8fe9-704a-4424-b02f-c2dca2dd99d3" containerName="payload-processing" containerID="cri-o://ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a" gracePeriod=30
Sep 10 16:31:20.034995 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.034966    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"
Sep 10 16:31:20.074457 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.074423    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c0bd0b9-78c2-43a1-a514-2002e5870cfd" path="/var/lib/kubelet/pods/9c0bd0b9-78c2-43a1-a514-2002e5870cfd/volumes"
Sep 10 16:31:20.094407 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.094374    2562 generic.go:356] "Generic (PLEG): container finished" podID="280d8fe9-704a-4424-b02f-c2dca2dd99d3" containerID="ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a" exitCode=0
Sep 10 16:31:20.094623 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.094426    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"
Sep 10 16:31:20.094623 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.094430    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s" event={"ID":"280d8fe9-704a-4424-b02f-c2dca2dd99d3","Type":"ContainerDied","Data":"ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a"}
Sep 10 16:31:20.094623 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.094551    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s" event={"ID":"280d8fe9-704a-4424-b02f-c2dca2dd99d3","Type":"ContainerDied","Data":"78dc89ad13d9eeb071ab633d3054390a54d10165fb4d893668385a99f8abe575"}
Sep 10 16:31:20.094623 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.094578    2562 scope.go:117] "RemoveContainer" containerID="ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a"
Sep 10 16:31:20.103794 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.103772    2562 scope.go:117] "RemoveContainer" containerID="ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a"
Sep 10 16:31:20.104125 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:31:20.104103    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a\": container with ID starting with ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a not found: ID does not exist" containerID="ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a"
Sep 10 16:31:20.104212 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.104136    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a"} err="failed to get container status \"ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a\": rpc error: code = NotFound desc = could not find container \"ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a\": container with ID starting with ea5052eca938e51307cb66be38faf3aaefa80f9b01ce88d4f41fda7d3c663d5a not found: ID does not exist"
Sep 10 16:31:20.162195 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.162163    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/280d8fe9-704a-4424-b02f-c2dca2dd99d3-plugins-config-volume\") pod \"280d8fe9-704a-4424-b02f-c2dca2dd99d3\" (UID: \"280d8fe9-704a-4424-b02f-c2dca2dd99d3\") "
Sep 10 16:31:20.162360 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.162214    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9mfp\" (UniqueName: \"kubernetes.io/projected/280d8fe9-704a-4424-b02f-c2dca2dd99d3-kube-api-access-m9mfp\") pod \"280d8fe9-704a-4424-b02f-c2dca2dd99d3\" (UID: \"280d8fe9-704a-4424-b02f-c2dca2dd99d3\") "
Sep 10 16:31:20.162607 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.162582    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/280d8fe9-704a-4424-b02f-c2dca2dd99d3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "280d8fe9-704a-4424-b02f-c2dca2dd99d3" (UID: "280d8fe9-704a-4424-b02f-c2dca2dd99d3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:31:20.164473 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.164452    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280d8fe9-704a-4424-b02f-c2dca2dd99d3-kube-api-access-m9mfp" (OuterVolumeSpecName: "kube-api-access-m9mfp") pod "280d8fe9-704a-4424-b02f-c2dca2dd99d3" (UID: "280d8fe9-704a-4424-b02f-c2dca2dd99d3"). InnerVolumeSpecName "kube-api-access-m9mfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:31:20.263684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.263597    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/280d8fe9-704a-4424-b02f-c2dca2dd99d3-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:20.263684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.263629    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9mfp\" (UniqueName: \"kubernetes.io/projected/280d8fe9-704a-4424-b02f-c2dca2dd99d3-kube-api-access-m9mfp\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:31:20.424435 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.424399    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"]
Sep 10 16:31:20.428695 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:20.428663    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-90bd7e-5575747ff7-jrl6s"]
Sep 10 16:31:22.070847 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:22.070802    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="280d8fe9-704a-4424-b02f-c2dca2dd99d3" path="/var/lib/kubelet/pods/280d8fe9-704a-4424-b02f-c2dca2dd99d3/volumes"
Sep 10 16:31:31.128248 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:31:31.128217    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85_253d580e-35cd-4822-99d0-dcc201d65b5d/payload-processing/0.log"
Sep 10 16:32:12.014930 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:12.014899    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f_fd64cfcc-088c-4fa1-bcda-0c7783528a8a/payload-processing/0.log"
Sep 10 16:32:12.288808 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:12.288716    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85_253d580e-35cd-4822-99d0-dcc201d65b5d/payload-processing/0.log"
Sep 10 16:32:18.279761 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.279712    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"]
Sep 10 16:32:18.280184 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.280171    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerName="istio-proxy"
Sep 10 16:32:18.280184 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.280185    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerName="istio-proxy"
Sep 10 16:32:18.280267 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.280198    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerName="istio-proxy"
Sep 10 16:32:18.280267 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.280203    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerName="istio-proxy"
Sep 10 16:32:18.280267 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.280217    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280d8fe9-704a-4424-b02f-c2dca2dd99d3" containerName="payload-processing"
Sep 10 16:32:18.280267 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.280223    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="280d8fe9-704a-4424-b02f-c2dca2dd99d3" containerName="payload-processing"
Sep 10 16:32:18.280407 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.280287    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerName="istio-proxy"
Sep 10 16:32:18.280407 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.280295    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9f7e98-554c-466a-a497-859cd7f51d33" containerName="istio-proxy"
Sep 10 16:32:18.280407 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.280303    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="280d8fe9-704a-4424-b02f-c2dca2dd99d3" containerName="payload-processing"
Sep 10 16:32:18.283363 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.283347    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"
Sep 10 16:32:18.287408 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.287381    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-68ca72-dockercfg-hqvqb\""
Sep 10 16:32:18.292686 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.292665    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-68ca72\""
Sep 10 16:32:18.298185 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.298166    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"]
Sep 10 16:32:18.329587 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.329561    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"]
Sep 10 16:32:18.332982 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.332967    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"
Sep 10 16:32:18.346813 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.346789    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"]
Sep 10 16:32:18.446198 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.446166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hsms\" (UniqueName: \"kubernetes.io/projected/601cd38b-34ef-45e8-b825-d23691e41b48-kube-api-access-7hsms\") pod \"payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z\" (UID: \"601cd38b-34ef-45e8-b825-d23691e41b48\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"
Sep 10 16:32:18.446369 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.446205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03623c7e-c07f-4ef1-83d5-816968543291-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75\" (UID: \"03623c7e-c07f-4ef1-83d5-816968543291\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"
Sep 10 16:32:18.446369 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.446243    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/601cd38b-34ef-45e8-b825-d23691e41b48-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z\" (UID: \"601cd38b-34ef-45e8-b825-d23691e41b48\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"
Sep 10 16:32:18.446369 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.446260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-298k5\" (UniqueName: \"kubernetes.io/projected/03623c7e-c07f-4ef1-83d5-816968543291-kube-api-access-298k5\") pod \"payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75\" (UID: \"03623c7e-c07f-4ef1-83d5-816968543291\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"
Sep 10 16:32:18.547330 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.547244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hsms\" (UniqueName: \"kubernetes.io/projected/601cd38b-34ef-45e8-b825-d23691e41b48-kube-api-access-7hsms\") pod \"payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z\" (UID: \"601cd38b-34ef-45e8-b825-d23691e41b48\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"
Sep 10 16:32:18.547330 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.547296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03623c7e-c07f-4ef1-83d5-816968543291-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75\" (UID: \"03623c7e-c07f-4ef1-83d5-816968543291\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"
Sep 10 16:32:18.547538 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.547354    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/601cd38b-34ef-45e8-b825-d23691e41b48-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z\" (UID: \"601cd38b-34ef-45e8-b825-d23691e41b48\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"
Sep 10 16:32:18.547538 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.547384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-298k5\" (UniqueName: \"kubernetes.io/projected/03623c7e-c07f-4ef1-83d5-816968543291-kube-api-access-298k5\") pod \"payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75\" (UID: \"03623c7e-c07f-4ef1-83d5-816968543291\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"
Sep 10 16:32:18.548071 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.548045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/601cd38b-34ef-45e8-b825-d23691e41b48-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z\" (UID: \"601cd38b-34ef-45e8-b825-d23691e41b48\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"
Sep 10 16:32:18.548164 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.548067    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03623c7e-c07f-4ef1-83d5-816968543291-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75\" (UID: \"03623c7e-c07f-4ef1-83d5-816968543291\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"
Sep 10 16:32:18.556741 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.556703    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hsms\" (UniqueName: \"kubernetes.io/projected/601cd38b-34ef-45e8-b825-d23691e41b48-kube-api-access-7hsms\") pod \"payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z\" (UID: \"601cd38b-34ef-45e8-b825-d23691e41b48\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"
Sep 10 16:32:18.556839 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.556818    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-298k5\" (UniqueName: \"kubernetes.io/projected/03623c7e-c07f-4ef1-83d5-816968543291-kube-api-access-298k5\") pod \"payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75\" (UID: \"03623c7e-c07f-4ef1-83d5-816968543291\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"
Sep 10 16:32:18.593708 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.593676    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"
Sep 10 16:32:18.643183 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.643047    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"
Sep 10 16:32:18.867186 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.867157    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"]
Sep 10 16:32:18.868959 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:32:18.868925    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601cd38b_34ef_45e8_b825_d23691e41b48.slice/crio-0c2d48a2a1fb0f2f017d0482fd4beb0d652306fbfb4fee05b20b649712b6d368 WatchSource:0}: Error finding container 0c2d48a2a1fb0f2f017d0482fd4beb0d652306fbfb4fee05b20b649712b6d368: Status 404 returned error can't find the container with id 0c2d48a2a1fb0f2f017d0482fd4beb0d652306fbfb4fee05b20b649712b6d368
Sep 10 16:32:18.932201 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:18.932176    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"]
Sep 10 16:32:18.933582 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:32:18.933560    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03623c7e_c07f_4ef1_83d5_816968543291.slice/crio-b87c1a8253a0886eb165b1e890cd00d22ea3181aa558b95160aca36120d10fd7 WatchSource:0}: Error finding container b87c1a8253a0886eb165b1e890cd00d22ea3181aa558b95160aca36120d10fd7: Status 404 returned error can't find the container with id b87c1a8253a0886eb165b1e890cd00d22ea3181aa558b95160aca36120d10fd7
Sep 10 16:32:19.431026 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:19.430981    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z" event={"ID":"601cd38b-34ef-45e8-b825-d23691e41b48","Type":"ContainerStarted","Data":"9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe"}
Sep 10 16:32:19.431487 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:19.431057    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z" event={"ID":"601cd38b-34ef-45e8-b825-d23691e41b48","Type":"ContainerStarted","Data":"0c2d48a2a1fb0f2f017d0482fd4beb0d652306fbfb4fee05b20b649712b6d368"}
Sep 10 16:32:19.431487 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:19.431194    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"
Sep 10 16:32:19.432635 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:19.432610    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75" event={"ID":"03623c7e-c07f-4ef1-83d5-816968543291","Type":"ContainerStarted","Data":"9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768"}
Sep 10 16:32:19.432772 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:19.432657    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75" event={"ID":"03623c7e-c07f-4ef1-83d5-816968543291","Type":"ContainerStarted","Data":"b87c1a8253a0886eb165b1e890cd00d22ea3181aa558b95160aca36120d10fd7"}
Sep 10 16:32:19.432772 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:19.432687    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"
Sep 10 16:32:19.450171 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:19.450068    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z" podStartSLOduration=1.45005511 podStartE2EDuration="1.45005511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:32:19.450023353 +0000 UTC m=+1823.862109566" watchObservedRunningTime="2026-09-10 16:32:19.45005511 +0000 UTC m=+1823.862141333"
Sep 10 16:32:19.471097 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:19.471054    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75" podStartSLOduration=1.471042044 podStartE2EDuration="1.471042044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:32:19.469293599 +0000 UTC m=+1823.881379809" watchObservedRunningTime="2026-09-10 16:32:19.471042044 +0000 UTC m=+1823.883128252"
Sep 10 16:32:30.440812 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:30.440775    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"
Sep 10 16:32:30.441418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:30.440904    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"
Sep 10 16:32:48.124621 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.124258    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"]
Sep 10 16:32:48.125252 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.124795    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z" podUID="601cd38b-34ef-45e8-b825-d23691e41b48" containerName="payload-processing" containerID="cri-o://9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe" gracePeriod=30
Sep 10 16:32:48.130371 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.130340    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"]
Sep 10 16:32:48.130804 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.130756    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75" podUID="03623c7e-c07f-4ef1-83d5-816968543291" containerName="payload-pre-processing" containerID="cri-o://9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768" gracePeriod=30
Sep 10 16:32:48.398472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.398446    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"
Sep 10 16:32:48.436863 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.436836    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"
Sep 10 16:32:48.566761 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.566689    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03623c7e-c07f-4ef1-83d5-816968543291-plugins-config-volume\") pod \"03623c7e-c07f-4ef1-83d5-816968543291\" (UID: \"03623c7e-c07f-4ef1-83d5-816968543291\") "
Sep 10 16:32:48.566968 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.566791    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-298k5\" (UniqueName: \"kubernetes.io/projected/03623c7e-c07f-4ef1-83d5-816968543291-kube-api-access-298k5\") pod \"03623c7e-c07f-4ef1-83d5-816968543291\" (UID: \"03623c7e-c07f-4ef1-83d5-816968543291\") "
Sep 10 16:32:48.566968 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.566866    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hsms\" (UniqueName: \"kubernetes.io/projected/601cd38b-34ef-45e8-b825-d23691e41b48-kube-api-access-7hsms\") pod \"601cd38b-34ef-45e8-b825-d23691e41b48\" (UID: \"601cd38b-34ef-45e8-b825-d23691e41b48\") "
Sep 10 16:32:48.566968 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.566899    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/601cd38b-34ef-45e8-b825-d23691e41b48-plugins-config-volume\") pod \"601cd38b-34ef-45e8-b825-d23691e41b48\" (UID: \"601cd38b-34ef-45e8-b825-d23691e41b48\") "
Sep 10 16:32:48.567151 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.567099    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03623c7e-c07f-4ef1-83d5-816968543291-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "03623c7e-c07f-4ef1-83d5-816968543291" (UID: "03623c7e-c07f-4ef1-83d5-816968543291"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:32:48.567339 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.567319    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03623c7e-c07f-4ef1-83d5-816968543291-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:32:48.567339 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.567328    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/601cd38b-34ef-45e8-b825-d23691e41b48-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "601cd38b-34ef-45e8-b825-d23691e41b48" (UID: "601cd38b-34ef-45e8-b825-d23691e41b48"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:32:48.569052 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.569023    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03623c7e-c07f-4ef1-83d5-816968543291-kube-api-access-298k5" (OuterVolumeSpecName: "kube-api-access-298k5") pod "03623c7e-c07f-4ef1-83d5-816968543291" (UID: "03623c7e-c07f-4ef1-83d5-816968543291"). InnerVolumeSpecName "kube-api-access-298k5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:32:48.569150 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.569023    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/601cd38b-34ef-45e8-b825-d23691e41b48-kube-api-access-7hsms" (OuterVolumeSpecName: "kube-api-access-7hsms") pod "601cd38b-34ef-45e8-b825-d23691e41b48" (UID: "601cd38b-34ef-45e8-b825-d23691e41b48"). InnerVolumeSpecName "kube-api-access-7hsms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:32:48.592384 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.592353    2562 generic.go:356] "Generic (PLEG): container finished" podID="03623c7e-c07f-4ef1-83d5-816968543291" containerID="9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768" exitCode=0
Sep 10 16:32:48.592523 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.592400    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"
Sep 10 16:32:48.592523 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.592441    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75" event={"ID":"03623c7e-c07f-4ef1-83d5-816968543291","Type":"ContainerDied","Data":"9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768"}
Sep 10 16:32:48.592523 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.592496    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75" event={"ID":"03623c7e-c07f-4ef1-83d5-816968543291","Type":"ContainerDied","Data":"b87c1a8253a0886eb165b1e890cd00d22ea3181aa558b95160aca36120d10fd7"}
Sep 10 16:32:48.592659 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.592526    2562 scope.go:117] "RemoveContainer" containerID="9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768"
Sep 10 16:32:48.593799 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.593778    2562 generic.go:356] "Generic (PLEG): container finished" podID="601cd38b-34ef-45e8-b825-d23691e41b48" containerID="9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe" exitCode=0
Sep 10 16:32:48.593919 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.593820    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"
Sep 10 16:32:48.593919 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.593843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z" event={"ID":"601cd38b-34ef-45e8-b825-d23691e41b48","Type":"ContainerDied","Data":"9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe"}
Sep 10 16:32:48.593919 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.593877    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z" event={"ID":"601cd38b-34ef-45e8-b825-d23691e41b48","Type":"ContainerDied","Data":"0c2d48a2a1fb0f2f017d0482fd4beb0d652306fbfb4fee05b20b649712b6d368"}
Sep 10 16:32:48.603095 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.603007    2562 scope.go:117] "RemoveContainer" containerID="9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768"
Sep 10 16:32:48.603310 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:32:48.603290    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768\": container with ID starting with 9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768 not found: ID does not exist" containerID="9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768"
Sep 10 16:32:48.603387 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.603316    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768"} err="failed to get container status \"9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768\": rpc error: code = NotFound desc = could not find container \"9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768\": container with ID starting with 9da9eda71bfde4e175bf2fddb01d8b406db6f1cc6a8e5cd8f434055a00c10768 not found: ID does not exist"
Sep 10 16:32:48.603387 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.603332    2562 scope.go:117] "RemoveContainer" containerID="9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe"
Sep 10 16:32:48.611605 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.611588    2562 scope.go:117] "RemoveContainer" containerID="9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe"
Sep 10 16:32:48.611879 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:32:48.611862    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe\": container with ID starting with 9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe not found: ID does not exist" containerID="9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe"
Sep 10 16:32:48.611946 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.611888    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe"} err="failed to get container status \"9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe\": rpc error: code = NotFound desc = could not find container \"9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe\": container with ID starting with 9f3e18d95065e5241802d2311af6766d2fc60493af77ea467b3d2612fcf7aabe not found: ID does not exist"
Sep 10 16:32:48.618011 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.617988    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"]
Sep 10 16:32:48.625050 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.625029    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-68ca72-54bb68d854-mgf75"]
Sep 10 16:32:48.638270 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.638209    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"]
Sep 10 16:32:48.643250 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.643227    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-68ca72-fff8d7dd9-dsn2z"]
Sep 10 16:32:48.668349 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.668324    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-298k5\" (UniqueName: \"kubernetes.io/projected/03623c7e-c07f-4ef1-83d5-816968543291-kube-api-access-298k5\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:32:48.668349 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.668345    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hsms\" (UniqueName: \"kubernetes.io/projected/601cd38b-34ef-45e8-b825-d23691e41b48-kube-api-access-7hsms\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:32:48.668476 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:48.668356    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/601cd38b-34ef-45e8-b825-d23691e41b48-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:32:50.071676 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:50.071639    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03623c7e-c07f-4ef1-83d5-816968543291" path="/var/lib/kubelet/pods/03623c7e-c07f-4ef1-83d5-816968543291/volumes"
Sep 10 16:32:50.072086 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:50.072052    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="601cd38b-34ef-45e8-b825-d23691e41b48" path="/var/lib/kubelet/pods/601cd38b-34ef-45e8-b825-d23691e41b48/volumes"
Sep 10 16:32:56.431040 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:32:56.431011    2562 scope.go:117] "RemoveContainer" containerID="3565a3e419d22a755392177e0acf3fff47b4011ee3a6f1ef74c7c72833787696"
Sep 10 16:33:14.981671 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:14.981632    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"]
Sep 10 16:33:14.982298 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:14.981895    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f" podUID="fd64cfcc-088c-4fa1-bcda-0c7783528a8a" containerName="payload-processing" containerID="cri-o://a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a" gracePeriod=30
Sep 10 16:33:14.992804 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:14.992777    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"]
Sep 10 16:33:14.993053 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:14.993018    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb" podUID="150f0b7c-582d-4030-9c3f-52b341e36c91" containerName="payload-pre-processing" containerID="cri-o://f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff" gracePeriod=30
Sep 10 16:33:15.274950 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.274929    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"
Sep 10 16:33:15.277718 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.277697    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"
Sep 10 16:33:15.341372 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.341333    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46d7l\" (UniqueName: \"kubernetes.io/projected/fd64cfcc-088c-4fa1-bcda-0c7783528a8a-kube-api-access-46d7l\") pod \"fd64cfcc-088c-4fa1-bcda-0c7783528a8a\" (UID: \"fd64cfcc-088c-4fa1-bcda-0c7783528a8a\") "
Sep 10 16:33:15.341559 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.341392    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/150f0b7c-582d-4030-9c3f-52b341e36c91-plugins-config-volume\") pod \"150f0b7c-582d-4030-9c3f-52b341e36c91\" (UID: \"150f0b7c-582d-4030-9c3f-52b341e36c91\") "
Sep 10 16:33:15.341559 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.341413    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvzmp\" (UniqueName: \"kubernetes.io/projected/150f0b7c-582d-4030-9c3f-52b341e36c91-kube-api-access-hvzmp\") pod \"150f0b7c-582d-4030-9c3f-52b341e36c91\" (UID: \"150f0b7c-582d-4030-9c3f-52b341e36c91\") "
Sep 10 16:33:15.341559 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.341525    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd64cfcc-088c-4fa1-bcda-0c7783528a8a-plugins-config-volume\") pod \"fd64cfcc-088c-4fa1-bcda-0c7783528a8a\" (UID: \"fd64cfcc-088c-4fa1-bcda-0c7783528a8a\") "
Sep 10 16:33:15.341798 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.341768    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/150f0b7c-582d-4030-9c3f-52b341e36c91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "150f0b7c-582d-4030-9c3f-52b341e36c91" (UID: "150f0b7c-582d-4030-9c3f-52b341e36c91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:33:15.341973 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.341932    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd64cfcc-088c-4fa1-bcda-0c7783528a8a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd64cfcc-088c-4fa1-bcda-0c7783528a8a" (UID: "fd64cfcc-088c-4fa1-bcda-0c7783528a8a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:33:15.342133 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.342109    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/150f0b7c-582d-4030-9c3f-52b341e36c91-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:33:15.342239 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.342137    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd64cfcc-088c-4fa1-bcda-0c7783528a8a-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:33:15.344074 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.344044    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/150f0b7c-582d-4030-9c3f-52b341e36c91-kube-api-access-hvzmp" (OuterVolumeSpecName: "kube-api-access-hvzmp") pod "150f0b7c-582d-4030-9c3f-52b341e36c91" (UID: "150f0b7c-582d-4030-9c3f-52b341e36c91"). InnerVolumeSpecName "kube-api-access-hvzmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:33:15.344192 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.344131    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd64cfcc-088c-4fa1-bcda-0c7783528a8a-kube-api-access-46d7l" (OuterVolumeSpecName: "kube-api-access-46d7l") pod "fd64cfcc-088c-4fa1-bcda-0c7783528a8a" (UID: "fd64cfcc-088c-4fa1-bcda-0c7783528a8a"). InnerVolumeSpecName "kube-api-access-46d7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:33:15.443211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.443176    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46d7l\" (UniqueName: \"kubernetes.io/projected/fd64cfcc-088c-4fa1-bcda-0c7783528a8a-kube-api-access-46d7l\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:33:15.443211 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.443198    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvzmp\" (UniqueName: \"kubernetes.io/projected/150f0b7c-582d-4030-9c3f-52b341e36c91-kube-api-access-hvzmp\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:33:15.746472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.746437    2562 generic.go:356] "Generic (PLEG): container finished" podID="fd64cfcc-088c-4fa1-bcda-0c7783528a8a" containerID="a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a" exitCode=0
Sep 10 16:33:15.746656 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.746485    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"
Sep 10 16:33:15.746656 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.746533    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f" event={"ID":"fd64cfcc-088c-4fa1-bcda-0c7783528a8a","Type":"ContainerDied","Data":"a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a"}
Sep 10 16:33:15.746656 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.746599    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f" event={"ID":"fd64cfcc-088c-4fa1-bcda-0c7783528a8a","Type":"ContainerDied","Data":"0bb6f95fe7371cf8b4e6f0598190709bfc52347872f04e1dbbcdf3497b7e4a5b"}
Sep 10 16:33:15.746656 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.746617    2562 scope.go:117] "RemoveContainer" containerID="a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a"
Sep 10 16:33:15.748072 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.748049    2562 generic.go:356] "Generic (PLEG): container finished" podID="150f0b7c-582d-4030-9c3f-52b341e36c91" containerID="f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff" exitCode=0
Sep 10 16:33:15.748180 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.748077    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb" event={"ID":"150f0b7c-582d-4030-9c3f-52b341e36c91","Type":"ContainerDied","Data":"f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff"}
Sep 10 16:33:15.748180 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.748096    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"
Sep 10 16:33:15.748180 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.748140    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb" event={"ID":"150f0b7c-582d-4030-9c3f-52b341e36c91","Type":"ContainerDied","Data":"c9c13261b480a74d12ddd1f3d65139fa609be6c1e537880747dd80fde89305da"}
Sep 10 16:33:15.756397 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.756374    2562 scope.go:117] "RemoveContainer" containerID="a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a"
Sep 10 16:33:15.756680 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:33:15.756660    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a\": container with ID starting with a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a not found: ID does not exist" containerID="a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a"
Sep 10 16:33:15.756752 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.756689    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a"} err="failed to get container status \"a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a\": rpc error: code = NotFound desc = could not find container \"a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a\": container with ID starting with a9f516cdebd75864b7c19f34e505838faaa85d40e116c3a48ad446af35cce06a not found: ID does not exist"
Sep 10 16:33:15.756752 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.756704    2562 scope.go:117] "RemoveContainer" containerID="f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff"
Sep 10 16:33:15.764876 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.764819    2562 scope.go:117] "RemoveContainer" containerID="f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff"
Sep 10 16:33:15.765095 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:33:15.765075    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff\": container with ID starting with f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff not found: ID does not exist" containerID="f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff"
Sep 10 16:33:15.765153 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.765101    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff"} err="failed to get container status \"f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff\": rpc error: code = NotFound desc = could not find container \"f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff\": container with ID starting with f1fd669eb1e02e57b13995a06eae1c611458fbb66b59723ac3015d5f9a0f06ff not found: ID does not exist"
Sep 10 16:33:15.778759 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.778712    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"]
Sep 10 16:33:15.781492 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.781472    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-814d40-7d6f469754-n5tpb"]
Sep 10 16:33:15.795022 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.794997    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"]
Sep 10 16:33:15.803366 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:15.803345    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-814d40-6bf8656cff-pc94f"]
Sep 10 16:33:16.077755 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:16.077703    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="150f0b7c-582d-4030-9c3f-52b341e36c91" path="/var/lib/kubelet/pods/150f0b7c-582d-4030-9c3f-52b341e36c91/volumes"
Sep 10 16:33:16.078115 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:33:16.078101    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd64cfcc-088c-4fa1-bcda-0c7783528a8a" path="/var/lib/kubelet/pods/fd64cfcc-088c-4fa1-bcda-0c7783528a8a/volumes"
Sep 10 16:34:04.674513 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:04.674476    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"]
Sep 10 16:34:04.675010 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:04.674689    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy" containerID="cri-o://65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd" gracePeriod=30
Sep 10 16:34:05.264464 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:05.264418    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 16:34:05.264643 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:05.264483    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 16:34:09.921871 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.921846    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:34:09.956282 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956221    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-podinfo\") pod \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") "
Sep 10 16:34:09.956282 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956255    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-envoy\") pod \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") "
Sep 10 16:34:09.956424 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956305    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-data\") pod \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") "
Sep 10 16:34:09.956424 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956410    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-workload-socket\") pod \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") "
Sep 10 16:34:09.956501 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956435    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-credential-socket\") pod \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") "
Sep 10 16:34:09.956501 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956473    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-token\") pod \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") "
Sep 10 16:34:09.956612 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956504    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svmd2\" (UniqueName: \"kubernetes.io/projected/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-kube-api-access-svmd2\") pod \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") "
Sep 10 16:34:09.956612 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956533    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-workload-certs\") pod \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") "
Sep 10 16:34:09.956612 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956592    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istiod-ca-cert\") pod \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\" (UID: \"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2\") "
Sep 10 16:34:09.956805 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956635    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-data" (OuterVolumeSpecName: "istio-data") pod "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" (UID: "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:34:09.956805 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956643    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" (UID: "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:34:09.956921 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956881    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" (UID: "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:34:09.956921 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.956905    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" (UID: "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:34:09.957026 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.957009    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-data\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:09.957122 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.957027    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-workload-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:09.957247 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.957129    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-credential-socket\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:09.957247 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.957145    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-workload-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:09.957247 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.957187    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" (UID: "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:34:09.958482 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.958460    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" (UID: "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:34:09.958686 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.958671    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" (UID: "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:34:09.958856 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.958827    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-kube-api-access-svmd2" (OuterVolumeSpecName: "kube-api-access-svmd2") pod "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" (UID: "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2"). InnerVolumeSpecName "kube-api-access-svmd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:34:09.958856 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:09.958851    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" (UID: "23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:34:10.052032 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.052003    2562 generic.go:356] "Generic (PLEG): container finished" podID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerID="65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd" exitCode=0
Sep 10 16:34:10.052152 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.052047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" event={"ID":"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2","Type":"ContainerDied","Data":"65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd"}
Sep 10 16:34:10.052152 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.052085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74" event={"ID":"23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2","Type":"ContainerDied","Data":"773576961ca11258c0ed5bd98ab394fa2dca7d016bff8af1f442f74cba6d6204"}
Sep 10 16:34:10.052152 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.052106    2562 scope.go:117] "RemoveContainer" containerID="65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd"
Sep 10 16:34:10.052152 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.052048    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"
Sep 10 16:34:10.057890 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.057860    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-token\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:10.057890 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.057887    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svmd2\" (UniqueName: \"kubernetes.io/projected/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-kube-api-access-svmd2\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:10.058027 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.057902    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istiod-ca-cert\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:10.058027 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.057916    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-podinfo\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:10.058027 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.057927    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2-istio-envoy\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:10.061044 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.061029    2562 scope.go:117] "RemoveContainer" containerID="2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470"
Sep 10 16:34:10.069173 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.069159    2562 scope.go:117] "RemoveContainer" containerID="65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd"
Sep 10 16:34:10.069441 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:34:10.069422    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd\": container with ID starting with 65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd not found: ID does not exist" containerID="65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd"
Sep 10 16:34:10.069489 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.069449    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd"} err="failed to get container status \"65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd\": rpc error: code = NotFound desc = could not find container \"65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd\": container with ID starting with 65c1431a87e3193dd790dbab8b7a95a22880112219098784032ba04eb2c700cd not found: ID does not exist"
Sep 10 16:34:10.069489 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.069467    2562 scope.go:117] "RemoveContainer" containerID="2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470"
Sep 10 16:34:10.069767 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:34:10.069747    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470\": container with ID starting with 2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470 not found: ID does not exist" containerID="2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470"
Sep 10 16:34:10.069848 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.069772    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470"} err="failed to get container status \"2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470\": rpc error: code = NotFound desc = could not find container \"2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470\": container with ID starting with 2253d90fe6123199c03766be23316d2a876b0771dac35d0a23b63ab52591f470 not found: ID does not exist"
Sep 10 16:34:10.077721 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.077691    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"]
Sep 10 16:34:10.082846 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:10.082826    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-814d40-openshift-default-64cd9cb8d8-kxh74"]
Sep 10 16:34:12.070739 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:12.070696    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" path="/var/lib/kubelet/pods/23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2/volumes"
Sep 10 16:34:15.997898 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:15.997853    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"]
Sep 10 16:34:15.998380 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:15.998065    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85" podUID="253d580e-35cd-4822-99d0-dcc201d65b5d" containerName="payload-processing" containerID="cri-o://dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6" gracePeriod=30
Sep 10 16:34:16.255861 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:16.255803    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"
Sep 10 16:34:16.314080 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:16.314050    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/253d580e-35cd-4822-99d0-dcc201d65b5d-plugins-config-volume\") pod \"253d580e-35cd-4822-99d0-dcc201d65b5d\" (UID: \"253d580e-35cd-4822-99d0-dcc201d65b5d\") "
Sep 10 16:34:16.314234 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:16.314097    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shjx8\" (UniqueName: \"kubernetes.io/projected/253d580e-35cd-4822-99d0-dcc201d65b5d-kube-api-access-shjx8\") pod \"253d580e-35cd-4822-99d0-dcc201d65b5d\" (UID: \"253d580e-35cd-4822-99d0-dcc201d65b5d\") "
Sep 10 16:34:16.314459 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:16.314437    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/253d580e-35cd-4822-99d0-dcc201d65b5d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "253d580e-35cd-4822-99d0-dcc201d65b5d" (UID: "253d580e-35cd-4822-99d0-dcc201d65b5d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:34:16.316297 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:16.316271    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/253d580e-35cd-4822-99d0-dcc201d65b5d-kube-api-access-shjx8" (OuterVolumeSpecName: "kube-api-access-shjx8") pod "253d580e-35cd-4822-99d0-dcc201d65b5d" (UID: "253d580e-35cd-4822-99d0-dcc201d65b5d"). InnerVolumeSpecName "kube-api-access-shjx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:34:16.415804 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:16.415759    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/253d580e-35cd-4822-99d0-dcc201d65b5d-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:16.415804 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:16.415797    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shjx8\" (UniqueName: \"kubernetes.io/projected/253d580e-35cd-4822-99d0-dcc201d65b5d-kube-api-access-shjx8\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:17.097307 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:17.097269    2562 generic.go:356] "Generic (PLEG): container finished" podID="253d580e-35cd-4822-99d0-dcc201d65b5d" containerID="dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6" exitCode=0
Sep 10 16:34:17.097801 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:17.097314    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"
Sep 10 16:34:17.097801 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:17.097353    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85" event={"ID":"253d580e-35cd-4822-99d0-dcc201d65b5d","Type":"ContainerDied","Data":"dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6"}
Sep 10 16:34:17.097801 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:17.097408    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85" event={"ID":"253d580e-35cd-4822-99d0-dcc201d65b5d","Type":"ContainerDied","Data":"a4a0d601063755edcc137acb50a510ebea8dd9e34e919962006fdf7c149657dc"}
Sep 10 16:34:17.097801 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:17.097432    2562 scope.go:117] "RemoveContainer" containerID="dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6"
Sep 10 16:34:17.106949 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:17.106932    2562 scope.go:117] "RemoveContainer" containerID="dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6"
Sep 10 16:34:17.107213 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:34:17.107192    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6\": container with ID starting with dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6 not found: ID does not exist" containerID="dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6"
Sep 10 16:34:17.107262 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:17.107223    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6"} err="failed to get container status \"dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6\": rpc error: code = NotFound desc = could not find container \"dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6\": container with ID starting with dc8d991b74463881cf5cd61f3fbd0c810621b2e9fe948dc15ca5f789f88baae6 not found: ID does not exist"
Sep 10 16:34:17.139892 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:17.139867    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"]
Sep 10 16:34:17.141824 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:17.141804    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-275a06-77cf85fc57-h7x85"]
Sep 10 16:34:18.070281 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:18.070240    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="253d580e-35cd-4822-99d0-dcc201d65b5d" path="/var/lib/kubelet/pods/253d580e-35cd-4822-99d0-dcc201d65b5d/volumes"
Sep 10 16:34:23.337003 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.336967    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7"]
Sep 10 16:34:23.337608 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337586    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd64cfcc-088c-4fa1-bcda-0c7783528a8a" containerName="payload-processing"
Sep 10 16:34:23.337668 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337613    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd64cfcc-088c-4fa1-bcda-0c7783528a8a" containerName="payload-processing"
Sep 10 16:34:23.337668 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337631    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy"
Sep 10 16:34:23.337668 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337646    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy"
Sep 10 16:34:23.337668 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337655    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="150f0b7c-582d-4030-9c3f-52b341e36c91" containerName="payload-pre-processing"
Sep 10 16:34:23.337668 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337661    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="150f0b7c-582d-4030-9c3f-52b341e36c91" containerName="payload-pre-processing"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337674    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="601cd38b-34ef-45e8-b825-d23691e41b48" containerName="payload-processing"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337680    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="601cd38b-34ef-45e8-b825-d23691e41b48" containerName="payload-processing"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337685    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03623c7e-c07f-4ef1-83d5-816968543291" containerName="payload-pre-processing"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337690    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="03623c7e-c07f-4ef1-83d5-816968543291" containerName="payload-pre-processing"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337703    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337708    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337717    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253d580e-35cd-4822-99d0-dcc201d65b5d" containerName="payload-processing"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337735    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="253d580e-35cd-4822-99d0-dcc201d65b5d" containerName="payload-processing"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337813    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337821    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd64cfcc-088c-4fa1-bcda-0c7783528a8a" containerName="payload-processing"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337828    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="03623c7e-c07f-4ef1-83d5-816968543291" containerName="payload-pre-processing"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337837    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="601cd38b-34ef-45e8-b825-d23691e41b48" containerName="payload-processing"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337844    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="253d580e-35cd-4822-99d0-dcc201d65b5d" containerName="payload-processing"
Sep 10 16:34:23.337917 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.337849    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="150f0b7c-582d-4030-9c3f-52b341e36c91" containerName="payload-pre-processing"
Sep 10 16:34:23.342279 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.342258    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7"
Sep 10 16:34:23.346622 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.346438    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l2dj2\""
Sep 10 16:34:23.347997 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.347975    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7"]
Sep 10 16:34:23.380732 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.380706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7\" (UID: \"f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7"
Sep 10 16:34:23.482068 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.482043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7\" (UID: \"f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7"
Sep 10 16:34:23.482646 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.482626    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7\" (UID: \"f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7"
Sep 10 16:34:23.653845 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.653774    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7"
Sep 10 16:34:23.937513 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:23.937444    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7"]
Sep 10 16:34:23.940894 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:34:23.940867    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d39a4c_04a8_4d6f_b88f_d2a55a4c5634.slice/crio-edf390aa7b6d33ccefba14454677abbe5fb6715261a8b47bcfb0a2d48504a001 WatchSource:0}: Error finding container edf390aa7b6d33ccefba14454677abbe5fb6715261a8b47bcfb0a2d48504a001: Status 404 returned error can't find the container with id edf390aa7b6d33ccefba14454677abbe5fb6715261a8b47bcfb0a2d48504a001
Sep 10 16:34:24.148778 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:24.148715    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7" event={"ID":"f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634","Type":"ContainerStarted","Data":"edf390aa7b6d33ccefba14454677abbe5fb6715261a8b47bcfb0a2d48504a001"}
Sep 10 16:34:25.155241 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:25.155153    2562 generic.go:356] "Generic (PLEG): container finished" podID="f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634" containerID="c5331b2457da1ef912023a37fe81a1572a6cf8231b437eaabd5c45c445a60a4d" exitCode=0
Sep 10 16:34:25.155591 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:25.155239    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7" event={"ID":"f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634","Type":"ContainerDied","Data":"c5331b2457da1ef912023a37fe81a1572a6cf8231b437eaabd5c45c445a60a4d"}
Sep 10 16:34:26.282782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:26.282758    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7"
Sep 10 16:34:26.408694 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:26.408661    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634-maas-api-service-ca\") pod \"f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634\" (UID: \"f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634\") "
Sep 10 16:34:26.408984 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:26.408961    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634" (UID: "f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:34:26.510298 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:26.510276    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634-maas-api-service-ca\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:27.167226 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:27.167195    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7"
Sep 10 16:34:27.167226 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:27.167210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7" event={"ID":"f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634","Type":"ContainerDied","Data":"edf390aa7b6d33ccefba14454677abbe5fb6715261a8b47bcfb0a2d48504a001"}
Sep 10 16:34:27.167480 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:27.167249    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edf390aa7b6d33ccefba14454677abbe5fb6715261a8b47bcfb0a2d48504a001"
Sep 10 16:34:33.908231 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:33.908192    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"]
Sep 10 16:34:33.908862 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:33.908433    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn" podUID="5c08cdca-82fc-4bf6-bff8-f691de4280c3" containerName="payload-processing" containerID="cri-o://f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4" gracePeriod=30
Sep 10 16:34:33.911846 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:33.911813    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"]
Sep 10 16:34:33.912111 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:33.912060    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c" podUID="2611a2f8-e770-4949-bacd-6ff069533469" containerName="payload-pre-processing" containerID="cri-o://e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5" gracePeriod=30
Sep 10 16:34:34.163291 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.163181    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7"]
Sep 10 16:34:34.165643 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.165609    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-219fd6-rl7x7"]
Sep 10 16:34:34.194641 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.194621    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"
Sep 10 16:34:34.197834 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.197816    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"
Sep 10 16:34:34.204418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.204398    2562 generic.go:356] "Generic (PLEG): container finished" podID="2611a2f8-e770-4949-bacd-6ff069533469" containerID="e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5" exitCode=0
Sep 10 16:34:34.204512 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.204432    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"
Sep 10 16:34:34.204512 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.204480    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c" event={"ID":"2611a2f8-e770-4949-bacd-6ff069533469","Type":"ContainerDied","Data":"e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5"}
Sep 10 16:34:34.204633 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.204529    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c" event={"ID":"2611a2f8-e770-4949-bacd-6ff069533469","Type":"ContainerDied","Data":"7fd178de287c81f9209d3a38e3c2b268840c270db6e6e5bd0d9deb24c577a993"}
Sep 10 16:34:34.204633 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.204545    2562 scope.go:117] "RemoveContainer" containerID="e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5"
Sep 10 16:34:34.205747 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.205714    2562 generic.go:356] "Generic (PLEG): container finished" podID="5c08cdca-82fc-4bf6-bff8-f691de4280c3" containerID="f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4" exitCode=0
Sep 10 16:34:34.205842 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.205773    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"
Sep 10 16:34:34.205842 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.205784    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn" event={"ID":"5c08cdca-82fc-4bf6-bff8-f691de4280c3","Type":"ContainerDied","Data":"f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4"}
Sep 10 16:34:34.205842 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.205826    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn" event={"ID":"5c08cdca-82fc-4bf6-bff8-f691de4280c3","Type":"ContainerDied","Data":"4e3599c4cd0e34c3b1459f904455a9d129ba0e8b054ab34b9178d6f7ab594d16"}
Sep 10 16:34:34.213029 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.213013    2562 scope.go:117] "RemoveContainer" containerID="e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5"
Sep 10 16:34:34.213284 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:34:34.213266    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5\": container with ID starting with e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5 not found: ID does not exist" containerID="e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5"
Sep 10 16:34:34.213334 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.213292    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5"} err="failed to get container status \"e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5\": rpc error: code = NotFound desc = could not find container \"e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5\": container with ID starting with e81063864f1c8ccbc8bb4062ca56d9727ab2d523e189f50d4b8726ee3f0e80c5 not found: ID does not exist"
Sep 10 16:34:34.213334 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.213309    2562 scope.go:117] "RemoveContainer" containerID="f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4"
Sep 10 16:34:34.224860 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.224517    2562 scope.go:117] "RemoveContainer" containerID="f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4"
Sep 10 16:34:34.225223 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:34:34.225190    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4\": container with ID starting with f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4 not found: ID does not exist" containerID="f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4"
Sep 10 16:34:34.225337 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.225232    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4"} err="failed to get container status \"f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4\": rpc error: code = NotFound desc = could not find container \"f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4\": container with ID starting with f92e52f8de1d3ad2f1e9b0d4939bdc03f29ee0251c603dd4e70f728b6cba96e4 not found: ID does not exist"
Sep 10 16:34:34.281217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.281175    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9cjm\" (UniqueName: \"kubernetes.io/projected/5c08cdca-82fc-4bf6-bff8-f691de4280c3-kube-api-access-k9cjm\") pod \"5c08cdca-82fc-4bf6-bff8-f691de4280c3\" (UID: \"5c08cdca-82fc-4bf6-bff8-f691de4280c3\") "
Sep 10 16:34:34.281217 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.281221    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hfwr\" (UniqueName: \"kubernetes.io/projected/2611a2f8-e770-4949-bacd-6ff069533469-kube-api-access-2hfwr\") pod \"2611a2f8-e770-4949-bacd-6ff069533469\" (UID: \"2611a2f8-e770-4949-bacd-6ff069533469\") "
Sep 10 16:34:34.281450 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.281239    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c08cdca-82fc-4bf6-bff8-f691de4280c3-plugins-config-volume\") pod \"5c08cdca-82fc-4bf6-bff8-f691de4280c3\" (UID: \"5c08cdca-82fc-4bf6-bff8-f691de4280c3\") "
Sep 10 16:34:34.281450 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.281287    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2611a2f8-e770-4949-bacd-6ff069533469-plugins-config-volume\") pod \"2611a2f8-e770-4949-bacd-6ff069533469\" (UID: \"2611a2f8-e770-4949-bacd-6ff069533469\") "
Sep 10 16:34:34.281673 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.281647    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c08cdca-82fc-4bf6-bff8-f691de4280c3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5c08cdca-82fc-4bf6-bff8-f691de4280c3" (UID: "5c08cdca-82fc-4bf6-bff8-f691de4280c3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:34:34.281775 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.281749    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2611a2f8-e770-4949-bacd-6ff069533469-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2611a2f8-e770-4949-bacd-6ff069533469" (UID: "2611a2f8-e770-4949-bacd-6ff069533469"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:34:34.283396 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.283373    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c08cdca-82fc-4bf6-bff8-f691de4280c3-kube-api-access-k9cjm" (OuterVolumeSpecName: "kube-api-access-k9cjm") pod "5c08cdca-82fc-4bf6-bff8-f691de4280c3" (UID: "5c08cdca-82fc-4bf6-bff8-f691de4280c3"). InnerVolumeSpecName "kube-api-access-k9cjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:34:34.283517 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.283399    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2611a2f8-e770-4949-bacd-6ff069533469-kube-api-access-2hfwr" (OuterVolumeSpecName: "kube-api-access-2hfwr") pod "2611a2f8-e770-4949-bacd-6ff069533469" (UID: "2611a2f8-e770-4949-bacd-6ff069533469"). InnerVolumeSpecName "kube-api-access-2hfwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:34:34.382576 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.382544    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9cjm\" (UniqueName: \"kubernetes.io/projected/5c08cdca-82fc-4bf6-bff8-f691de4280c3-kube-api-access-k9cjm\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:34.382576 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.382569    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hfwr\" (UniqueName: \"kubernetes.io/projected/2611a2f8-e770-4949-bacd-6ff069533469-kube-api-access-2hfwr\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:34.382576 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.382581    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c08cdca-82fc-4bf6-bff8-f691de4280c3-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:34.382843 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.382590    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2611a2f8-e770-4949-bacd-6ff069533469-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:34.530433 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.530401    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"]
Sep 10 16:34:34.535159 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.535132    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-219fd6-59c79dc69f-pf4vn"]
Sep 10 16:34:34.547846 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.547825    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"]
Sep 10 16:34:34.552024 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:34.552002    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-219fd6-64dcd7f4c4-68j6c"]
Sep 10 16:34:36.071909 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:36.071872    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2611a2f8-e770-4949-bacd-6ff069533469" path="/var/lib/kubelet/pods/2611a2f8-e770-4949-bacd-6ff069533469/volumes"
Sep 10 16:34:36.072281 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:36.072238    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c08cdca-82fc-4bf6-bff8-f691de4280c3" path="/var/lib/kubelet/pods/5c08cdca-82fc-4bf6-bff8-f691de4280c3/volumes"
Sep 10 16:34:36.072511 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:36.072499    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634" path="/var/lib/kubelet/pods/f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634/volumes"
Sep 10 16:34:41.917137 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.917105    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz"]
Sep 10 16:34:41.917551 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.917536    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2611a2f8-e770-4949-bacd-6ff069533469" containerName="payload-pre-processing"
Sep 10 16:34:41.917596 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.917552    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2611a2f8-e770-4949-bacd-6ff069533469" containerName="payload-pre-processing"
Sep 10 16:34:41.917596 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.917561    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634" containerName="revoke-keys"
Sep 10 16:34:41.917596 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.917567    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634" containerName="revoke-keys"
Sep 10 16:34:41.917596 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.917589    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c08cdca-82fc-4bf6-bff8-f691de4280c3" containerName="payload-processing"
Sep 10 16:34:41.917596 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.917596    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c08cdca-82fc-4bf6-bff8-f691de4280c3" containerName="payload-processing"
Sep 10 16:34:41.917774 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.917666    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9d39a4c-04a8-4d6f-b88f-d2a55a4c5634" containerName="revoke-keys"
Sep 10 16:34:41.917774 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.917676    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2611a2f8-e770-4949-bacd-6ff069533469" containerName="payload-pre-processing"
Sep 10 16:34:41.917774 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.917682    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="23ded5c1-d43f-4ce6-bf08-6ccf5fc407a2" containerName="istio-proxy"
Sep 10 16:34:41.917774 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.917692    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c08cdca-82fc-4bf6-bff8-f691de4280c3" containerName="payload-processing"
Sep 10 16:34:41.922318 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.922297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz"
Sep 10 16:34:41.926944 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.926921    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l2dj2\""
Sep 10 16:34:41.933538 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:41.933506    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz"]
Sep 10 16:34:42.056614 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:42.056578    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f63f16bc-7609-420a-a99a-66f97ddd18bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz\" (UID: \"f63f16bc-7609-420a-a99a-66f97ddd18bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz"
Sep 10 16:34:42.158033 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:42.157984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f63f16bc-7609-420a-a99a-66f97ddd18bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz\" (UID: \"f63f16bc-7609-420a-a99a-66f97ddd18bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz"
Sep 10 16:34:42.158566 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:42.158544    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f63f16bc-7609-420a-a99a-66f97ddd18bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz\" (UID: \"f63f16bc-7609-420a-a99a-66f97ddd18bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz"
Sep 10 16:34:42.232355 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:42.232325    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz"
Sep 10 16:34:42.507955 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:42.507930    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz"]
Sep 10 16:34:42.510038 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:34:42.510011    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63f16bc_7609_420a_a99a_66f97ddd18bc.slice/crio-d05a3347e0f1b341f7bb25c9d4694252cc9f5d225c1903c23e79956d864f4af9 WatchSource:0}: Error finding container d05a3347e0f1b341f7bb25c9d4694252cc9f5d225c1903c23e79956d864f4af9: Status 404 returned error can't find the container with id d05a3347e0f1b341f7bb25c9d4694252cc9f5d225c1903c23e79956d864f4af9
Sep 10 16:34:43.256755 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:43.256707    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz" event={"ID":"f63f16bc-7609-420a-a99a-66f97ddd18bc","Type":"ContainerStarted","Data":"14ad5e0689598406864d1099516c5c739adf9291eeea2f2174acb739d524f802"}
Sep 10 16:34:43.257151 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:43.256774    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz" event={"ID":"f63f16bc-7609-420a-a99a-66f97ddd18bc","Type":"ContainerStarted","Data":"d05a3347e0f1b341f7bb25c9d4694252cc9f5d225c1903c23e79956d864f4af9"}
Sep 10 16:34:43.285966 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:43.285920    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz" podStartSLOduration=2.285904159 podStartE2EDuration="2.285904159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:34:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:34:43.28528725 +0000 UTC m=+1967.697373460" watchObservedRunningTime="2026-09-10 16:34:43.285904159 +0000 UTC m=+1967.697990367"
Sep 10 16:34:44.264592 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:44.264554    2562 generic.go:356] "Generic (PLEG): container finished" podID="f63f16bc-7609-420a-a99a-66f97ddd18bc" containerID="14ad5e0689598406864d1099516c5c739adf9291eeea2f2174acb739d524f802" exitCode=0
Sep 10 16:34:44.265007 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:44.264619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz" event={"ID":"f63f16bc-7609-420a-a99a-66f97ddd18bc","Type":"ContainerDied","Data":"14ad5e0689598406864d1099516c5c739adf9291eeea2f2174acb739d524f802"}
Sep 10 16:34:45.406855 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:45.406830    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz"
Sep 10 16:34:45.591769 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:45.591654    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f63f16bc-7609-420a-a99a-66f97ddd18bc-maas-api-service-ca\") pod \"f63f16bc-7609-420a-a99a-66f97ddd18bc\" (UID: \"f63f16bc-7609-420a-a99a-66f97ddd18bc\") "
Sep 10 16:34:45.592011 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:45.591989    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f63f16bc-7609-420a-a99a-66f97ddd18bc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f63f16bc-7609-420a-a99a-66f97ddd18bc" (UID: "f63f16bc-7609-420a-a99a-66f97ddd18bc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:34:45.692622 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:45.692584    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f63f16bc-7609-420a-a99a-66f97ddd18bc-maas-api-service-ca\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:46.276088 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:46.276055    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz"
Sep 10 16:34:46.276259 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:46.276092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz" event={"ID":"f63f16bc-7609-420a-a99a-66f97ddd18bc","Type":"ContainerDied","Data":"d05a3347e0f1b341f7bb25c9d4694252cc9f5d225c1903c23e79956d864f4af9"}
Sep 10 16:34:46.276259 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:46.276138    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d05a3347e0f1b341f7bb25c9d4694252cc9f5d225c1903c23e79956d864f4af9"
Sep 10 16:34:52.668706 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:52.668624    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"]
Sep 10 16:34:52.669109 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:52.668858    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f" podUID="b8269eec-fc72-4cb1-bb49-61ec56304a48" containerName="payload-processing" containerID="cri-o://a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98" gracePeriod=30
Sep 10 16:34:52.674256 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:52.674229    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"]
Sep 10 16:34:52.674482 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:52.674459    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97" podUID="dfe453df-3553-4a84-8784-1f7b1611da01" containerName="payload-pre-processing" containerID="cri-o://fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d" gracePeriod=30
Sep 10 16:34:52.912978 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:52.912948    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz"]
Sep 10 16:34:52.917364 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:52.917337    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b73303-8jzdz"]
Sep 10 16:34:52.950853 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:52.950831    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"
Sep 10 16:34:52.957529 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:52.957502    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"
Sep 10 16:34:53.060595 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.060553    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8269eec-fc72-4cb1-bb49-61ec56304a48-plugins-config-volume\") pod \"b8269eec-fc72-4cb1-bb49-61ec56304a48\" (UID: \"b8269eec-fc72-4cb1-bb49-61ec56304a48\") "
Sep 10 16:34:53.060832 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.060624    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k62ls\" (UniqueName: \"kubernetes.io/projected/dfe453df-3553-4a84-8784-1f7b1611da01-kube-api-access-k62ls\") pod \"dfe453df-3553-4a84-8784-1f7b1611da01\" (UID: \"dfe453df-3553-4a84-8784-1f7b1611da01\") "
Sep 10 16:34:53.060832 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.060688    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe453df-3553-4a84-8784-1f7b1611da01-plugins-config-volume\") pod \"dfe453df-3553-4a84-8784-1f7b1611da01\" (UID: \"dfe453df-3553-4a84-8784-1f7b1611da01\") "
Sep 10 16:34:53.060832 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.060748    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pqlx\" (UniqueName: \"kubernetes.io/projected/b8269eec-fc72-4cb1-bb49-61ec56304a48-kube-api-access-6pqlx\") pod \"b8269eec-fc72-4cb1-bb49-61ec56304a48\" (UID: \"b8269eec-fc72-4cb1-bb49-61ec56304a48\") "
Sep 10 16:34:53.061035 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.061009    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8269eec-fc72-4cb1-bb49-61ec56304a48-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b8269eec-fc72-4cb1-bb49-61ec56304a48" (UID: "b8269eec-fc72-4cb1-bb49-61ec56304a48"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:34:53.061085 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.061051    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfe453df-3553-4a84-8784-1f7b1611da01-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dfe453df-3553-4a84-8784-1f7b1611da01" (UID: "dfe453df-3553-4a84-8784-1f7b1611da01"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:34:53.061160 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.061091    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8269eec-fc72-4cb1-bb49-61ec56304a48-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:53.062814 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.062790    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8269eec-fc72-4cb1-bb49-61ec56304a48-kube-api-access-6pqlx" (OuterVolumeSpecName: "kube-api-access-6pqlx") pod "b8269eec-fc72-4cb1-bb49-61ec56304a48" (UID: "b8269eec-fc72-4cb1-bb49-61ec56304a48"). InnerVolumeSpecName "kube-api-access-6pqlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:34:53.062885 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.062826    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe453df-3553-4a84-8784-1f7b1611da01-kube-api-access-k62ls" (OuterVolumeSpecName: "kube-api-access-k62ls") pod "dfe453df-3553-4a84-8784-1f7b1611da01" (UID: "dfe453df-3553-4a84-8784-1f7b1611da01"). InnerVolumeSpecName "kube-api-access-k62ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:34:53.162764 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.162638    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe453df-3553-4a84-8784-1f7b1611da01-plugins-config-volume\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:53.162764 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.162675    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pqlx\" (UniqueName: \"kubernetes.io/projected/b8269eec-fc72-4cb1-bb49-61ec56304a48-kube-api-access-6pqlx\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:53.162764 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.162690    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k62ls\" (UniqueName: \"kubernetes.io/projected/dfe453df-3553-4a84-8784-1f7b1611da01-kube-api-access-k62ls\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:34:53.318956 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.318918    2562 generic.go:356] "Generic (PLEG): container finished" podID="b8269eec-fc72-4cb1-bb49-61ec56304a48" containerID="a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98" exitCode=0
Sep 10 16:34:53.319153 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.318969    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"
Sep 10 16:34:53.319153 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.319007    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f" event={"ID":"b8269eec-fc72-4cb1-bb49-61ec56304a48","Type":"ContainerDied","Data":"a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98"}
Sep 10 16:34:53.319153 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.319093    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f" event={"ID":"b8269eec-fc72-4cb1-bb49-61ec56304a48","Type":"ContainerDied","Data":"1fd825407fc4c13f2f3ee60c0d3ca62d585042e169271fceee176b39e5e8bbd0"}
Sep 10 16:34:53.319153 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.319119    2562 scope.go:117] "RemoveContainer" containerID="a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98"
Sep 10 16:34:53.320478 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.320449    2562 generic.go:356] "Generic (PLEG): container finished" podID="dfe453df-3553-4a84-8784-1f7b1611da01" containerID="fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d" exitCode=0
Sep 10 16:34:53.320570 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.320498    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"
Sep 10 16:34:53.320570 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.320522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97" event={"ID":"dfe453df-3553-4a84-8784-1f7b1611da01","Type":"ContainerDied","Data":"fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d"}
Sep 10 16:34:53.320570 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.320567    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97" event={"ID":"dfe453df-3553-4a84-8784-1f7b1611da01","Type":"ContainerDied","Data":"9ec96e8757b32233c954e3339a4bdc2374892ce9ca56bbcfaee695a54210d100"}
Sep 10 16:34:53.329402 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.329387    2562 scope.go:117] "RemoveContainer" containerID="a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98"
Sep 10 16:34:53.329704 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:34:53.329679    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98\": container with ID starting with a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98 not found: ID does not exist" containerID="a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98"
Sep 10 16:34:53.329825 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.329714    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98"} err="failed to get container status \"a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98\": rpc error: code = NotFound desc = could not find container \"a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98\": container with ID starting with a4b733ab89c41184b6c586820f0dbb3e05645c15391bc47357faf228a65d7c98 not found: ID does not exist"
Sep 10 16:34:53.329825 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.329754    2562 scope.go:117] "RemoveContainer" containerID="fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d"
Sep 10 16:34:53.337958 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.337705    2562 scope.go:117] "RemoveContainer" containerID="fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d"
Sep 10 16:34:53.338058 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:34:53.337999    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d\": container with ID starting with fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d not found: ID does not exist" containerID="fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d"
Sep 10 16:34:53.338058 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.338021    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d"} err="failed to get container status \"fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d\": rpc error: code = NotFound desc = could not find container \"fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d\": container with ID starting with fdaede9192e5e1d894cea80feb1b7adf8f00e1333a0225f7bbbfe686ce25bb1d not found: ID does not exist"
Sep 10 16:34:53.345479 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.345459    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"]
Sep 10 16:34:53.349304 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.349283    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b73303-988f4dc69-9xs5f"]
Sep 10 16:34:53.361673 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.361649    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"]
Sep 10 16:34:53.365915 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:53.365892    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b73303-ddbd4cff8-9tf97"]
Sep 10 16:34:54.071116 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:54.071077    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8269eec-fc72-4cb1-bb49-61ec56304a48" path="/var/lib/kubelet/pods/b8269eec-fc72-4cb1-bb49-61ec56304a48/volumes"
Sep 10 16:34:54.071560 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:54.071542    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe453df-3553-4a84-8784-1f7b1611da01" path="/var/lib/kubelet/pods/dfe453df-3553-4a84-8784-1f7b1611da01/volumes"
Sep 10 16:34:54.071870 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:34:54.071857    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f63f16bc-7609-420a-a99a-66f97ddd18bc" path="/var/lib/kubelet/pods/f63f16bc-7609-420a-a99a-66f97ddd18bc/volumes"
Sep 10 16:36:56.515642 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:36:56.515609    2562 scope.go:117] "RemoveContainer" containerID="fbfd676ce7e90f7b9b399761a25358d539b2e1b30d3cebe790a7256c863fe344"
Sep 10 16:36:56.523978 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:36:56.523957    2562 scope.go:117] "RemoveContainer" containerID="f91cf8f6f18beb012edc076cbef4650f0a6c591d647ea4fc42955582e3ca4654"
Sep 10 16:36:56.531188 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:36:56.531167    2562 scope.go:117] "RemoveContainer" containerID="8ede9e01e63b6af9a4d48cd0c951d3fda3430da2033e988420e5b2708a1be092"
Sep 10 16:39:32.854992 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.854908    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"]
Sep 10 16:39:32.855462 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.855303    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f63f16bc-7609-420a-a99a-66f97ddd18bc" containerName="revoke-keys"
Sep 10 16:39:32.855462 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.855315    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f63f16bc-7609-420a-a99a-66f97ddd18bc" containerName="revoke-keys"
Sep 10 16:39:32.855462 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.855330    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8269eec-fc72-4cb1-bb49-61ec56304a48" containerName="payload-processing"
Sep 10 16:39:32.855462 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.855336    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8269eec-fc72-4cb1-bb49-61ec56304a48" containerName="payload-processing"
Sep 10 16:39:32.855462 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.855347    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe453df-3553-4a84-8784-1f7b1611da01" containerName="payload-pre-processing"
Sep 10 16:39:32.855462 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.855353    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe453df-3553-4a84-8784-1f7b1611da01" containerName="payload-pre-processing"
Sep 10 16:39:32.855462 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.855416    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe453df-3553-4a84-8784-1f7b1611da01" containerName="payload-pre-processing"
Sep 10 16:39:32.855462 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.855424    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8269eec-fc72-4cb1-bb49-61ec56304a48" containerName="payload-processing"
Sep 10 16:39:32.855462 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.855430    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f63f16bc-7609-420a-a99a-66f97ddd18bc" containerName="revoke-keys"
Sep 10 16:39:32.865889 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.865860    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:32.868939 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.868885    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-1d0deeff-kserve-self-signed-certs\""
Sep 10 16:39:32.877039 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.876976    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"]
Sep 10 16:39:32.999396 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.999349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-dshm\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:32.999582 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.999528    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5v9r\" (UniqueName: \"kubernetes.io/projected/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-kube-api-access-r5v9r\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:32.999582 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.999573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-model-cache\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:32.999678 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.999601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-home\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:32.999678 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.999623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-tmp-dir\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:32.999836 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:32.999765    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-tls-certs\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.100861 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.100828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5v9r\" (UniqueName: \"kubernetes.io/projected/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-kube-api-access-r5v9r\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.100861 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.100864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-model-cache\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.101114 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.100886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-home\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.101114 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.100902    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-tmp-dir\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.101114 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.100924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-tls-certs\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.101114 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.101053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-dshm\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.101350 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.101301    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-model-cache\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.101350 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.101331    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-tmp-dir\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.101430 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.101358    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-home\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.103264 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.103241    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-dshm\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.103546 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.103525    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-tls-certs\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.111071 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.111007    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5v9r\" (UniqueName: \"kubernetes.io/projected/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-kube-api-access-r5v9r\") pod \"e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") " pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.177607 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.177577    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:33.454225 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.454102    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"]
Sep 10 16:39:33.457023 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:39:33.456996    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5d1557f_9983_4ee1_b5e5_9781f99e7a19.slice/crio-66c9b3f8febe1233822aa93d9c6fbec25bbaaef0d5fe4989ad3ab9f274395327 WatchSource:0}: Error finding container 66c9b3f8febe1233822aa93d9c6fbec25bbaaef0d5fe4989ad3ab9f274395327: Status 404 returned error can't find the container with id 66c9b3f8febe1233822aa93d9c6fbec25bbaaef0d5fe4989ad3ab9f274395327
Sep 10 16:39:33.722130 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.722044    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp" event={"ID":"a5d1557f-9983-4ee1-b5e5-9781f99e7a19","Type":"ContainerStarted","Data":"9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67"}
Sep 10 16:39:33.722130 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.722094    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp" event={"ID":"a5d1557f-9983-4ee1-b5e5-9781f99e7a19","Type":"ContainerStarted","Data":"66c9b3f8febe1233822aa93d9c6fbec25bbaaef0d5fe4989ad3ab9f274395327"}
Sep 10 16:39:33.743964 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:33.743914    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp" podStartSLOduration=1.743899609 podStartE2EDuration="1.743899609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:39:33.741659848 +0000 UTC m=+2258.153746035" watchObservedRunningTime="2026-09-10 16:39:33.743899609 +0000 UTC m=+2258.155985860"
Sep 10 16:39:43.178020 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:43.177981    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:43.178464 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:43.178040    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:43.190525 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:43.190500    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:39:43.785902 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:39:43.785870    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:40:15.630028 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:15.629992    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"]
Sep 10 16:40:30.650961 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.650895    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp" podUID="a5d1557f-9983-4ee1-b5e5-9781f99e7a19" containerName="main" containerID="cri-o://9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67" gracePeriod=45
Sep 10 16:40:30.905397 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.905334    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:40:30.957366 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.957325    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-model-cache\") pod \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") "
Sep 10 16:40:30.957555 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.957380    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5v9r\" (UniqueName: \"kubernetes.io/projected/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-kube-api-access-r5v9r\") pod \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") "
Sep 10 16:40:30.957555 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.957454    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-home\") pod \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") "
Sep 10 16:40:30.957678 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.957569    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-dshm\") pod \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") "
Sep 10 16:40:30.957678 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.957620    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-tmp-dir\") pod \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") "
Sep 10 16:40:30.957845 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.957669    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5d1557f-9983-4ee1-b5e5-9781f99e7a19" (UID: "a5d1557f-9983-4ee1-b5e5-9781f99e7a19"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:40:30.957845 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.957680    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-tls-certs\") pod \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\" (UID: \"a5d1557f-9983-4ee1-b5e5-9781f99e7a19\") "
Sep 10 16:40:30.957845 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.957736    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-home" (OuterVolumeSpecName: "home") pod "a5d1557f-9983-4ee1-b5e5-9781f99e7a19" (UID: "a5d1557f-9983-4ee1-b5e5-9781f99e7a19"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:40:30.958002 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.957963    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5d1557f-9983-4ee1-b5e5-9781f99e7a19" (UID: "a5d1557f-9983-4ee1-b5e5-9781f99e7a19"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:40:30.958134 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.958115    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-model-cache\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:40:30.958196 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.958148    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-home\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:40:30.958196 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.958162    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-tmp-dir\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:40:30.959800 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.959761    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-kube-api-access-r5v9r" (OuterVolumeSpecName: "kube-api-access-r5v9r") pod "a5d1557f-9983-4ee1-b5e5-9781f99e7a19" (UID: "a5d1557f-9983-4ee1-b5e5-9781f99e7a19"). InnerVolumeSpecName "kube-api-access-r5v9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:40:30.959800 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.959776    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-dshm" (OuterVolumeSpecName: "dshm") pod "a5d1557f-9983-4ee1-b5e5-9781f99e7a19" (UID: "a5d1557f-9983-4ee1-b5e5-9781f99e7a19"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:40:30.959800 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:30.959787    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5d1557f-9983-4ee1-b5e5-9781f99e7a19" (UID: "a5d1557f-9983-4ee1-b5e5-9781f99e7a19"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 16:40:31.021646 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:31.021608    2562 generic.go:356] "Generic (PLEG): container finished" podID="a5d1557f-9983-4ee1-b5e5-9781f99e7a19" containerID="9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67" exitCode=0
Sep 10 16:40:31.021826 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:31.021667    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"
Sep 10 16:40:31.021826 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:31.021698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp" event={"ID":"a5d1557f-9983-4ee1-b5e5-9781f99e7a19","Type":"ContainerDied","Data":"9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67"}
Sep 10 16:40:31.021826 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:31.021753    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp" event={"ID":"a5d1557f-9983-4ee1-b5e5-9781f99e7a19","Type":"ContainerDied","Data":"66c9b3f8febe1233822aa93d9c6fbec25bbaaef0d5fe4989ad3ab9f274395327"}
Sep 10 16:40:31.021826 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:31.021772    2562 scope.go:117] "RemoveContainer" containerID="9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67"
Sep 10 16:40:31.030957 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:31.030937    2562 scope.go:117] "RemoveContainer" containerID="9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67"
Sep 10 16:40:31.031257 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:40:31.031236    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67\": container with ID starting with 9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67 not found: ID does not exist" containerID="9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67"
Sep 10 16:40:31.031310 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:31.031273    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67"} err="failed to get container status \"9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67\": rpc error: code = NotFound desc = could not find container \"9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67\": container with ID starting with 9a909909aa377617ed00303f630acef3598131791600b978383f881af5d0eb67 not found: ID does not exist"
Sep 10 16:40:31.057783 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:31.057747    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"]
Sep 10 16:40:31.059141 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:31.059117    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5v9r\" (UniqueName: \"kubernetes.io/projected/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-kube-api-access-r5v9r\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:40:31.059194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:31.059146    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-dshm\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:40:31.059194 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:31.059157    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d1557f-9983-4ee1-b5e5-9781f99e7a19-tls-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:40:31.064866 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:31.064838    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-1d0deeff-kserve-864d95c4bc-pxctp"]
Sep 10 16:40:32.070849 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:32.070811    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5d1557f-9983-4ee1-b5e5-9781f99e7a19" path="/var/lib/kubelet/pods/a5d1557f-9983-4ee1-b5e5-9781f99e7a19/volumes"
Sep 10 16:40:34.609264 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.609229    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b8859f477-jbj75"]
Sep 10 16:40:34.609659 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.609647    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d1557f-9983-4ee1-b5e5-9781f99e7a19" containerName="main"
Sep 10 16:40:34.609713 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.609661    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d1557f-9983-4ee1-b5e5-9781f99e7a19" containerName="main"
Sep 10 16:40:34.609795 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.609785    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5d1557f-9983-4ee1-b5e5-9781f99e7a19" containerName="main"
Sep 10 16:40:34.613008 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.612990    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.621066 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.621049    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2l6fb\""
Sep 10 16:40:34.621171 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.621079    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 16:40:34.621171 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.621103    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 16:40:34.648184 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.648149    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b8859f477-jbj75"]
Sep 10 16:40:34.695352 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.695319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxhjm\" (UniqueName: \"kubernetes.io/projected/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-kube-api-access-sxhjm\") pod \"maas-api-b8859f477-jbj75\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") " pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.695538 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.695378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-openshift-service-ca\") pod \"maas-api-b8859f477-jbj75\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") " pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.695538 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.695406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-metrics-certs\") pod \"maas-api-b8859f477-jbj75\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") " pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.695538 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.695430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-maas-api-tls\") pod \"maas-api-b8859f477-jbj75\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") " pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.796809 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.796768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-openshift-service-ca\") pod \"maas-api-b8859f477-jbj75\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") " pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.796995 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.796818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-metrics-certs\") pod \"maas-api-b8859f477-jbj75\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") " pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.796995 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.796864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-maas-api-tls\") pod \"maas-api-b8859f477-jbj75\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") " pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.796995 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.796974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxhjm\" (UniqueName: \"kubernetes.io/projected/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-kube-api-access-sxhjm\") pod \"maas-api-b8859f477-jbj75\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") " pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.797571 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.797546    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-openshift-service-ca\") pod \"maas-api-b8859f477-jbj75\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") " pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.799357 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.799335    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-metrics-certs\") pod \"maas-api-b8859f477-jbj75\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") " pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.799448 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.799401    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-maas-api-tls\") pod \"maas-api-b8859f477-jbj75\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") " pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.807570 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.807548    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxhjm\" (UniqueName: \"kubernetes.io/projected/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-kube-api-access-sxhjm\") pod \"maas-api-b8859f477-jbj75\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") " pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:34.923789 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:34.923677    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:35.208495 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:35.208465    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b8859f477-jbj75"]
Sep 10 16:40:35.211301 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:40:35.211273    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848b98d3_6f3d_4fd9_9d6f_e02d5195fa90.slice/crio-28616cef0f40031237b9931e8ab686fce6d50a07f010a284f5511d0061d716f6 WatchSource:0}: Error finding container 28616cef0f40031237b9931e8ab686fce6d50a07f010a284f5511d0061d716f6: Status 404 returned error can't find the container with id 28616cef0f40031237b9931e8ab686fce6d50a07f010a284f5511d0061d716f6
Sep 10 16:40:35.212574 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:35.212554    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 16:40:36.052740 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:36.052648    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75" event={"ID":"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90","Type":"ContainerStarted","Data":"28616cef0f40031237b9931e8ab686fce6d50a07f010a284f5511d0061d716f6"}
Sep 10 16:40:38.070995 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:38.070963    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:38.071372 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:38.071012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75" event={"ID":"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90","Type":"ContainerStarted","Data":"9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585"}
Sep 10 16:40:38.102413 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:38.102362    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75" podStartSLOduration=1.693500091 podStartE2EDuration="4.102343331s" totalImagesPullingTime="2.40884324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:40:38.100002222 +0000 UTC m=+2322.512088469" watchObservedRunningTime="2026-09-10 16:40:38.102343331 +0000 UTC m=+2322.514429539"
Sep 10 16:40:42.527571 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.527531    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-b8859f477-jbj75"]
Sep 10 16:40:42.528081 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.527805    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75" podUID="848b98d3-6f3d-4fd9-9d6f-e02d5195fa90" containerName="maas-api" containerID="cri-o://9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585" gracePeriod=30
Sep 10 16:40:42.532781 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.532758    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:42.580635 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:40:42.580602    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848b98d3_6f3d_4fd9_9d6f_e02d5195fa90.slice/crio-conmon-9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 16:40:42.625122 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.625079    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"]
Sep 10 16:40:42.628444 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.628420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.660439 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.660404    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"]
Sep 10 16:40:42.775544 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.775511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/998d57fb-7080-4dc1-965f-e6ae9f3e9649-openshift-service-ca\") pod \"maas-api-75bdcfcf57-qmm4n\" (UID: \"998d57fb-7080-4dc1-965f-e6ae9f3e9649\") " pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.775700 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.775584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/998d57fb-7080-4dc1-965f-e6ae9f3e9649-maas-api-tls\") pod \"maas-api-75bdcfcf57-qmm4n\" (UID: \"998d57fb-7080-4dc1-965f-e6ae9f3e9649\") " pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.775700 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.775610    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf9jw\" (UniqueName: \"kubernetes.io/projected/998d57fb-7080-4dc1-965f-e6ae9f3e9649-kube-api-access-gf9jw\") pod \"maas-api-75bdcfcf57-qmm4n\" (UID: \"998d57fb-7080-4dc1-965f-e6ae9f3e9649\") " pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.775831 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.775764    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998d57fb-7080-4dc1-965f-e6ae9f3e9649-metrics-certs\") pod \"maas-api-75bdcfcf57-qmm4n\" (UID: \"998d57fb-7080-4dc1-965f-e6ae9f3e9649\") " pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.780473 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.780419    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:42.876976 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.876929    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-maas-api-tls\") pod \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") "
Sep 10 16:40:42.876976 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.876981    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxhjm\" (UniqueName: \"kubernetes.io/projected/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-kube-api-access-sxhjm\") pod \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") "
Sep 10 16:40:42.877250 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.877009    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-metrics-certs\") pod \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") "
Sep 10 16:40:42.877250 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.877132    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-openshift-service-ca\") pod \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\" (UID: \"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90\") "
Sep 10 16:40:42.877421 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.877295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998d57fb-7080-4dc1-965f-e6ae9f3e9649-metrics-certs\") pod \"maas-api-75bdcfcf57-qmm4n\" (UID: \"998d57fb-7080-4dc1-965f-e6ae9f3e9649\") " pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.877421 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.877368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/998d57fb-7080-4dc1-965f-e6ae9f3e9649-openshift-service-ca\") pod \"maas-api-75bdcfcf57-qmm4n\" (UID: \"998d57fb-7080-4dc1-965f-e6ae9f3e9649\") " pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.877527 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.877442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/998d57fb-7080-4dc1-965f-e6ae9f3e9649-maas-api-tls\") pod \"maas-api-75bdcfcf57-qmm4n\" (UID: \"998d57fb-7080-4dc1-965f-e6ae9f3e9649\") " pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.877527 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.877471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf9jw\" (UniqueName: \"kubernetes.io/projected/998d57fb-7080-4dc1-965f-e6ae9f3e9649-kube-api-access-gf9jw\") pod \"maas-api-75bdcfcf57-qmm4n\" (UID: \"998d57fb-7080-4dc1-965f-e6ae9f3e9649\") " pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.877629 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.877518    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "848b98d3-6f3d-4fd9-9d6f-e02d5195fa90" (UID: "848b98d3-6f3d-4fd9-9d6f-e02d5195fa90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:40:42.877811 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.877718    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-openshift-service-ca\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:40:42.878223 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.878202    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/998d57fb-7080-4dc1-965f-e6ae9f3e9649-openshift-service-ca\") pod \"maas-api-75bdcfcf57-qmm4n\" (UID: \"998d57fb-7080-4dc1-965f-e6ae9f3e9649\") " pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.879958 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.879908    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-kube-api-access-sxhjm" (OuterVolumeSpecName: "kube-api-access-sxhjm") pod "848b98d3-6f3d-4fd9-9d6f-e02d5195fa90" (UID: "848b98d3-6f3d-4fd9-9d6f-e02d5195fa90"). InnerVolumeSpecName "kube-api-access-sxhjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:40:42.880048 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.879971    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/998d57fb-7080-4dc1-965f-e6ae9f3e9649-maas-api-tls\") pod \"maas-api-75bdcfcf57-qmm4n\" (UID: \"998d57fb-7080-4dc1-965f-e6ae9f3e9649\") " pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.880048 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.879983    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "848b98d3-6f3d-4fd9-9d6f-e02d5195fa90" (UID: "848b98d3-6f3d-4fd9-9d6f-e02d5195fa90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 16:40:42.880048 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.879993    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "848b98d3-6f3d-4fd9-9d6f-e02d5195fa90" (UID: "848b98d3-6f3d-4fd9-9d6f-e02d5195fa90"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 16:40:42.880204 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.880181    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998d57fb-7080-4dc1-965f-e6ae9f3e9649-metrics-certs\") pod \"maas-api-75bdcfcf57-qmm4n\" (UID: \"998d57fb-7080-4dc1-965f-e6ae9f3e9649\") " pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.900008 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.899982    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf9jw\" (UniqueName: \"kubernetes.io/projected/998d57fb-7080-4dc1-965f-e6ae9f3e9649-kube-api-access-gf9jw\") pod \"maas-api-75bdcfcf57-qmm4n\" (UID: \"998d57fb-7080-4dc1-965f-e6ae9f3e9649\") " pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.938320 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.938278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:42.978990 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.978909    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-maas-api-tls\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:40:42.978990 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.978948    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxhjm\" (UniqueName: \"kubernetes.io/projected/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-kube-api-access-sxhjm\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:40:42.978990 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:42.978963    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90-metrics-certs\") on node \"ip-10-0-132-43.ec2.internal\" DevicePath \"\""
Sep 10 16:40:43.094323 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:43.094231    2562 generic.go:356] "Generic (PLEG): container finished" podID="848b98d3-6f3d-4fd9-9d6f-e02d5195fa90" containerID="9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585" exitCode=0
Sep 10 16:40:43.094323 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:43.094295    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75"
Sep 10 16:40:43.094519 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:43.094322    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75" event={"ID":"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90","Type":"ContainerDied","Data":"9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585"}
Sep 10 16:40:43.094519 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:43.094379    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b8859f477-jbj75" event={"ID":"848b98d3-6f3d-4fd9-9d6f-e02d5195fa90","Type":"ContainerDied","Data":"28616cef0f40031237b9931e8ab686fce6d50a07f010a284f5511d0061d716f6"}
Sep 10 16:40:43.094519 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:43.094407    2562 scope.go:117] "RemoveContainer" containerID="9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585"
Sep 10 16:40:43.103159 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:43.103137    2562 scope.go:117] "RemoveContainer" containerID="9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585"
Sep 10 16:40:43.103455 ip-10-0-132-43 kubenswrapper[2562]: E0910 16:40:43.103433    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585\": container with ID starting with 9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585 not found: ID does not exist" containerID="9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585"
Sep 10 16:40:43.103539 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:43.103466    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585"} err="failed to get container status \"9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585\": rpc error: code = NotFound desc = could not find container \"9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585\": container with ID starting with 9906394f544a06ceddd0f94e04cfce561cd114b695f3df7128cecdf04c9c3585 not found: ID does not exist"
Sep 10 16:40:43.125382 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:43.125349    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-b8859f477-jbj75"]
Sep 10 16:40:43.130271 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:43.130243    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-b8859f477-jbj75"]
Sep 10 16:40:43.229019 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:43.228988    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"]
Sep 10 16:40:43.229851 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:40:43.229829    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998d57fb_7080_4dc1_965f_e6ae9f3e9649.slice/crio-86c596bc07b5dd8671fa64456d3e6ee9db6b8b444817158c260010fc71079610 WatchSource:0}: Error finding container 86c596bc07b5dd8671fa64456d3e6ee9db6b8b444817158c260010fc71079610: Status 404 returned error can't find the container with id 86c596bc07b5dd8671fa64456d3e6ee9db6b8b444817158c260010fc71079610
Sep 10 16:40:44.071163 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:44.071133    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="848b98d3-6f3d-4fd9-9d6f-e02d5195fa90" path="/var/lib/kubelet/pods/848b98d3-6f3d-4fd9-9d6f-e02d5195fa90/volumes"
Sep 10 16:40:44.102173 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:44.102140    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n" event={"ID":"998d57fb-7080-4dc1-965f-e6ae9f3e9649","Type":"ContainerStarted","Data":"4e7e988dfb4144da06ea7276e14e0f87ddc3ecf24b56b0615ccc32fba5a6bcef"}
Sep 10 16:40:44.102317 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:44.102196    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n" event={"ID":"998d57fb-7080-4dc1-965f-e6ae9f3e9649","Type":"ContainerStarted","Data":"86c596bc07b5dd8671fa64456d3e6ee9db6b8b444817158c260010fc71079610"}
Sep 10 16:40:44.102317 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:44.102225    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:44.144199 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:44.144145    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n" podStartSLOduration=1.70031552 podStartE2EDuration="2.144127874s" totalImagesPullingTime="443.812354ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:40:44.14214568 +0000 UTC m=+2328.554231889" watchObservedRunningTime="2026-09-10 16:40:44.144127874 +0000 UTC m=+2328.556214082"
Sep 10 16:40:50.113984 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:50.113894    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-75bdcfcf57-qmm4n"
Sep 10 16:40:56.579561 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:56.579525    2562 scope.go:117] "RemoveContainer" containerID="14ad5e0689598406864d1099516c5c739adf9291eeea2f2174acb739d524f802"
Sep 10 16:40:56.588314 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:40:56.588290    2562 scope.go:117] "RemoveContainer" containerID="c5331b2457da1ef912023a37fe81a1572a6cf8231b437eaabd5c45c445a60a4d"
Sep 10 16:41:14.785186 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:14.785156    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jmsm6_ecaebd23-c06e-4713-a5d6-8539f4838e3a/manager/0.log"
Sep 10 16:41:15.045546 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:15.045473    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tbpc2_d320a264-aaef-4cae-916d-25898659ac4e/server/0.log"
Sep 10 16:41:15.418318 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:15.418241    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67779d4d4c-6wrbw_0e459f82-7a27-401e-bb40-929b46a7c16f/copy-manifests/0.log"
Sep 10 16:41:15.429688 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:15.429662    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67779d4d4c-6wrbw_0e459f82-7a27-401e-bb40-929b46a7c16f/manager/0.log"
Sep 10 16:41:16.060104 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:16.060072    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-75bdcfcf57-qmm4n_998d57fb-7080-4dc1-965f-e6ae9f3e9649/maas-api/0.log"
Sep 10 16:41:16.178307 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:16.178275    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817630-9lmx9_f4d1a628-1158-4ebb-95f1-9e70ef202955/cleanup/0.log"
Sep 10 16:41:16.307297 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:16.307268    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-ctf45_3198681d-c5b8-4a6f-b154-4128d7bf2c97/postgres/0.log"
Sep 10 16:41:17.320294 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:17.320261    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hnx5s_5cf686b9-aa42-4710-8529-eac2dd96f232/manager/0.log"
Sep 10 16:41:17.450306 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:17.450271    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-t5xjp_0e62c407-7a27-4c24-821b-13dd1cc056f5/manager/0.log"
Sep 10 16:41:18.332848 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:18.332815    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn_65ae43dd-0459-4d4c-b4b6-a5ee5d223063/istio-proxy/0.log"
Sep 10 16:41:18.780288 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:18.780248    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-mgrr2_3b7a2202-f718-48b7-b442-9aaafae35418/istio-proxy/1.log"
Sep 10 16:41:18.894011 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:18.893980    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-qc9mc_d636c127-261a-43cd-8a07-1ba705891fd4/payload-pre-processing/0.log"
Sep 10 16:41:19.528313 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:19.528286    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xx59g_df5fb673-2832-44e9-90ce-9e4470129325/main/0.log"
Sep 10 16:41:19.888879 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:19.888793    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-gnf5b_fb434d6b-fb5a-4913-8733-e9647fca7dcd/main/0.log"
Sep 10 16:41:29.034250 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:29.034211    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5jnrv_7921cd1d-ec59-489d-944d-57030a1fd6ed/global-pull-secret-syncer/0.log"
Sep 10 16:41:29.334101 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:29.334025    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dwt9d_fd09ccc9-f489-4f26-9bb0-823dc02b483a/konnectivity-agent/0.log"
Sep 10 16:41:29.426052 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:29.426018    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-43.ec2.internal_1c0a1ff402e4c440e263b451c0fbfb11/haproxy/0.log"
Sep 10 16:41:34.680741 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:34.680649    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hnx5s_5cf686b9-aa42-4710-8529-eac2dd96f232/manager/0.log"
Sep 10 16:41:34.715966 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:34.715938    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-t5xjp_0e62c407-7a27-4c24-821b-13dd1cc056f5/manager/0.log"
Sep 10 16:41:36.853293 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:36.853208    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-cvxzw_b1d066a1-6a5a-4f93-8720-9ba4bce5a675/kube-state-metrics/0.log"
Sep 10 16:41:36.887234 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:36.887208    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-cvxzw_b1d066a1-6a5a-4f93-8720-9ba4bce5a675/kube-rbac-proxy-main/0.log"
Sep 10 16:41:36.932334 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:36.932308    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-cvxzw_b1d066a1-6a5a-4f93-8720-9ba4bce5a675/kube-rbac-proxy-self/0.log"
Sep 10 16:41:37.067315 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.067280    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6zjts_af8b7029-1676-4170-ae1e-ed61dbc568a6/node-exporter/0.log"
Sep 10 16:41:37.095929 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.095900    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6zjts_af8b7029-1676-4170-ae1e-ed61dbc568a6/kube-rbac-proxy/0.log"
Sep 10 16:41:37.144704 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.144632    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6zjts_af8b7029-1676-4170-ae1e-ed61dbc568a6/init-textfile/0.log"
Sep 10 16:41:37.452213 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.452134    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-c7qbk_de597ceb-a080-4263-9619-96d058a4d28a/kube-rbac-proxy-main/0.log"
Sep 10 16:41:37.498744 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.498710    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-c7qbk_de597ceb-a080-4263-9619-96d058a4d28a/kube-rbac-proxy-self/0.log"
Sep 10 16:41:37.532088 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.532059    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-c7qbk_de597ceb-a080-4263-9619-96d058a4d28a/openshift-state-metrics/0.log"
Sep 10 16:41:37.590200 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.590168    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f4f5f431-c2bb-4c99-a329-367cbdd0583d/prometheus/0.log"
Sep 10 16:41:37.632509 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.632478    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f4f5f431-c2bb-4c99-a329-367cbdd0583d/config-reloader/0.log"
Sep 10 16:41:37.662250 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.662219    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f4f5f431-c2bb-4c99-a329-367cbdd0583d/thanos-sidecar/0.log"
Sep 10 16:41:37.692434 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.692406    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f4f5f431-c2bb-4c99-a329-367cbdd0583d/kube-rbac-proxy-web/0.log"
Sep 10 16:41:37.730926 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.730841    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f4f5f431-c2bb-4c99-a329-367cbdd0583d/kube-rbac-proxy/0.log"
Sep 10 16:41:37.766173 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.766139    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f4f5f431-c2bb-4c99-a329-367cbdd0583d/kube-rbac-proxy-thanos/0.log"
Sep 10 16:41:37.799576 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.799547    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f4f5f431-c2bb-4c99-a329-367cbdd0583d/init-config-reloader/0.log"
Sep 10 16:41:37.923175 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.923145    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-jxp6j_60be0a0f-58f5-4243-b06c-64a0b26d40b1/prometheus-operator-admission-webhook/0.log"
Sep 10 16:41:37.962200 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.962166    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ff96d8c57-8kzq7_61179110-f966-4765-ac14-505a99718fdc/telemeter-client/0.log"
Sep 10 16:41:37.988244 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:37.988219    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ff96d8c57-8kzq7_61179110-f966-4765-ac14-505a99718fdc/reload/0.log"
Sep 10 16:41:38.030850 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.030818    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ff96d8c57-8kzq7_61179110-f966-4765-ac14-505a99718fdc/kube-rbac-proxy/0.log"
Sep 10 16:41:38.075859 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.075829    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96dfdd9-mh559_664b53ac-193f-45e1-9d2d-91e840fd6f3d/thanos-query/0.log"
Sep 10 16:41:38.109714 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.109680    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96dfdd9-mh559_664b53ac-193f-45e1-9d2d-91e840fd6f3d/kube-rbac-proxy-web/0.log"
Sep 10 16:41:38.137851 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.137822    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96dfdd9-mh559_664b53ac-193f-45e1-9d2d-91e840fd6f3d/kube-rbac-proxy/0.log"
Sep 10 16:41:38.169738 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.169691    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96dfdd9-mh559_664b53ac-193f-45e1-9d2d-91e840fd6f3d/prom-label-proxy/0.log"
Sep 10 16:41:38.202040 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.202011    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96dfdd9-mh559_664b53ac-193f-45e1-9d2d-91e840fd6f3d/kube-rbac-proxy-rules/0.log"
Sep 10 16:41:38.230685 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.230656    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96dfdd9-mh559_664b53ac-193f-45e1-9d2d-91e840fd6f3d/kube-rbac-proxy-metrics/0.log"
Sep 10 16:41:38.746355 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.746316    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"]
Sep 10 16:41:38.746765 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.746752    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="848b98d3-6f3d-4fd9-9d6f-e02d5195fa90" containerName="maas-api"
Sep 10 16:41:38.746819 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.746767    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="848b98d3-6f3d-4fd9-9d6f-e02d5195fa90" containerName="maas-api"
Sep 10 16:41:38.746857 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.746837    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="848b98d3-6f3d-4fd9-9d6f-e02d5195fa90" containerName="maas-api"
Sep 10 16:41:38.750043 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.750025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.754992 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.754968    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dg8f5\"/\"kube-root-ca.crt\""
Sep 10 16:41:38.755820 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.755790    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dg8f5\"/\"default-dockercfg-rxdwj\""
Sep 10 16:41:38.755820 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.755812    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dg8f5\"/\"openshift-service-ca.crt\""
Sep 10 16:41:38.769258 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.769228    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"]
Sep 10 16:41:38.828418 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.828376    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn7nn\" (UniqueName: \"kubernetes.io/projected/67880ff2-65d6-47ea-b7b1-661dce49d83d-kube-api-access-vn7nn\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.828626 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.828441    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67880ff2-65d6-47ea-b7b1-661dce49d83d-lib-modules\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.828626 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.828574    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67880ff2-65d6-47ea-b7b1-661dce49d83d-proc\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.828626 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.828613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67880ff2-65d6-47ea-b7b1-661dce49d83d-sys\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.828785 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.828645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67880ff2-65d6-47ea-b7b1-661dce49d83d-podres\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.930023 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.929987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67880ff2-65d6-47ea-b7b1-661dce49d83d-lib-modules\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.930472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.930057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67880ff2-65d6-47ea-b7b1-661dce49d83d-proc\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.930472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.930083    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67880ff2-65d6-47ea-b7b1-661dce49d83d-sys\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.930472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.930112    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67880ff2-65d6-47ea-b7b1-661dce49d83d-podres\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.930472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.930154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn7nn\" (UniqueName: \"kubernetes.io/projected/67880ff2-65d6-47ea-b7b1-661dce49d83d-kube-api-access-vn7nn\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.930472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.930188    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67880ff2-65d6-47ea-b7b1-661dce49d83d-lib-modules\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.930472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.930207    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67880ff2-65d6-47ea-b7b1-661dce49d83d-proc\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.930472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.930211    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67880ff2-65d6-47ea-b7b1-661dce49d83d-sys\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.930472 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.930259    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67880ff2-65d6-47ea-b7b1-661dce49d83d-podres\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:38.941273 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:38.941244    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn7nn\" (UniqueName: \"kubernetes.io/projected/67880ff2-65d6-47ea-b7b1-661dce49d83d-kube-api-access-vn7nn\") pod \"perf-node-gather-daemonset-6qgp2\" (UID: \"67880ff2-65d6-47ea-b7b1-661dce49d83d\") " pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:39.060055 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:39.059959    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:39.348704 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:39.348616    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"]
Sep 10 16:41:39.355674 ip-10-0-132-43 kubenswrapper[2562]: W0910 16:41:39.355642    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod67880ff2_65d6_47ea_b7b1_661dce49d83d.slice/crio-557fb9812828de203d0097ea73b2808e28f454194a43a925d34c488e57e5749c WatchSource:0}: Error finding container 557fb9812828de203d0097ea73b2808e28f454194a43a925d34c488e57e5749c: Status 404 returned error can't find the container with id 557fb9812828de203d0097ea73b2808e28f454194a43a925d34c488e57e5749c
Sep 10 16:41:39.392609 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:39.392577    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2" event={"ID":"67880ff2-65d6-47ea-b7b1-661dce49d83d","Type":"ContainerStarted","Data":"557fb9812828de203d0097ea73b2808e28f454194a43a925d34c488e57e5749c"}
Sep 10 16:41:40.399598 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:40.399558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2" event={"ID":"67880ff2-65d6-47ea-b7b1-661dce49d83d","Type":"ContainerStarted","Data":"41246849dfa6207fb4d5a1ac17856edb0c01e0df8a26542419c3aa3fbb22e4f1"}
Sep 10 16:41:40.400060 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:40.399648    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:40.420213 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:40.420159    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2" podStartSLOduration=2.420143999 podStartE2EDuration="2.420143999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:41:40.418265299 +0000 UTC m=+2384.830351508" watchObservedRunningTime="2026-09-10 16:41:40.420143999 +0000 UTC m=+2384.832230543"
Sep 10 16:41:40.912160 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:40.912127    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58c444bd8-jwfrf_ac5a647c-40da-4b91-a524-6050e26bf720/console/0.log"
Sep 10 16:41:43.028164 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:43.028133    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xz4lx_c6b1fd77-45a8-45ad-90fb-dba87007d949/dns/0.log"
Sep 10 16:41:43.053249 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:43.053221    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xz4lx_c6b1fd77-45a8-45ad-90fb-dba87007d949/kube-rbac-proxy/0.log"
Sep 10 16:41:43.147340 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:43.147310    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6st4n_cdd45b18-7dc2-4135-b89b-2679984e2b5a/dns-node-resolver/0.log"
Sep 10 16:41:43.852962 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:43.852922    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7fd74bd6-pn6k5_bda009fa-5989-4796-9a6d-0e93e8e40d5e/registry/0.log"
Sep 10 16:41:43.879142 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:43.879114    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-695sv_e9286b05-9412-43dc-89c0-9ef8b198a429/node-ca/0.log"
Sep 10 16:41:45.093782 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:45.093752    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn_65ae43dd-0459-4d4c-b4b6-a5ee5d223063/istio-proxy/0.log"
Sep 10 16:41:45.450912 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:45.450825    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-mgrr2_3b7a2202-f718-48b7-b442-9aaafae35418/istio-proxy/0.log"
Sep 10 16:41:45.458471 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:45.458444    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-mgrr2_3b7a2202-f718-48b7-b442-9aaafae35418/istio-proxy/1.log"
Sep 10 16:41:45.504298 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:45.504266    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-qc9mc_d636c127-261a-43cd-8a07-1ba705891fd4/payload-pre-processing/0.log"
Sep 10 16:41:46.414622 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:46.414593    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dg8f5/perf-node-gather-daemonset-6qgp2"
Sep 10 16:41:46.648716 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:46.648687    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xkqtd_f2d1b3be-a896-444d-8516-147b5e1fb599/serve-healthcheck-canary/0.log"
Sep 10 16:41:47.547684 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:47.547651    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r5vhs_6de2389b-8710-4c59-94d2-0354fe905d75/kube-rbac-proxy/0.log"
Sep 10 16:41:47.585053 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:47.585021    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r5vhs_6de2389b-8710-4c59-94d2-0354fe905d75/exporter/0.log"
Sep 10 16:41:47.635295 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:47.635265    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r5vhs_6de2389b-8710-4c59-94d2-0354fe905d75/extractor/0.log"
Sep 10 16:41:49.393617 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:49.393538    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn_65ae43dd-0459-4d4c-b4b6-a5ee5d223063/istio-proxy/0.log"
Sep 10 16:41:49.677776 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:49.677661    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-mgrr2_3b7a2202-f718-48b7-b442-9aaafae35418/istio-proxy/0.log"
Sep 10 16:41:49.682755 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:49.682712    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-mgrr2_3b7a2202-f718-48b7-b442-9aaafae35418/istio-proxy/1.log"
Sep 10 16:41:49.713363 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:49.713331    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-qc9mc_d636c127-261a-43cd-8a07-1ba705891fd4/payload-pre-processing/0.log"
Sep 10 16:41:50.653282 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:50.653251    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jmsm6_ecaebd23-c06e-4713-a5d6-8539f4838e3a/manager/0.log"
Sep 10 16:41:50.769207 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:50.769170    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tbpc2_d320a264-aaef-4cae-916d-25898659ac4e/server/0.log"
Sep 10 16:41:50.986481 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:50.986401    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67779d4d4c-6wrbw_0e459f82-7a27-401e-bb40-929b46a7c16f/manager/0.log"
Sep 10 16:41:51.020105 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:51.020072    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67779d4d4c-6wrbw_0e459f82-7a27-401e-bb40-929b46a7c16f/copy-manifests/0.log"
Sep 10 16:41:51.383720 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:51.383689    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6cbcdcfccc8vfgn_65ae43dd-0459-4d4c-b4b6-a5ee5d223063/istio-proxy/0.log"
Sep 10 16:41:51.728448 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:51.728373    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-mgrr2_3b7a2202-f718-48b7-b442-9aaafae35418/istio-proxy/0.log"
Sep 10 16:41:51.735931 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:51.735908    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-mgrr2_3b7a2202-f718-48b7-b442-9aaafae35418/istio-proxy/1.log"
Sep 10 16:41:51.772476 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:51.772448    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-qc9mc_d636c127-261a-43cd-8a07-1ba705891fd4/payload-pre-processing/0.log"
Sep 10 16:41:52.584922 ip-10-0-132-43 kubenswrapper[2562]: I0910 16:41:52.584890    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84479dc8dd-s27xz_bd730c90-54c5-452f-b33d-0b0d6a9d782f/manager/0.log"