Sep 16 00:34:09.097035 ip-10-0-136-16 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 00:34:09.427457 ip-10-0-136-16 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 00:34:09.427457 ip-10-0-136-16 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 00:34:09.427457 ip-10-0-136-16 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 00:34:09.427457 ip-10-0-136-16 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 00:34:09.427457 ip-10-0-136-16 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 00:34:09.428315 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.428223    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 00:34:09.431793 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431778    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 00:34:09.431793 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431794    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431798    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431801    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431804    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431807    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431810    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431813    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431816    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431819    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431821    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431824    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431827    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431830    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431832    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431835    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431838    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431840    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431842    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431845    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 00:34:09.431858 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431849    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431853    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431856    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431858    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431862    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431865    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431868    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431871    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431873    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431882    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431885    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431887    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431891    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431895    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431897    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431900    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431903    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431905    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431908    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 00:34:09.432304 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431910    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431913    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431915    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431918    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431920    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431923    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431925    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431928    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431930    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431933    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431935    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431937    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431940    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431943    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431945    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431948    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431951    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431954    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431956    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431959    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 00:34:09.432788 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431961    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431964    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431966    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431969    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431972    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431974    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431976    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431984    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431987    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431990    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431992    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431995    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.431997    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432000    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432002    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432005    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432009    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432011    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432014    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432017    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 00:34:09.433279 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432021    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432024    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432026    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432029    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432032    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432034    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432039    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432044    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432047    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432050    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432053    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432056    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432059    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432061    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432064    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432067    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432069    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432072    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432074    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432077    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 00:34:09.433774 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432792    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432799    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432802    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432805    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432808    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432811    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432814    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432816    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432819    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432822    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432824    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432827    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432829    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432833    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432836    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432839    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432843    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432846    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432849    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 00:34:09.434253 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432852    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432855    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432857    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432860    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432862    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432865    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432868    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432870    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432873    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432875    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432878    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432880    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432883    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432886    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432888    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432891    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432893    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432896    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432899    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432901    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 00:34:09.434770 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432904    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432906    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432908    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432911    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432914    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432917    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432920    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432923    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432925    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432928    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432930    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432933    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432940    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432943    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432947    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432950    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432954    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432957    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432960    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 00:34:09.435263 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432962    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432965    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432968    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432971    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432974    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432977    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432979    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432982    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432985    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432987    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432990    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432992    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432994    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.432997    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433000    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433002    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433005    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433008    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433010    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 00:34:09.435740 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433012    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433015    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433018    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433021    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433023    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433028    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433032    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433035    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433038    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433041    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433043    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433046    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433049    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433051    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433054    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433056    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433059    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433061    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433064    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433066    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 00:34:09.436201 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433069    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433071    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433455    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433461    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433464    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433466    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433469    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433471    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433474    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433477    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433479    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433482    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433484    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433487    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433491    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433493    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433496    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433498    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433503    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433505    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 00:34:09.436703 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433508    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433510    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433513    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433516    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433518    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433521    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433523    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433525    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433528    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433530    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433533    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433535    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433538    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433542    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433546    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433549    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433551    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433554    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433556    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 00:34:09.437215 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433559    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433561    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433564    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433566    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433569    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433571    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433574    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433576    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433579    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433581    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433584    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433588    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433591    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433593    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433595    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433598    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433601    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433603    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433606    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433609    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 00:34:09.437696 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433611    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433613    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433616    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433618    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433621    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433623    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433626    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433628    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433631    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433633    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433636    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433638    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433641    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433643    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433645    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433650    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433653    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433656    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433659    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 00:34:09.438175 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433678    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433681    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433684    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433686    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433690    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433693    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433696    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433699    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433701    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433704    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433707    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433709    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433711    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433714    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433717    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433720    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433724    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433726    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433729    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 00:34:09.438674 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433732    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433734    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433737    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.433740    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433811    2563 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433860    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433868    2563 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433873    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433882    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433886    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433890    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433894    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433898    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433901    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433920    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433924    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433930    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433936    2563 flags.go:64] FLAG: --cgroup-root=""
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433938    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433942    2563 flags.go:64] FLAG: --client-ca-file=""
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433944    2563 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433947    2563 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433951    2563 flags.go:64] FLAG: --cluster-domain=""
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433954    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 00:34:09.439134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433957    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433960    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433963    2563 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433967    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433970    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433972    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433976    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433978    2563 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433981    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433984    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433987    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433990    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433994    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.433997    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434000    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434003    2563 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434005    2563 flags.go:64] FLAG: --enable-server="true"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434008    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434012    2563 flags.go:64] FLAG: --event-burst="100"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434015    2563 flags.go:64] FLAG: --event-qps="50"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434018    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434021    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434024    2563 flags.go:64] FLAG: --eviction-hard=""
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434028    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 00:34:09.439797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434032    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434037    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434040    2563 flags.go:64] FLAG: --eviction-soft=""
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434043    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434045    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434048    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434051    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434054    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434057    2563 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434060    2563 flags.go:64] FLAG: --feature-gates=""
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434063    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434066    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434069    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434072    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434074    2563 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434077    2563 flags.go:64] FLAG: --help="false"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434080    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434084    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434087    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434090    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434093    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434096    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434099    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 00:34:09.440474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434101    2563 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434104    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434107    2563 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434110    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434113    2563 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434115    2563 flags.go:64] FLAG: --kube-reserved=""
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434118    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434121    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434124    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434127    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434131    2563 flags.go:64] FLAG: --lock-file=""
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434135    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434138    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434141    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434146    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434149    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434152    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434154    2563 flags.go:64] FLAG: --logging-format="text"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434158    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434161    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434164    2563 flags.go:64] FLAG: --manifest-url=""
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434166    2563 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434171    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434173    2563 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434177    2563 flags.go:64] FLAG: --max-pods="110"
Sep 16 00:34:09.441110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434180    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434183    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434186    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434189    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434192    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434194    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434197    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434205    2563 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434207    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434210    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434213    2563 flags.go:64] FLAG: --pod-cidr=""
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434216    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434221    2563 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434224    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434227    2563 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434230    2563 flags.go:64] FLAG: --port="10250"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434234    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434237    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bab952fce6ca16cf"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434241    2563 flags.go:64] FLAG: --qos-reserved=""
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434245    2563 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434247    2563 flags.go:64] FLAG: --register-node="true"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434250    2563 flags.go:64] FLAG: --register-with-taints=""
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434254    2563 flags.go:64] FLAG: --registry-burst="10"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434257    2563 flags.go:64] FLAG: --registry-qps="5"
Sep 16 00:34:09.441778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434260    2563 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434262    2563 flags.go:64] FLAG: --reserved-memory=""
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434266    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434269    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434272    2563 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434275    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434277    2563 flags.go:64] FLAG: --runonce="false"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434280    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434283    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434286    2563 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434289    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434291    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434294    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434298    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434300    2563 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434303    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434306    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434309    2563 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434311    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434314    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434317    2563 flags.go:64] FLAG: --system-cgroups=""
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434319    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434325    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434327    2563 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434331    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 00:34:09.442366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434335    2563 flags.go:64] FLAG: --tls-min-version=""
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434338    2563 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434341    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434344    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434347    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434350    2563 flags.go:64] FLAG: --v="2"
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434354    2563 flags.go:64] FLAG: --version="false"
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434357    2563 flags.go:64] FLAG: --vmodule=""
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434361    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.434363    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434482    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434488    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434505    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434509    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434514    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434517    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434519    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434522    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434525    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434529    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434533    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 00:34:09.442983 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434536    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434538    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434541    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434543    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434545    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434548    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434551    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434553    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434556    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434559    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434562    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434565    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434567    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434570    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434573    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434576    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434579    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434582    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434584    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434587    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 00:34:09.443527 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434589    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434592    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434595    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434597    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434599    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434602    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434604    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434607    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434609    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434612    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434615    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434619    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434622    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434624    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434627    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434629    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434632    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434634    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434637    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434639    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 00:34:09.444035 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434642    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434644    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434648    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434651    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434653    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434656    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434658    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434661    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434678    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434680    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434684    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434687    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434690    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434693    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434696    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434698    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434701    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434703    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434706    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 00:34:09.444524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434708    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434711    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434713    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434715    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434718    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434721    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434723    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434726    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434729    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434731    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434734    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434736    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434738    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434741    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434743    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434747    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434750    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434752    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434755    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434758    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 00:34:09.445028 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434760    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434763    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434765    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434768    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434770    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434773    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434776    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434778    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.434781    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.435486    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.442718    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.442731    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.443492    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.443500    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 00:34:09.445524 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443557    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443567    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443573    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443578    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443581    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443584    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443587    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443590    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443593    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443595    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443598    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443600    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443604    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443607    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443609    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443612    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443615    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443617    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443620    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443622    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 00:34:09.445898 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443625    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443628    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443630    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443632    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443635    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443639    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443643    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443647    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443651    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443657    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443660    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443675    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443678    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443681    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443683    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443686    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443688    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443691    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443693    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443696    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 00:34:09.446386 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443698    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443701    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443703    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443705    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443708    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443711    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443713    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443717    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443721    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443725    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443730    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443734    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443737    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443739    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443742    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443744    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443746    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443749    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443752    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443754    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 00:34:09.446917 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443757    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443760    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443764    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443766    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443769    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443771    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443775    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443778    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443781    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443783    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443786    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443789    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443791    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443793    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443796    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443800    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443804    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443808    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443813    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 00:34:09.447397 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443816    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443818    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443821    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443823    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443826    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443828    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443831    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443833    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443835    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443838    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443841    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443843    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443846    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443848    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443851    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443853    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443856    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443859    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443861    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 00:34:09.447899 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.443864    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.443868    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444015    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444020    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444024    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444027    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444030    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444032    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444037    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444042    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444046    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444051    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444055    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444057    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444060    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 00:34:09.448359 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444063    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444065    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444068    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444071    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444073    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444076    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444079    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444081    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444084    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444086    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444089    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444091    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444094    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444096    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444098    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444102    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444105    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444107    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444111    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 00:34:09.448753 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444115    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444119    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444126    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444132    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444137    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444140    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444143    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444146    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444148    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444151    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444154    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444157    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444159    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444161    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444164    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444167    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444169    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444172    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444174    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 00:34:09.449206 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444177    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444179    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444182    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444184    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444187    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444189    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444192    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444194    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444198    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444202    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444207    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444211    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444215    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444217    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444220    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444222    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444225    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444227    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444230    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444232    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 00:34:09.449661 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444234    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444239    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444242    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444245    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444247    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444249    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444252    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444255    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444257    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444260    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444262    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444265    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444267    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444269    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444272    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444274    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444278    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444282    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444286    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444290    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 00:34:09.450453 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444294    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444297    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444299    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444302    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444305    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444307    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444310    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:09.444312    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.444317    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.444426    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.446586    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.447414    2563 server.go:1019] "Starting client certificate rotation"
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.447517    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 00:34:09.451158 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.448060    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 00:34:09.451492 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.449457    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 00:34:09.454341 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.454318    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 00:34:09.463071 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.463052    2563 log.go:25] "Validated CRI v1 runtime API"
Sep 16 00:34:09.465619 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.465604    2563 log.go:25] "Validated CRI v1 image API"
Sep 16 00:34:09.466407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.466393    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 00:34:09.469580 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.469559    2563 fs.go:135] Filesystem UUIDs: map[1f4716e7-8960-4fda-8302-8fc16f535a4b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e4dc6a73-0bcd-4b4c-97c4-44f443c6a71e:/dev/nvme0n1p4]
Sep 16 00:34:09.469642 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.469579    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 00:34:09.473786 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.473657    2563 manager.go:216] Machine: {Timestamp:2026-09-16 00:34:09.473195984 +0000 UTC m=+0.276019039 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097570 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27c1bd6cd7c019ddf31d203212ccc6 SystemUUID:ec27c1bd-6cd7-c019-ddf3-1d203212ccc6 BootID:919eebd3-294d-4d50-a477-934e67987d4e Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d1:d3:7c:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d1:d3:7c:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:7e:75:e5:dd:7d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 00:34:09.473786 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.473782    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 00:34:09.473900 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.473860    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 00:34:09.476827 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.476803    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 00:34:09.476978 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.476829    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-16.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 00:34:09.477582 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.477571    2563 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 00:34:09.477612 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.477583    2563 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 00:34:09.477612 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.477591    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 00:34:09.478265 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.478254    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 00:34:09.479125 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.479114    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 00:34:09.482987 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.482973    2563 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 00:34:09.483102 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.483092    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 00:34:09.483145 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.483130    2563 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 00:34:09.483189 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.483146    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 00:34:09.483189 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.483165    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 00:34:09.483189 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.483174    2563 kubelet.go:398] "Adding apiserver pod source"
Sep 16 00:34:09.483189 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.483184    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 00:34:09.483574 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.483563    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 00:34:09.483612 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.483581    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 00:34:09.484216 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.484196    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 00:34:09.485733 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.485714    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 00:34:09.488878 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.488859    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 00:34:09.488955 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.488904    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 00:34:09.490465 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.490451    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 00:34:09.490509 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.490470    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 00:34:09.490509 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.490476    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 00:34:09.490509 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.490482    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 00:34:09.490509 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.490490    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 00:34:09.490509 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.490496    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 00:34:09.490509 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.490511    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 00:34:09.490682 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.490517    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 00:34:09.490682 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.490524    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 00:34:09.490682 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.490529    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 00:34:09.490682 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.490539    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 00:34:09.490682 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.490544    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 00:34:09.491094 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.491082    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 00:34:09.491162 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.491097    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 00:34:09.493275 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.493259    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-16.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 00:34:09.493779 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.493759    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-16.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 00:34:09.493825 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.493765    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 00:34:09.494879 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.494867    2563 server.go:1268] "Started kubelet"
Sep 16 00:34:09.494997 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.494939    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 00:34:09.495133 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.494955    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 00:34:09.495187 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.495164    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 00:34:09.495657 ip-10-0-136-16 systemd[1]: Started Kubernetes Kubelet.
Sep 16 00:34:09.495973 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.495959    2563 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 00:34:09.497131 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.497110    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 00:34:09.499010 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.498990    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 00:34:09.500688 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.500658    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 00:34:09.501087 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.501066    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 00:34:09.501277 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.501259    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-16.ec2.internal\" not found"
Sep 16 00:34:09.501758 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.501736    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 00:34:09.501758 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.501737    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 00:34:09.501910 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.501770    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 00:34:09.501910 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.501862    2563 factory.go:55] Registering systemd factory
Sep 16 00:34:09.501910 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.501878    2563 factory.go:223] Registration of the systemd container factory successfully
Sep 16 00:34:09.502054 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.501965    2563 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 00:34:09.502054 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.502037    2563 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 00:34:09.502119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.502102    2563 factory.go:153] Registering CRI-O factory
Sep 16 00:34:09.502119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.502118    2563 factory.go:223] Registration of the crio container factory successfully
Sep 16 00:34:09.502205 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.502165    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 00:34:09.502205 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.502180    2563 factory.go:103] Registering Raw factory
Sep 16 00:34:09.502205 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.502194    2563 manager.go:1196] Started watching for new ooms in manager
Sep 16 00:34:09.502777 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.502559    2563 manager.go:349] Starting recovery of all containers
Sep 16 00:34:09.510266 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.510230    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-16.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 00:34:09.510375 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.510341    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 00:34:09.513568 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.512996    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rk92p"
Sep 16 00:34:09.515288 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.515267    2563 manager.go:354] Recovery completed
Sep 16 00:34:09.517228 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.510211    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-16.ec2.internal.18d5a5e98f0161e8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-16.ec2.internal,UID:ip-10-0-136-16.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-16.ec2.internal,},FirstTimestamp:2026-09-16 00:34:09.494835688 +0000 UTC m=+0.297658742,LastTimestamp:2026-09-16 00:34:09.494835688 +0000 UTC m=+0.297658742,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-16.ec2.internal,}"
Sep 16 00:34:09.517424 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.517404    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rk92p"
Sep 16 00:34:09.522509 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.522492    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 00:34:09.526564 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.526546    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 00:34:09.526645 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.526577    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 00:34:09.526645 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.526586    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientPID"
Sep 16 00:34:09.527121 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.527110    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 00:34:09.527121 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.527121    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 00:34:09.527203 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.527139    2563 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 00:34:09.527203 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.527164    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 00:34:09.528312 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.528235    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-16.ec2.internal.18d5a5e990e580ab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-16.ec2.internal,UID:ip-10-0-136-16.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-16.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-16.ec2.internal,},FirstTimestamp:2026-09-16 00:34:09.526562987 +0000 UTC m=+0.329386041,LastTimestamp:2026-09-16 00:34:09.526562987 +0000 UTC m=+0.329386041,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-16.ec2.internal,}"
Sep 16 00:34:09.528585 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.528571    2563 policy_none.go:49] "None policy: Start"
Sep 16 00:34:09.528620 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.528593    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 00:34:09.528620 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.528605    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 00:34:09.528993 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.528973    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 00:34:09.529077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.529012    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 00:34:09.529077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.529028    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientPID"
Sep 16 00:34:09.529868 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.529853    2563 policy_none.go:47] "Start"
Sep 16 00:34:09.615328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.574532    2563 manager.go:337] "Starting Device Plugin manager"
Sep 16 00:34:09.615328 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.574578    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 00:34:09.615328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.574591    2563 server.go:87] "Starting device plugin registration server"
Sep 16 00:34:09.615328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.574995    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 00:34:09.615328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.575012    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 00:34:09.615328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.575111    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 00:34:09.615328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.575191    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 00:34:09.615328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.575200    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 00:34:09.615328 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.575825    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 00:34:09.615328 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.575873    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-16.ec2.internal\" not found"
Sep 16 00:34:09.659548 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.659512    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 00:34:09.660848 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.660831    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 00:34:09.660959 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.660893    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 00:34:09.660959 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.660924    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 00:34:09.661052 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.660969    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 00:34:09.663465 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.663441    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 00:34:09.675493 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.675475    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 00:34:09.676570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.676553    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 00:34:09.676654 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.676591    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 00:34:09.676654 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.676608    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientPID"
Sep 16 00:34:09.676654 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.676631    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.682933 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.682870    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.682933 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.682895    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-16.ec2.internal\": node \"ip-10-0-136-16.ec2.internal\" not found"
Sep 16 00:34:09.708176 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.708154    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-16.ec2.internal\" not found"
Sep 16 00:34:09.761759 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.761716    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-16.ec2.internal"]
Sep 16 00:34:09.761841 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.761814    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 00:34:09.763016 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.762996    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 00:34:09.763108 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.763035    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 00:34:09.763108 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.763049    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientPID"
Sep 16 00:34:09.764476 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.764461    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 00:34:09.764604 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.764590    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.764657 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.764637    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 00:34:09.765274 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.765253    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 00:34:09.765364 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.765287    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 00:34:09.765364 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.765253    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 00:34:09.765364 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.765300    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientPID"
Sep 16 00:34:09.765364 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.765320    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 00:34:09.765364 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.765333    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientPID"
Sep 16 00:34:09.766416 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.766401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.766464 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.766427    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 00:34:09.767100 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.767084    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 00:34:09.767165 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.767115    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 00:34:09.767165 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.767130    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeHasSufficientPID"
Sep 16 00:34:09.790482 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.790461    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-16.ec2.internal\" not found" node="ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.795309 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.795290    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-16.ec2.internal\" not found" node="ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.803462 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.803444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fc0ab2a38bff369ebd41f0fa6d816a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal\" (UID: \"1fc0ab2a38bff369ebd41f0fa6d816a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.803543 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.803475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fc0ab2a38bff369ebd41f0fa6d816a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal\" (UID: \"1fc0ab2a38bff369ebd41f0fa6d816a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.803543 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.803501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e0069b0aef7ee63595e298c66c4b96a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-16.ec2.internal\" (UID: \"0e0069b0aef7ee63595e298c66c4b96a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.808527 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.808507    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-16.ec2.internal\" not found"
Sep 16 00:34:09.903930 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.903893    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fc0ab2a38bff369ebd41f0fa6d816a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal\" (UID: \"1fc0ab2a38bff369ebd41f0fa6d816a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.903930 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.903927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fc0ab2a38bff369ebd41f0fa6d816a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal\" (UID: \"1fc0ab2a38bff369ebd41f0fa6d816a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.904169 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.903981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e0069b0aef7ee63595e298c66c4b96a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-16.ec2.internal\" (UID: \"0e0069b0aef7ee63595e298c66c4b96a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.904169 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.903985    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fc0ab2a38bff369ebd41f0fa6d816a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal\" (UID: \"1fc0ab2a38bff369ebd41f0fa6d816a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.904169 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.904014    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e0069b0aef7ee63595e298c66c4b96a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-16.ec2.internal\" (UID: \"0e0069b0aef7ee63595e298c66c4b96a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.904169 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:09.904019    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fc0ab2a38bff369ebd41f0fa6d816a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal\" (UID: \"1fc0ab2a38bff369ebd41f0fa6d816a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:09.909004 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:09.908987    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-16.ec2.internal\" not found"
Sep 16 00:34:10.009906 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.009861    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-16.ec2.internal\" not found"
Sep 16 00:34:10.093091 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.093055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:10.098133 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.098117    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:10.110863 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.110843    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-16.ec2.internal\" not found"
Sep 16 00:34:10.211373 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.211335    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-16.ec2.internal\" not found"
Sep 16 00:34:10.312018 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.311925    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-16.ec2.internal\" not found"
Sep 16 00:34:10.319052 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.319027    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 00:34:10.402247 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.402215    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:10.413376 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.413344    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 00:34:10.415133 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.415111    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-16.ec2.internal"
Sep 16 00:34:10.423808 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.423786    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 00:34:10.428055 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.428035    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 00:34:10.446960 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.446929    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 00:34:10.447102 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.447079    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 00:34:10.447148 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.447110    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 00:34:10.447148 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.447110    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 00:34:10.468375 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.468344    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 00:34:10.483829 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.483800    2563 apiserver.go:52] "Watching apiserver"
Sep 16 00:34:10.490772 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.490724    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 00:34:10.492025 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.492000    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6l74x","kube-system/konnectivity-agent-v77nk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq","openshift-cluster-node-tuning-operator/tuned-7j7h6","openshift-image-registry/node-ca-4k5j9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal","openshift-multus/multus-additional-cni-plugins-7n9lz","openshift-multus/network-metrics-daemon-87j7s","kube-system/kube-apiserver-proxy-ip-10-0-136-16.ec2.internal","openshift-dns/node-resolver-kgmhs","openshift-multus/multus-hbvgv","openshift-network-diagnostics/network-check-target-swcf8","openshift-network-operator/iptables-alerter-t469h","openshift-ovn-kubernetes/ovnkube-node-xjfsh"]
Sep 16 00:34:10.493462 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.493440    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.494534 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.494515    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t469h"
Sep 16 00:34:10.495737 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.495706    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 00:34:10.495854 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.495837    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kg2sp\""
Sep 16 00:34:10.495926 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.495888    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.495982 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.495959    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 00:34:10.496226 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.496207    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 00:34:10.496315 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.496240    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 00:34:10.496503 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.496489    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 00:34:10.496837 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.496823    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 00:34:10.496920 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.496845    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 00:34:10.496920 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.496852    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vl49d\""
Sep 16 00:34:10.497347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.497325    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 00:34:10.497439 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.497400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.498129 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.498108    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 00:34:10.498205 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.498147    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fdlmx\""
Sep 16 00:34:10.498315 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.498297    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 00:34:10.498483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.498468    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 00:34:10.498769 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.498747    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4k5j9"
Sep 16 00:34:10.499304 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.499287    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 00:34:10.499462 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.499437    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v7zh2\""
Sep 16 00:34:10.499686 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.499349    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 00:34:10.500109 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.500089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.500469 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.500440    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 00:34:10.502557 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.500752    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8tv9d\""
Sep 16 00:34:10.502557 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.500764    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 00:34:10.502557 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.500773    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 00:34:10.502557 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.501457    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 00:34:10.502557 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.501473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:10.502557 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.501537    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:10.502557 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.501859    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 00:34:10.502557 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.502269    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 00:34:10.502557 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.502330    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 00:34:10.502557 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.502416    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 00:34:10.502557 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.502516    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 00:34:10.503089 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.502611    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 00:34:10.503089 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.502742    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-95m8b\""
Sep 16 00:34:10.503089 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.502955    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:10.503089 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.503019    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:10.504123 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.504102    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v77nk"
Sep 16 00:34:10.505528 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.505512    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kgmhs"
Sep 16 00:34:10.505891 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.505871    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 00:34:10.506016 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.505954    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c8hlj\""
Sep 16 00:34:10.506153 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.506137    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 00:34:10.507521 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507252    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ndqdx\""
Sep 16 00:34:10.507521 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507336    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.507521 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507384    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 00:34:10.507521 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507490    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 00:34:10.507783 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-kubelet\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.507783 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-cni-netd\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.507783 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-etc-openvswitch\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.508008 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-kubernetes\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.508008 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-lib-modules\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.508008 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-cni-bin\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.508008 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f540942-2af5-47b1-9686-2b8708bd002d-ovnkube-config\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.508008 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff05bc9e-4000-447e-ba95-1c553022a157-kubelet-config\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:10.508008 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.508008 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-device-dir\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.508008 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrqz7\" (UniqueName: \"kubernetes.io/projected/0543670a-aee2-4aaf-8cf1-d1d7e147c704-kube-api-access-qrqz7\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.508008 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.507981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:10.508008 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-etc-selinux\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e79a602a-4cd5-45e4-b7f5-0315498e7dda-serviceca\") pod \"node-ca-4k5j9\" (UID: \"e79a602a-4cd5-45e4-b7f5-0315498e7dda\") " pod="openshift-image-registry/node-ca-4k5j9"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-system-cni-dir\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-systemd\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmzct\" (UniqueName: \"kubernetes.io/projected/b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f-kube-api-access-kmzct\") pod \"iptables-alerter-t469h\" (UID: \"b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f\") " pod="openshift-network-operator/iptables-alerter-t469h"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-sys\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1824e97-9116-4325-a0c3-cd0420078a59-tmp\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f-iptables-alerter-script\") pod \"iptables-alerter-t469h\" (UID: \"b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f\") " pod="openshift-network-operator/iptables-alerter-t469h"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508205    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-registration-dir\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-slash\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f540942-2af5-47b1-9686-2b8708bd002d-ovnkube-script-lib\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-modprobe-d\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508378    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8glrv\" (UniqueName: \"kubernetes.io/projected/d1824e97-9116-4325-a0c3-cd0420078a59-kube-api-access-8glrv\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-systemd-units\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.508443 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508429    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-node-log\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f540942-2af5-47b1-9686-2b8708bd002d-ovn-node-metrics-cert\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x8wp\" (UniqueName: \"kubernetes.io/projected/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-kube-api-access-6x8wp\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508855    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-log-socket\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvnwr\" (UniqueName: \"kubernetes.io/projected/3f540942-2af5-47b1-9686-2b8708bd002d-kube-api-access-rvnwr\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff05bc9e-4000-447e-ba95-1c553022a157-dbus\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.508911    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e79a602a-4cd5-45e4-b7f5-0315498e7dda-host\") pod \"node-ca-4k5j9\" (UID: \"e79a602a-4cd5-45e4-b7f5-0315498e7dda\") " pod="openshift-image-registry/node-ca-4k5j9"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bthxq\" (UniqueName: \"kubernetes.io/projected/e79a602a-4cd5-45e4-b7f5-0315498e7dda-kube-api-access-bthxq\") pod \"node-ca-4k5j9\" (UID: \"e79a602a-4cd5-45e4-b7f5-0315498e7dda\") " pod="openshift-image-registry/node-ca-4k5j9"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-cnibin\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.508996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-sysctl-conf\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-run\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d1824e97-9116-4325-a0c3-cd0420078a59-etc-tuned\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-var-lib-openvswitch\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.509192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509092    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-sys-fs\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509118    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-sysconfig\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-sysctl-d\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-socket-dir\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-host\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-run-systemd\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509271    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509302    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-cni-binary-copy\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-run-ovn-kubernetes\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfzwt\" (UniqueName: \"kubernetes.io/projected/2489af70-f6d9-4573-b417-a837382d7240-kube-api-access-tfzwt\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-var-lib-kubelet\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-run-openvswitch\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-run-ovn\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509462    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6wjhh\""
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f540942-2af5-47b1-9686-2b8708bd002d-env-overrides\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f-host-slash\") pod \"iptables-alerter-t469h\" (UID: \"b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f\") " pod="openshift-network-operator/iptables-alerter-t469h"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-run-netns\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.509698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.509582    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 00:34:10.515761 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.515738    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 00:34:10.522048 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.521994    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 00:29:09 +0000 UTC" deadline="2028-02-23 09:14:27.749690079 +0000 UTC"
Sep 16 00:34:10.522048 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.522047    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12608h40m17.227646506s"
Sep 16 00:34:10.532944 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.532921    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lbcj7"
Sep 16 00:34:10.546179 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.546126    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lbcj7"
Sep 16 00:34:10.603366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.603340    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 00:34:10.605425 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:10.605400    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc0ab2a38bff369ebd41f0fa6d816a7.slice/crio-5df9b2ad18011a3ca154b1c260a7de28e767f81af05b834262ca2e0bee10f87f WatchSource:0}: Error finding container 5df9b2ad18011a3ca154b1c260a7de28e767f81af05b834262ca2e0bee10f87f: Status 404 returned error can't find the container with id 5df9b2ad18011a3ca154b1c260a7de28e767f81af05b834262ca2e0bee10f87f
Sep 16 00:34:10.605649 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:10.605629    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0069b0aef7ee63595e298c66c4b96a.slice/crio-2194f71409c79a9648ba3610dc8c5d0963e08afa613eed941f8ced450ff07e09 WatchSource:0}: Error finding container 2194f71409c79a9648ba3610dc8c5d0963e08afa613eed941f8ced450ff07e09: Status 404 returned error can't find the container with id 2194f71409c79a9648ba3610dc8c5d0963e08afa613eed941f8ced450ff07e09
Sep 16 00:34:10.609803 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f-host-slash\") pod \"iptables-alerter-t469h\" (UID: \"b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f\") " pod="openshift-network-operator/iptables-alerter-t469h"
Sep 16 00:34:10.609914 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-run-netns\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.609914 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609838    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-kubelet\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.609914 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-cni-netd\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.609914 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609857    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f-host-slash\") pod \"iptables-alerter-t469h\" (UID: \"b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f\") " pod="openshift-network-operator/iptables-alerter-t469h"
Sep 16 00:34:10.609914 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-system-cni-dir\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.609914 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609896    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-run-netns\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.609914 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-etc-openvswitch\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609909    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-kubelet\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-cni-netd\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-run-netns\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89f6z\" (UniqueName: \"kubernetes.io/projected/55345e74-4778-4460-96e8-5bc1d01532fb-kube-api-access-89f6z\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-etc-openvswitch\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.609998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-kubernetes\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-lib-modules\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-cni-bin\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f540942-2af5-47b1-9686-2b8708bd002d-ovnkube-config\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff05bc9e-4000-447e-ba95-1c553022a157-kubelet-config\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-device-dir\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-cni-bin\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrqz7\" (UniqueName: \"kubernetes.io/projected/0543670a-aee2-4aaf-8cf1-d1d7e147c704-kube-api-access-qrqz7\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610146    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-kubernetes\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610164    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-var-lib-cni-bin\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.610430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-device-dir\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-lib-modules\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610410    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff05bc9e-4000-447e-ba95-1c553022a157-kubelet-config\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610470    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-var-lib-kubelet\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610496    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-multus-conf-dir\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-etc-selinux\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e79a602a-4cd5-45e4-b7f5-0315498e7dda-serviceca\") pod \"node-ca-4k5j9\" (UID: \"e79a602a-4cd5-45e4-b7f5-0315498e7dda\") " pod="openshift-image-registry/node-ca-4k5j9"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-system-cni-dir\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-systemd\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmzct\" (UniqueName: \"kubernetes.io/projected/b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f-kube-api-access-kmzct\") pod \"iptables-alerter-t469h\" (UID: \"b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f\") " pod="openshift-network-operator/iptables-alerter-t469h"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-run-multus-certs\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-sys\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1824e97-9116-4325-a0c3-cd0420078a59-tmp\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f-iptables-alerter-script\") pod \"iptables-alerter-t469h\" (UID: \"b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f\") " pod="openshift-network-operator/iptables-alerter-t469h"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-registration-dir\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.611542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610812    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-system-cni-dir\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-slash\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610875    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.610893    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f540942-2af5-47b1-9686-2b8708bd002d-ovnkube-script-lib\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610909    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-etc-selinux\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47514264-52fd-443e-9ba3-4bcb3f3717e5-hosts-file\") pod \"node-resolver-kgmhs\" (UID: \"47514264-52fd-443e-9ba3-4bcb3f3717e5\") " pod="openshift-dns/node-resolver-kgmhs"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610910    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f540942-2af5-47b1-9686-2b8708bd002d-ovnkube-config\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.610948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-modprobe-d\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.610970    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret podName:ff05bc9e-4000-447e-ba95-1c553022a157 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:11.110954839 +0000 UTC m=+1.913777907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret") pod "global-pull-secret-syncer-6l74x" (UID: "ff05bc9e-4000-447e-ba95-1c553022a157") : object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8glrv\" (UniqueName: \"kubernetes.io/projected/d1824e97-9116-4325-a0c3-cd0420078a59-kube-api-access-8glrv\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-modprobe-d\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-systemd-units\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-systemd-units\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47514264-52fd-443e-9ba3-4bcb3f3717e5-tmp-dir\") pod \"node-resolver-kgmhs\" (UID: \"47514264-52fd-443e-9ba3-4bcb3f3717e5\") " pod="openshift-dns/node-resolver-kgmhs"
Sep 16 00:34:10.612407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611174    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd912ef0-02c8-41a2-84cb-4567e72d85ab-konnectivity-ca\") pod \"konnectivity-agent-v77nk\" (UID: \"cd912ef0-02c8-41a2-84cb-4567e72d85ab\") " pod="kube-system/konnectivity-agent-v77nk"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-hostroot\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-node-log\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611307    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-slash\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f540942-2af5-47b1-9686-2b8708bd002d-ovn-node-metrics-cert\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-cnibin\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611374    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-systemd\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x8wp\" (UniqueName: \"kubernetes.io/projected/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-kube-api-access-6x8wp\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611468    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-log-socket\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvnwr\" (UniqueName: \"kubernetes.io/projected/3f540942-2af5-47b1-9686-2b8708bd002d-kube-api-access-rvnwr\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff05bc9e-4000-447e-ba95-1c553022a157-dbus\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e79a602a-4cd5-45e4-b7f5-0315498e7dda-host\") pod \"node-ca-4k5j9\" (UID: \"e79a602a-4cd5-45e4-b7f5-0315498e7dda\") " pod="openshift-image-registry/node-ca-4k5j9"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bthxq\" (UniqueName: \"kubernetes.io/projected/e79a602a-4cd5-45e4-b7f5-0315498e7dda-kube-api-access-bthxq\") pod \"node-ca-4k5j9\" (UID: \"e79a602a-4cd5-45e4-b7f5-0315498e7dda\") " pod="openshift-image-registry/node-ca-4k5j9"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd912ef0-02c8-41a2-84cb-4567e72d85ab-agent-certs\") pod \"konnectivity-agent-v77nk\" (UID: \"cd912ef0-02c8-41a2-84cb-4567e72d85ab\") " pod="kube-system/konnectivity-agent-v77nk"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-run-k8s-cni-cncf-io\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-cnibin\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.613303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-sysctl-conf\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611785    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-run\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d1824e97-9116-4325-a0c3-cd0420078a59-etc-tuned\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-var-lib-openvswitch\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-sys-fs\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-multus-socket-dir-parent\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkppg\" (UniqueName: \"kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg\") pod \"network-check-target-swcf8\" (UID: \"f3291aad-6696-43d4-b082-eee2b95fef20\") " pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-sysconfig\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-sysctl-d\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612014    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f-iptables-alerter-script\") pod \"iptables-alerter-t469h\" (UID: \"b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f\") " pod="openshift-network-operator/iptables-alerter-t469h"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612036    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-socket-dir\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-host\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612082    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-node-log\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-run-systemd\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612170    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.612206    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:10.614172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f540942-2af5-47b1-9686-2b8708bd002d-ovnkube-script-lib\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-multus-cni-dir\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.611470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e79a602a-4cd5-45e4-b7f5-0315498e7dda-serviceca\") pod \"node-ca-4k5j9\" (UID: \"e79a602a-4cd5-45e4-b7f5-0315498e7dda\") " pod="openshift-image-registry/node-ca-4k5j9"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-run-systemd\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.612252    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs podName:2489af70-f6d9-4573-b417-a837382d7240 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:11.112237591 +0000 UTC m=+1.915060648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs") pod "network-metrics-daemon-87j7s" (UID: "2489af70-f6d9-4573-b417-a837382d7240") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612307    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-run\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-cni-binary-copy\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612355    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-log-socket\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612427    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-sysconfig\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-run-ovn-kubernetes\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-registration-dir\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzwt\" (UniqueName: \"kubernetes.io/projected/2489af70-f6d9-4573-b417-a837382d7240-kube-api-access-tfzwt\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrdhn\" (UniqueName: \"kubernetes.io/projected/47514264-52fd-443e-9ba3-4bcb3f3717e5-kube-api-access-jrdhn\") pod \"node-resolver-kgmhs\" (UID: \"47514264-52fd-443e-9ba3-4bcb3f3717e5\") " pod="openshift-dns/node-resolver-kgmhs"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff05bc9e-4000-447e-ba95-1c553022a157-dbus\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-var-lib-kubelet\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612551    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e79a602a-4cd5-45e4-b7f5-0315498e7dda-host\") pod \"node-ca-4k5j9\" (UID: \"e79a602a-4cd5-45e4-b7f5-0315498e7dda\") " pod="openshift-image-registry/node-ca-4k5j9"
Sep 16 00:34:10.615222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-run-ovn-kubernetes\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612599    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-var-lib-kubelet\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-run-openvswitch\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612792    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-socket-dir\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-cnibin\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-sysctl-d\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-etc-sysctl-conf\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-run-openvswitch\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-run-ovn\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613163    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-run-ovn\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613167    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-sys\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f540942-2af5-47b1-9686-2b8708bd002d-env-overrides\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f540942-2af5-47b1-9686-2b8708bd002d-var-lib-openvswitch\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-cni-binary-copy\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-sys-fs\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613365    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1824e97-9116-4325-a0c3-cd0420078a59-host\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.616266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.617130 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55345e74-4778-4460-96e8-5bc1d01532fb-cni-binary-copy\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.617130 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-var-lib-cni-multus\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.617130 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55345e74-4778-4460-96e8-5bc1d01532fb-multus-daemon-config\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.617130 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613709    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f540942-2af5-47b1-9686-2b8708bd002d-env-overrides\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.617130 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.613713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-etc-kubernetes\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.617130 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.612088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0543670a-aee2-4aaf-8cf1-d1d7e147c704-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.617716 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.617512    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d1824e97-9116-4325-a0c3-cd0420078a59-etc-tuned\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.617807 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.617552    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1824e97-9116-4325-a0c3-cd0420078a59-tmp\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.617864 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.617686    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f540942-2af5-47b1-9686-2b8708bd002d-ovn-node-metrics-cert\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.620994 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.620197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8glrv\" (UniqueName: \"kubernetes.io/projected/d1824e97-9116-4325-a0c3-cd0420078a59-kube-api-access-8glrv\") pod \"tuned-7j7h6\" (UID: \"d1824e97-9116-4325-a0c3-cd0420078a59\") " pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.620994 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.620395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrqz7\" (UniqueName: \"kubernetes.io/projected/0543670a-aee2-4aaf-8cf1-d1d7e147c704-kube-api-access-qrqz7\") pod \"aws-ebs-csi-driver-node-wlnwq\" (UID: \"0543670a-aee2-4aaf-8cf1-d1d7e147c704\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.621729 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.621708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bthxq\" (UniqueName: \"kubernetes.io/projected/e79a602a-4cd5-45e4-b7f5-0315498e7dda-kube-api-access-bthxq\") pod \"node-ca-4k5j9\" (UID: \"e79a602a-4cd5-45e4-b7f5-0315498e7dda\") " pod="openshift-image-registry/node-ca-4k5j9"
Sep 16 00:34:10.621871 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.621839    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x8wp\" (UniqueName: \"kubernetes.io/projected/89e23aa3-969a-40ab-8ed1-8c1b7bb63199-kube-api-access-6x8wp\") pod \"multus-additional-cni-plugins-7n9lz\" (UID: \"89e23aa3-969a-40ab-8ed1-8c1b7bb63199\") " pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.622880 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.622856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfzwt\" (UniqueName: \"kubernetes.io/projected/2489af70-f6d9-4573-b417-a837382d7240-kube-api-access-tfzwt\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:10.623153 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.623122    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmzct\" (UniqueName: \"kubernetes.io/projected/b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f-kube-api-access-kmzct\") pod \"iptables-alerter-t469h\" (UID: \"b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f\") " pod="openshift-network-operator/iptables-alerter-t469h"
Sep 16 00:34:10.625108 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.625083    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvnwr\" (UniqueName: \"kubernetes.io/projected/3f540942-2af5-47b1-9686-2b8708bd002d-kube-api-access-rvnwr\") pod \"ovnkube-node-xjfsh\" (UID: \"3f540942-2af5-47b1-9686-2b8708bd002d\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.665000 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.664953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal" event={"ID":"1fc0ab2a38bff369ebd41f0fa6d816a7","Type":"ContainerStarted","Data":"5df9b2ad18011a3ca154b1c260a7de28e767f81af05b834262ca2e0bee10f87f"}
Sep 16 00:34:10.666050 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.666028    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-16.ec2.internal" event={"ID":"0e0069b0aef7ee63595e298c66c4b96a","Type":"ContainerStarted","Data":"2194f71409c79a9648ba3610dc8c5d0963e08afa613eed941f8ced450ff07e09"}
Sep 16 00:34:10.714523 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55345e74-4778-4460-96e8-5bc1d01532fb-cni-binary-copy\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.714523 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-var-lib-cni-multus\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.714523 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55345e74-4778-4460-96e8-5bc1d01532fb-multus-daemon-config\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.714872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714584    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-var-lib-cni-multus\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.714872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-etc-kubernetes\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.714872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714721    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-etc-kubernetes\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.714872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-system-cni-dir\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.714872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-run-netns\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.714872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714778    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-system-cni-dir\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.714872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89f6z\" (UniqueName: \"kubernetes.io/projected/55345e74-4778-4460-96e8-5bc1d01532fb-kube-api-access-89f6z\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.714872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714812    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-run-netns\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.714872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-var-lib-cni-bin\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.714872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-var-lib-kubelet\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-multus-conf-dir\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-run-multus-certs\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-var-lib-cni-bin\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714958    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-var-lib-kubelet\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47514264-52fd-443e-9ba3-4bcb3f3717e5-hosts-file\") pod \"node-resolver-kgmhs\" (UID: \"47514264-52fd-443e-9ba3-4bcb3f3717e5\") " pod="openshift-dns/node-resolver-kgmhs"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.714983    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-multus-conf-dir\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715002    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-run-multus-certs\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715032    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47514264-52fd-443e-9ba3-4bcb3f3717e5-hosts-file\") pod \"node-resolver-kgmhs\" (UID: \"47514264-52fd-443e-9ba3-4bcb3f3717e5\") " pod="openshift-dns/node-resolver-kgmhs"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47514264-52fd-443e-9ba3-4bcb3f3717e5-tmp-dir\") pod \"node-resolver-kgmhs\" (UID: \"47514264-52fd-443e-9ba3-4bcb3f3717e5\") " pod="openshift-dns/node-resolver-kgmhs"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd912ef0-02c8-41a2-84cb-4567e72d85ab-konnectivity-ca\") pod \"konnectivity-agent-v77nk\" (UID: \"cd912ef0-02c8-41a2-84cb-4567e72d85ab\") " pod="kube-system/konnectivity-agent-v77nk"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-hostroot\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-cnibin\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55345e74-4778-4460-96e8-5bc1d01532fb-cni-binary-copy\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd912ef0-02c8-41a2-84cb-4567e72d85ab-agent-certs\") pod \"konnectivity-agent-v77nk\" (UID: \"cd912ef0-02c8-41a2-84cb-4567e72d85ab\") " pod="kube-system/konnectivity-agent-v77nk"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715210    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55345e74-4778-4460-96e8-5bc1d01532fb-multus-daemon-config\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-hostroot\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-run-k8s-cni-cncf-io\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-cnibin\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715966 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715267    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-host-run-k8s-cni-cncf-io\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715966 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-multus-socket-dir-parent\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715966 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkppg\" (UniqueName: \"kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg\") pod \"network-check-target-swcf8\" (UID: \"f3291aad-6696-43d4-b082-eee2b95fef20\") " pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:10.715966 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-multus-cni-dir\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715966 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrdhn\" (UniqueName: \"kubernetes.io/projected/47514264-52fd-443e-9ba3-4bcb3f3717e5-kube-api-access-jrdhn\") pod \"node-resolver-kgmhs\" (UID: \"47514264-52fd-443e-9ba3-4bcb3f3717e5\") " pod="openshift-dns/node-resolver-kgmhs"
Sep 16 00:34:10.715966 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715383    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47514264-52fd-443e-9ba3-4bcb3f3717e5-tmp-dir\") pod \"node-resolver-kgmhs\" (UID: \"47514264-52fd-443e-9ba3-4bcb3f3717e5\") " pod="openshift-dns/node-resolver-kgmhs"
Sep 16 00:34:10.715966 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-multus-socket-dir-parent\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715966 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715521    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55345e74-4778-4460-96e8-5bc1d01532fb-multus-cni-dir\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.715966 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.715639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd912ef0-02c8-41a2-84cb-4567e72d85ab-konnectivity-ca\") pod \"konnectivity-agent-v77nk\" (UID: \"cd912ef0-02c8-41a2-84cb-4567e72d85ab\") " pod="kube-system/konnectivity-agent-v77nk"
Sep 16 00:34:10.717617 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.717601    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd912ef0-02c8-41a2-84cb-4567e72d85ab-agent-certs\") pod \"konnectivity-agent-v77nk\" (UID: \"cd912ef0-02c8-41a2-84cb-4567e72d85ab\") " pod="kube-system/konnectivity-agent-v77nk"
Sep 16 00:34:10.720831 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.720808    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 00:34:10.720831 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.720832    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 00:34:10.720980 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.720842    2563 projected.go:196] Error preparing data for projected volume kube-api-access-nkppg for pod openshift-network-diagnostics/network-check-target-swcf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:10.720980 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:10.720892    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg podName:f3291aad-6696-43d4-b082-eee2b95fef20 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:11.220878634 +0000 UTC m=+2.023701675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nkppg" (UniqueName: "kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg") pod "network-check-target-swcf8" (UID: "f3291aad-6696-43d4-b082-eee2b95fef20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:10.723022 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.723006    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89f6z\" (UniqueName: \"kubernetes.io/projected/55345e74-4778-4460-96e8-5bc1d01532fb-kube-api-access-89f6z\") pod \"multus-hbvgv\" (UID: \"55345e74-4778-4460-96e8-5bc1d01532fb\") " pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.723066 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.723019    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrdhn\" (UniqueName: \"kubernetes.io/projected/47514264-52fd-443e-9ba3-4bcb3f3717e5-kube-api-access-jrdhn\") pod \"node-resolver-kgmhs\" (UID: \"47514264-52fd-443e-9ba3-4bcb3f3717e5\") " pod="openshift-dns/node-resolver-kgmhs"
Sep 16 00:34:10.825468 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.825395    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7n9lz"
Sep 16 00:34:10.834892 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:10.834868    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e23aa3_969a_40ab_8ed1_8c1b7bb63199.slice/crio-0caf709a85add91a41192a5a444174e66e72c66080742751ce614e28c330ea04 WatchSource:0}: Error finding container 0caf709a85add91a41192a5a444174e66e72c66080742751ce614e28c330ea04: Status 404 returned error can't find the container with id 0caf709a85add91a41192a5a444174e66e72c66080742751ce614e28c330ea04
Sep 16 00:34:10.842100 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.842080    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t469h"
Sep 16 00:34:10.849044 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:10.849021    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb40b3e38_4f5b_4743_8a7b_1fbfdc6d907f.slice/crio-fa0c08f7ec9752e70357eb235a789ea34fb3d9007e68e91826cd484ecc5cc274 WatchSource:0}: Error finding container fa0c08f7ec9752e70357eb235a789ea34fb3d9007e68e91826cd484ecc5cc274: Status 404 returned error can't find the container with id fa0c08f7ec9752e70357eb235a789ea34fb3d9007e68e91826cd484ecc5cc274
Sep 16 00:34:10.856553 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.856531    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq"
Sep 16 00:34:10.864582 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:10.864543    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0543670a_aee2_4aaf_8cf1_d1d7e147c704.slice/crio-59c10bb6dbbc87a807db8cb8a83fcca72c7d73af8b49bef3c9c86c5249da099d WatchSource:0}: Error finding container 59c10bb6dbbc87a807db8cb8a83fcca72c7d73af8b49bef3c9c86c5249da099d: Status 404 returned error can't find the container with id 59c10bb6dbbc87a807db8cb8a83fcca72c7d73af8b49bef3c9c86c5249da099d
Sep 16 00:34:10.871070 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.871054    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7j7h6"
Sep 16 00:34:10.878273 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:10.878249    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1824e97_9116_4325_a0c3_cd0420078a59.slice/crio-ff2bf688bcf4d20221f15c8c4902bca9c229d3aee4898146df1d4d7b99ed1401 WatchSource:0}: Error finding container ff2bf688bcf4d20221f15c8c4902bca9c229d3aee4898146df1d4d7b99ed1401: Status 404 returned error can't find the container with id ff2bf688bcf4d20221f15c8c4902bca9c229d3aee4898146df1d4d7b99ed1401
Sep 16 00:34:10.888059 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.888039    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4k5j9"
Sep 16 00:34:10.895171 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:10.895148    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79a602a_4cd5_45e4_b7f5_0315498e7dda.slice/crio-9fe1bc28932097df595f7b07e4802f9f99e887c6826ee4baf11151477a2f5bae WatchSource:0}: Error finding container 9fe1bc28932097df595f7b07e4802f9f99e887c6826ee4baf11151477a2f5bae: Status 404 returned error can't find the container with id 9fe1bc28932097df595f7b07e4802f9f99e887c6826ee4baf11151477a2f5bae
Sep 16 00:34:10.910803 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.910784    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:10.918213 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:10.918191    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f540942_2af5_47b1_9686_2b8708bd002d.slice/crio-4f21dd41257b2965128e5745fe4b3616e67bf74eda5c4f3f04e6073f790a0256 WatchSource:0}: Error finding container 4f21dd41257b2965128e5745fe4b3616e67bf74eda5c4f3f04e6073f790a0256: Status 404 returned error can't find the container with id 4f21dd41257b2965128e5745fe4b3616e67bf74eda5c4f3f04e6073f790a0256
Sep 16 00:34:10.931593 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.931562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v77nk"
Sep 16 00:34:10.936830 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.936809    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kgmhs"
Sep 16 00:34:10.939857 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:10.939834    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd912ef0_02c8_41a2_84cb_4567e72d85ab.slice/crio-6a5e331012ed33b4947dea67c8fcca5c19a5a309da698a1ad2267e1344550da5 WatchSource:0}: Error finding container 6a5e331012ed33b4947dea67c8fcca5c19a5a309da698a1ad2267e1344550da5: Status 404 returned error can't find the container with id 6a5e331012ed33b4947dea67c8fcca5c19a5a309da698a1ad2267e1344550da5
Sep 16 00:34:10.940968 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:10.940949    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hbvgv"
Sep 16 00:34:10.945375 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:10.945345    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47514264_52fd_443e_9ba3_4bcb3f3717e5.slice/crio-8c14a8fb88132101179e4a7a350b72833cc410c39554c9ec4f60dd27ae35e2be WatchSource:0}: Error finding container 8c14a8fb88132101179e4a7a350b72833cc410c39554c9ec4f60dd27ae35e2be: Status 404 returned error can't find the container with id 8c14a8fb88132101179e4a7a350b72833cc410c39554c9ec4f60dd27ae35e2be
Sep 16 00:34:10.951040 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:10.951017    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55345e74_4778_4460_96e8_5bc1d01532fb.slice/crio-2c9297d654728be349b60c88b186017569b41847149a6d75ec9c75379a2f4ea2 WatchSource:0}: Error finding container 2c9297d654728be349b60c88b186017569b41847149a6d75ec9c75379a2f4ea2: Status 404 returned error can't find the container with id 2c9297d654728be349b60c88b186017569b41847149a6d75ec9c75379a2f4ea2
Sep 16 00:34:11.119370 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.119277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:11.119370 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.119346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:11.119672 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:11.119528    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:11.119672 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:11.119593    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs podName:2489af70-f6d9-4573-b417-a837382d7240 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:12.119571536 +0000 UTC m=+2.922394598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs") pod "network-metrics-daemon-87j7s" (UID: "2489af70-f6d9-4573-b417-a837382d7240") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:11.120057 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:11.120009    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:11.120228 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:11.120087    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret podName:ff05bc9e-4000-447e-ba95-1c553022a157 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:12.120068598 +0000 UTC m=+2.922891648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret") pod "global-pull-secret-syncer-6l74x" (UID: "ff05bc9e-4000-447e-ba95-1c553022a157") : object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:11.321698 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.321650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkppg\" (UniqueName: \"kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg\") pod \"network-check-target-swcf8\" (UID: \"f3291aad-6696-43d4-b082-eee2b95fef20\") " pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:11.321901 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:11.321862    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 00:34:11.321901 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:11.321890    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 00:34:11.322020 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:11.321905    2563 projected.go:196] Error preparing data for projected volume kube-api-access-nkppg for pod openshift-network-diagnostics/network-check-target-swcf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:11.322020 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:11.321989    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg podName:f3291aad-6696-43d4-b082-eee2b95fef20 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:12.321959724 +0000 UTC m=+3.124782789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkppg" (UniqueName: "kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg") pod "network-check-target-swcf8" (UID: "f3291aad-6696-43d4-b082-eee2b95fef20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:11.548763 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.548713    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 00:29:10 +0000 UTC" deadline="2028-06-02 10:52:25.46924966 +0000 UTC"
Sep 16 00:34:11.548763 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.548756    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15010h18m13.920498552s"
Sep 16 00:34:11.673395 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.672871    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:11.673395 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:11.673071    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:11.692778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.692731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hbvgv" event={"ID":"55345e74-4778-4460-96e8-5bc1d01532fb","Type":"ContainerStarted","Data":"2c9297d654728be349b60c88b186017569b41847149a6d75ec9c75379a2f4ea2"}
Sep 16 00:34:11.704570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.704528    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kgmhs" event={"ID":"47514264-52fd-443e-9ba3-4bcb3f3717e5","Type":"ContainerStarted","Data":"8c14a8fb88132101179e4a7a350b72833cc410c39554c9ec4f60dd27ae35e2be"}
Sep 16 00:34:11.708614 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.708578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh" event={"ID":"3f540942-2af5-47b1-9686-2b8708bd002d","Type":"ContainerStarted","Data":"4f21dd41257b2965128e5745fe4b3616e67bf74eda5c4f3f04e6073f790a0256"}
Sep 16 00:34:11.712474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.712440    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4k5j9" event={"ID":"e79a602a-4cd5-45e4-b7f5-0315498e7dda","Type":"ContainerStarted","Data":"9fe1bc28932097df595f7b07e4802f9f99e887c6826ee4baf11151477a2f5bae"}
Sep 16 00:34:11.724507 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.724476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq" event={"ID":"0543670a-aee2-4aaf-8cf1-d1d7e147c704","Type":"ContainerStarted","Data":"59c10bb6dbbc87a807db8cb8a83fcca72c7d73af8b49bef3c9c86c5249da099d"}
Sep 16 00:34:11.733375 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.733332    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t469h" event={"ID":"b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f","Type":"ContainerStarted","Data":"fa0c08f7ec9752e70357eb235a789ea34fb3d9007e68e91826cd484ecc5cc274"}
Sep 16 00:34:11.735713 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.735676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v77nk" event={"ID":"cd912ef0-02c8-41a2-84cb-4567e72d85ab","Type":"ContainerStarted","Data":"6a5e331012ed33b4947dea67c8fcca5c19a5a309da698a1ad2267e1344550da5"}
Sep 16 00:34:11.742000 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.741919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7j7h6" event={"ID":"d1824e97-9116-4325-a0c3-cd0420078a59","Type":"ContainerStarted","Data":"ff2bf688bcf4d20221f15c8c4902bca9c229d3aee4898146df1d4d7b99ed1401"}
Sep 16 00:34:11.750288 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.750204    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7n9lz" event={"ID":"89e23aa3-969a-40ab-8ed1-8c1b7bb63199","Type":"ContainerStarted","Data":"0caf709a85add91a41192a5a444174e66e72c66080742751ce614e28c330ea04"}
Sep 16 00:34:11.815815 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:11.815007    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 00:34:12.128586 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:12.128447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:12.128586 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:12.128524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:12.128953 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:12.128722    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:12.128953 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:12.128795    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs podName:2489af70-f6d9-4573-b417-a837382d7240 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:14.128774429 +0000 UTC m=+4.931597498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs") pod "network-metrics-daemon-87j7s" (UID: "2489af70-f6d9-4573-b417-a837382d7240") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:12.129437 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:12.129214    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:12.129437 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:12.129271    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret podName:ff05bc9e-4000-447e-ba95-1c553022a157 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:14.129255192 +0000 UTC m=+4.932078240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret") pod "global-pull-secret-syncer-6l74x" (UID: "ff05bc9e-4000-447e-ba95-1c553022a157") : object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:12.330569 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:12.330527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkppg\" (UniqueName: \"kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg\") pod \"network-check-target-swcf8\" (UID: \"f3291aad-6696-43d4-b082-eee2b95fef20\") " pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:12.330783 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:12.330765    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 00:34:12.330851 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:12.330791    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 00:34:12.330851 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:12.330806    2563 projected.go:196] Error preparing data for projected volume kube-api-access-nkppg for pod openshift-network-diagnostics/network-check-target-swcf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:12.330954 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:12.330921    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg podName:f3291aad-6696-43d4-b082-eee2b95fef20 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:14.330898776 +0000 UTC m=+5.133721843 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkppg" (UniqueName: "kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg") pod "network-check-target-swcf8" (UID: "f3291aad-6696-43d4-b082-eee2b95fef20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:12.550003 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:12.549932    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 00:29:10 +0000 UTC" deadline="2028-06-14 00:22:17.202802294 +0000 UTC"
Sep 16 00:34:12.550003 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:12.549995    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15287h48m4.652811656s"
Sep 16 00:34:12.662712 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:12.661815    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:12.662712 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:12.661936    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:12.662712 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:12.661999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:12.662712 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:12.662050    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:13.358053 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:13.358020    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 00:34:13.430083 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:13.430050    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 00:34:13.674722 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:13.674647    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:13.675348 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:13.674792    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:14.147445 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:14.147410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:14.147641 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:14.147479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:14.147641 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:14.147634    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:14.147792 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:14.147714    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs podName:2489af70-f6d9-4573-b417-a837382d7240 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:18.147691317 +0000 UTC m=+8.950514384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs") pod "network-metrics-daemon-87j7s" (UID: "2489af70-f6d9-4573-b417-a837382d7240") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:14.148143 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:14.148122    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:14.148228 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:14.148180    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret podName:ff05bc9e-4000-447e-ba95-1c553022a157 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:18.148164976 +0000 UTC m=+8.950988022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret") pod "global-pull-secret-syncer-6l74x" (UID: "ff05bc9e-4000-447e-ba95-1c553022a157") : object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:14.349295 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:14.349261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkppg\" (UniqueName: \"kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg\") pod \"network-check-target-swcf8\" (UID: \"f3291aad-6696-43d4-b082-eee2b95fef20\") " pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:14.349477 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:14.349451    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 00:34:14.349477 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:14.349473    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 00:34:14.349588 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:14.349486    2563 projected.go:196] Error preparing data for projected volume kube-api-access-nkppg for pod openshift-network-diagnostics/network-check-target-swcf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:14.349588 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:14.349539    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg podName:f3291aad-6696-43d4-b082-eee2b95fef20 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:18.349522179 +0000 UTC m=+9.152345224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkppg" (UniqueName: "kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg") pod "network-check-target-swcf8" (UID: "f3291aad-6696-43d4-b082-eee2b95fef20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:14.662062 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:14.661433    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:14.662062 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:14.661552    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:14.662062 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:14.661936    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:14.662062 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:14.662024    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:15.662801 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:15.662771    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:15.663285 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:15.662880    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:16.661387 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:16.661349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:16.661581 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:16.661491    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:16.661876 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:16.661856    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:16.661986 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:16.661967    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:17.661636 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:17.661603    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:17.662111 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:17.661756    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:18.180449 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:18.180404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:18.180604 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:18.180471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:18.180690 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:18.180639    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:18.180743 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:18.180723    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs podName:2489af70-f6d9-4573-b417-a837382d7240 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:26.180702894 +0000 UTC m=+16.983525950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs") pod "network-metrics-daemon-87j7s" (UID: "2489af70-f6d9-4573-b417-a837382d7240") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:18.180803 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:18.180790    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:18.180854 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:18.180828    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret podName:ff05bc9e-4000-447e-ba95-1c553022a157 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:26.180817691 +0000 UTC m=+16.983640744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret") pod "global-pull-secret-syncer-6l74x" (UID: "ff05bc9e-4000-447e-ba95-1c553022a157") : object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:18.382373 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:18.382326    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkppg\" (UniqueName: \"kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg\") pod \"network-check-target-swcf8\" (UID: \"f3291aad-6696-43d4-b082-eee2b95fef20\") " pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:18.382554 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:18.382466    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 00:34:18.382554 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:18.382496    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 00:34:18.382554 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:18.382507    2563 projected.go:196] Error preparing data for projected volume kube-api-access-nkppg for pod openshift-network-diagnostics/network-check-target-swcf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:18.382826 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:18.382565    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg podName:f3291aad-6696-43d4-b082-eee2b95fef20 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:26.382548463 +0000 UTC m=+17.185371513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkppg" (UniqueName: "kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg") pod "network-check-target-swcf8" (UID: "f3291aad-6696-43d4-b082-eee2b95fef20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:18.661780 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:18.661742    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:18.662353 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:18.661888    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:18.662353 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:18.661747    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:18.662353 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:18.662277    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:19.662593 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:19.662557    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:19.663060 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:19.662657    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:20.662392 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:20.661743    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:20.662392 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:20.661897    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:20.662392 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:20.662254    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:20.662392 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:20.662353    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:21.661323 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:21.661279    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:21.661527 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:21.661420    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:22.661162 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:22.661128    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:22.661551 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:22.661170    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:22.661551 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:22.661255    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:22.661551 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:22.661410    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:23.664478 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:23.664451    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:23.664855 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:23.664543    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:24.661863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:24.661824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:24.662060 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:24.661934    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:24.662060 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:24.662014    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:24.662184 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:24.662141    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:25.661408 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:25.661370    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:25.661806 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:25.661508    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:26.241538 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:26.241495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:26.241780 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:26.241598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:26.241780 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:26.241680    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:26.241780 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:26.241726    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:26.241780 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:26.241757    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs podName:2489af70-f6d9-4573-b417-a837382d7240 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:42.241735699 +0000 UTC m=+33.044558760 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs") pod "network-metrics-daemon-87j7s" (UID: "2489af70-f6d9-4573-b417-a837382d7240") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:26.241780 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:26.241780    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret podName:ff05bc9e-4000-447e-ba95-1c553022a157 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:42.241764814 +0000 UTC m=+33.044587870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret") pod "global-pull-secret-syncer-6l74x" (UID: "ff05bc9e-4000-447e-ba95-1c553022a157") : object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:26.442972 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:26.442933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkppg\" (UniqueName: \"kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg\") pod \"network-check-target-swcf8\" (UID: \"f3291aad-6696-43d4-b082-eee2b95fef20\") " pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:26.443130 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:26.443102    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 00:34:26.443130 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:26.443124    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 00:34:26.443223 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:26.443134    2563 projected.go:196] Error preparing data for projected volume kube-api-access-nkppg for pod openshift-network-diagnostics/network-check-target-swcf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:26.443223 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:26.443199    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg podName:f3291aad-6696-43d4-b082-eee2b95fef20 nodeName:}" failed. No retries permitted until 2026-09-16 00:34:42.443185088 +0000 UTC m=+33.246008134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkppg" (UniqueName: "kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg") pod "network-check-target-swcf8" (UID: "f3291aad-6696-43d4-b082-eee2b95fef20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:26.661431 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:26.661340    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:26.661987 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:26.661475    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:26.661987 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:26.661531    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:26.661987 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:26.661634    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:27.665024 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:27.664987    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:27.665455 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:27.665111    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:28.662143 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:28.662109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:28.662415 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:28.662236    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:28.662415 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:28.662270    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:28.662415 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:28.662330    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:29.662469 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:29.662433    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:29.662904 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:29.662541    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:30.661775 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.661281    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:30.661905 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.661300    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:30.661905 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:30.661888    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:30.661985 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:30.661918    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:30.795620 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.795584    2563 generic.go:356] "Generic (PLEG): container finished" podID="1fc0ab2a38bff369ebd41f0fa6d816a7" containerID="71ab869b8ea1cc54885e767fb55c6a1e404fcbfdb132707fce279d4b10d4d241" exitCode=0
Sep 16 00:34:30.796259 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.795684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal" event={"ID":"1fc0ab2a38bff369ebd41f0fa6d816a7","Type":"ContainerDied","Data":"71ab869b8ea1cc54885e767fb55c6a1e404fcbfdb132707fce279d4b10d4d241"}
Sep 16 00:34:30.797306 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.797281    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-16.ec2.internal" event={"ID":"0e0069b0aef7ee63595e298c66c4b96a","Type":"ContainerStarted","Data":"d3b55976c12e9c9893858330b25e7a27112f8ef84e1372913f82c2964baa46da"}
Sep 16 00:34:30.799023 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.799000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hbvgv" event={"ID":"55345e74-4778-4460-96e8-5bc1d01532fb","Type":"ContainerStarted","Data":"485e76222df91b31c235e7e0eebba0fa90a9c3660da853727b57742f723b7453"}
Sep 16 00:34:30.800640 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.800615    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kgmhs" event={"ID":"47514264-52fd-443e-9ba3-4bcb3f3717e5","Type":"ContainerStarted","Data":"47f241677f5cfa2d52a1960a7f6486e29b9e9544d098ba4ee430296ab282ca03"}
Sep 16 00:34:30.805714 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.805659    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh" event={"ID":"3f540942-2af5-47b1-9686-2b8708bd002d","Type":"ContainerStarted","Data":"eb0f193fa488ce00665c4593a05e8329924790f38f36d6ce611fafffd3989dee"}
Sep 16 00:34:30.805815 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.805783    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh" event={"ID":"3f540942-2af5-47b1-9686-2b8708bd002d","Type":"ContainerStarted","Data":"e7f4361a5f2db4138d26752bbf1f977055af80c70af3042292760d3628f8e404"}
Sep 16 00:34:30.805921 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.805837    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh" event={"ID":"3f540942-2af5-47b1-9686-2b8708bd002d","Type":"ContainerStarted","Data":"1d4573975205e64ec69643c9dd7e919cdc630da7ebfa1074d9b2f66d2dbdaede"}
Sep 16 00:34:30.805921 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.805875    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh" event={"ID":"3f540942-2af5-47b1-9686-2b8708bd002d","Type":"ContainerStarted","Data":"c2d7208c6075fb603bb4f0ad9f04f23c6d8dc2ef4201566c3c25cfafa3c9e8a3"}
Sep 16 00:34:30.807231 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.807202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4k5j9" event={"ID":"e79a602a-4cd5-45e4-b7f5-0315498e7dda","Type":"ContainerStarted","Data":"8b8f94e02b71cc76ecd528adf5990da1cb1b1e8c72c8eaf73d1be65fee9181c8"}
Sep 16 00:34:30.808654 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.808637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq" event={"ID":"0543670a-aee2-4aaf-8cf1-d1d7e147c704","Type":"ContainerStarted","Data":"85e9dc1a0fbc4d8c726a800cd0b9d55acaaf64d394008e6ac8cc1b5b68815a1a"}
Sep 16 00:34:30.809797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.809780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v77nk" event={"ID":"cd912ef0-02c8-41a2-84cb-4567e72d85ab","Type":"ContainerStarted","Data":"7fa52490430c066fddab1a27a15c80ef29908c20cffd1b50ef580f4545fc7df2"}
Sep 16 00:34:30.811113 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.811097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7j7h6" event={"ID":"d1824e97-9116-4325-a0c3-cd0420078a59","Type":"ContainerStarted","Data":"985c7fc3d3121b4d3cc65cb836a17a37c0c417ffa1737b5b4d2f0a22b0f8bca9"}
Sep 16 00:34:30.812387 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.812367    2563 generic.go:356] "Generic (PLEG): container finished" podID="89e23aa3-969a-40ab-8ed1-8c1b7bb63199" containerID="2d5a7a5838a935fa2eb4371310ab8330b213459a83564f88e6f26df77238983d" exitCode=0
Sep 16 00:34:30.812457 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.812398    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7n9lz" event={"ID":"89e23aa3-969a-40ab-8ed1-8c1b7bb63199","Type":"ContainerDied","Data":"2d5a7a5838a935fa2eb4371310ab8330b213459a83564f88e6f26df77238983d"}
Sep 16 00:34:30.835963 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.835918    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kgmhs" podStartSLOduration=2.838539583 podStartE2EDuration="21.83590315s" totalImagesPullingTime="18.997363567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 00:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:34:30.821202131 +0000 UTC m=+21.624025193" watchObservedRunningTime="2026-09-16 00:34:30.83590315 +0000 UTC m=+21.638726227"
Sep 16 00:34:30.836098 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.835997    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hbvgv" podStartSLOduration=2.504455029 podStartE2EDuration="21.835991071s" totalImagesPullingTime="19.331536042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 00:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:34:30.835482206 +0000 UTC m=+21.638305271" watchObservedRunningTime="2026-09-16 00:34:30.835991071 +0000 UTC m=+21.638814160"
Sep 16 00:34:30.852368 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.852316    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-16.ec2.internal" podStartSLOduration=20.852303163 podStartE2EDuration="20.852303163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 00:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:34:30.851648838 +0000 UTC m=+21.654471908" watchObservedRunningTime="2026-09-16 00:34:30.852303163 +0000 UTC m=+21.655126226"
Sep 16 00:34:30.864909 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.864846    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4k5j9" podStartSLOduration=2.82726399 podStartE2EDuration="21.864831087s" totalImagesPullingTime="19.037567097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 00:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:34:30.864089444 +0000 UTC m=+21.666912507" watchObservedRunningTime="2026-09-16 00:34:30.864831087 +0000 UTC m=+21.667654150"
Sep 16 00:34:30.878045 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.878001    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v77nk" podStartSLOduration=2.884969439 podStartE2EDuration="21.877984849s" totalImagesPullingTime="18.99301541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:34:30.877429782 +0000 UTC m=+21.680252849" watchObservedRunningTime="2026-09-16 00:34:30.877984849 +0000 UTC m=+21.680807912"
Sep 16 00:34:30.912662 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.912617    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7j7h6" podStartSLOduration=2.856246291 podStartE2EDuration="21.912602383s" totalImagesPullingTime="19.056356092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 00:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:34:30.912272951 +0000 UTC m=+21.715096013" watchObservedRunningTime="2026-09-16 00:34:30.912602383 +0000 UTC m=+21.715425445"
Sep 16 00:34:30.950911 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:30.950877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v77nk_cd912ef0-02c8-41a2-84cb-4567e72d85ab/konnectivity-agent/0.log" limit=1024
Sep 16 00:34:31.026208 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:31.026125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v77nk_cd912ef0-02c8-41a2-84cb-4567e72d85ab/konnectivity-agent/0.log" limit=1024
Sep 16 00:34:31.661776 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:31.661747    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:31.661937 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:31.661878    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:31.722205 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:31.722179    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 00:34:31.819560 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:31.819472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh" event={"ID":"3f540942-2af5-47b1-9686-2b8708bd002d","Type":"ContainerStarted","Data":"7e201289fcd90fbae209f0c73d4f75e87802d52812e92fca2ceeaf7c9e062e8d"}
Sep 16 00:34:31.820283 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:31.819566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh" event={"ID":"3f540942-2af5-47b1-9686-2b8708bd002d","Type":"ContainerStarted","Data":"34bdac01207207166bdf0fb7a5eb159b6bcb3df380385f72aa7299f8ee3bc655"}
Sep 16 00:34:31.821318 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:31.821286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq" event={"ID":"0543670a-aee2-4aaf-8cf1-d1d7e147c704","Type":"ContainerStarted","Data":"757746e5196e09db71be2101608003c4855bf9202820a167664c7ecd9f3229b4"}
Sep 16 00:34:31.822658 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:31.822629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t469h" event={"ID":"b40b3e38-4f5b-4743-8a7b-1fbfdc6d907f","Type":"ContainerStarted","Data":"310e427842c519b0685c3f79f82a3fed1a1162e3511b49f51603d60680ad6fb9"}
Sep 16 00:34:31.824501 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:31.824460    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal" event={"ID":"1fc0ab2a38bff369ebd41f0fa6d816a7","Type":"ContainerStarted","Data":"38cb222a7d21ecbbc512c34b7e8206f27e95354f958cb728c45aa9ccff860f80"}
Sep 16 00:34:31.838159 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:31.838113    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t469h" podStartSLOduration=7.562102919 podStartE2EDuration="22.838095384s" totalImagesPullingTime="15.275992465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 00:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:34:31.837567447 +0000 UTC m=+22.640390522" watchObservedRunningTime="2026-09-16 00:34:31.838095384 +0000 UTC m=+22.640918447"
Sep 16 00:34:31.852099 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:31.852056    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-16.ec2.internal" podStartSLOduration=21.852043685 podStartE2EDuration="21.852043685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 00:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:34:31.851595604 +0000 UTC m=+22.654418666" watchObservedRunningTime="2026-09-16 00:34:31.852043685 +0000 UTC m=+22.654866748"
Sep 16 00:34:31.963688 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:31.963641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v77nk_cd912ef0-02c8-41a2-84cb-4567e72d85ab/konnectivity-agent/0.log" limit=1024
Sep 16 00:34:32.015486 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:32.015452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v77nk_cd912ef0-02c8-41a2-84cb-4567e72d85ab/konnectivity-agent/0.log" limit=1024
Sep 16 00:34:32.212431 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:32.212399    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v77nk"
Sep 16 00:34:32.213109 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:32.213091    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v77nk"
Sep 16 00:34:32.593047 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:32.592889    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T00:34:31.722202398Z","UUID":"74476bff-4e69-4178-ace1-96a9dbe1ae16","Handler":null,"Name":"","Endpoint":""}
Sep 16 00:34:32.594424 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:32.594370    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 00:34:32.594424 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:32.594403    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 00:34:32.662152 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:32.662116    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:32.662330 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:32.662165    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:32.662330 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:32.662260    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:32.662444 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:32.662391    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:32.827660 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:32.827625    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v77nk"
Sep 16 00:34:32.828123 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:32.828106    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v77nk"
Sep 16 00:34:33.662189 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:33.661888    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:33.662339 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:33.662250    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:33.833377 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:33.833328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh" event={"ID":"3f540942-2af5-47b1-9686-2b8708bd002d","Type":"ContainerStarted","Data":"2c15fea43cceb2ba9583fdcde8e6f461b21be12e379da7cf4c4f97fc49f946e5"}
Sep 16 00:34:33.835796 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:33.835759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq" event={"ID":"0543670a-aee2-4aaf-8cf1-d1d7e147c704","Type":"ContainerStarted","Data":"9900b78b031357b6cf2363c5f63eae6eeb69e0cc3f09c0560519caca40a48626"}
Sep 16 00:34:33.851987 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:33.851925    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlnwq" podStartSLOduration=3.592928014 podStartE2EDuration="24.851905438s" totalImagesPullingTime="21.258977424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 00:34:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:34:33.851552121 +0000 UTC m=+24.654375183" watchObservedRunningTime="2026-09-16 00:34:33.851905438 +0000 UTC m=+24.654728502"
Sep 16 00:34:34.661786 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:34.661753    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:34.661786 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:34.661796    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:34.661982 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:34.661875    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:34.661982 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:34.661953    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:35.665886 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:35.665855    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:35.666238 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:35.665984    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:35.845071 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:35.845028    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh" event={"ID":"3f540942-2af5-47b1-9686-2b8708bd002d","Type":"ContainerStarted","Data":"5a5e44ea78cbbcb59d5bc4d4b5c4ddc199c80912d19836bc1236d3ea4947339a"}
Sep 16 00:34:35.845331 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:35.845310    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:35.863857 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:35.863683    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:35.867482 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:35.867441    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh" podStartSLOduration=7.850216814 podStartE2EDuration="26.867428034s" totalImagesPullingTime="19.01721122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 00:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:34:35.866236196 +0000 UTC m=+26.669059253" watchObservedRunningTime="2026-09-16 00:34:35.867428034 +0000 UTC m=+26.670251096"
Sep 16 00:34:36.661540 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:36.661514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:36.661540 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:36.661535    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:36.661798 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:36.661628    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:36.661798 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:36.661778    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:36.848463 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:36.848422    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:36.848927 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:36.848508    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:36.865968 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:36.865938    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:34:37.411784 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:37.411682    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-swcf8"]
Sep 16 00:34:37.411933 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:37.411867    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:37.412024 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:37.411973    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:37.412409 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:37.412387    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-87j7s"]
Sep 16 00:34:37.412498 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:37.412487    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:37.412591 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:37.412574    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:37.413783 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:37.413764    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6l74x"]
Sep 16 00:34:37.413882 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:37.413844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:37.413943 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:37.413922    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:38.611461 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:38.611435    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kgmhs_47514264-52fd-443e-9ba3-4bcb3f3717e5/dns-node-resolver/0.log"
Sep 16 00:34:38.661725 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:38.661693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:38.661899 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:38.661708    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:38.661899 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:38.661821    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:38.661899 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:38.661861    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:39.413315 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:39.413247    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4k5j9_e79a602a-4cd5-45e4-b7f5-0315498e7dda/node-ca/0.log"
Sep 16 00:34:39.664181 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:39.663125    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:39.664181 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:39.663307    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:39.857042 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:39.856841    2563 generic.go:356] "Generic (PLEG): container finished" podID="89e23aa3-969a-40ab-8ed1-8c1b7bb63199" containerID="45e5b7d856efee52e19d0ad28325bc4fee404a70db935256611e06b1f4bab73c" exitCode=0
Sep 16 00:34:39.857042 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:39.856916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7n9lz" event={"ID":"89e23aa3-969a-40ab-8ed1-8c1b7bb63199","Type":"ContainerDied","Data":"45e5b7d856efee52e19d0ad28325bc4fee404a70db935256611e06b1f4bab73c"}
Sep 16 00:34:40.662146 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:40.662113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:40.662294 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:40.662112    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:40.662294 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:40.662224    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:40.662372 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:40.662312    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:41.661413 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:41.661379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:41.661765 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:41.661493    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:41.863159 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:41.863082    2563 generic.go:356] "Generic (PLEG): container finished" podID="89e23aa3-969a-40ab-8ed1-8c1b7bb63199" containerID="4244880ec116a0871c105ccc1e9b325f5ca3503679d54d8f3abc0ead858b832d" exitCode=0
Sep 16 00:34:41.863159 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:41.863119    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7n9lz" event={"ID":"89e23aa3-969a-40ab-8ed1-8c1b7bb63199","Type":"ContainerDied","Data":"4244880ec116a0871c105ccc1e9b325f5ca3503679d54d8f3abc0ead858b832d"}
Sep 16 00:34:42.267961 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:42.267924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:42.268137 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:42.267970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:42.268137 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:42.268077    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:42.268137 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:42.268077    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:42.268238 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:42.268143    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs podName:2489af70-f6d9-4573-b417-a837382d7240 nodeName:}" failed. No retries permitted until 2026-09-16 00:35:14.268127854 +0000 UTC m=+65.070950899 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs") pod "network-metrics-daemon-87j7s" (UID: "2489af70-f6d9-4573-b417-a837382d7240") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 00:34:42.268238 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:42.268157    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret podName:ff05bc9e-4000-447e-ba95-1c553022a157 nodeName:}" failed. No retries permitted until 2026-09-16 00:35:14.268151307 +0000 UTC m=+65.070974348 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret") pod "global-pull-secret-syncer-6l74x" (UID: "ff05bc9e-4000-447e-ba95-1c553022a157") : object "kube-system"/"original-pull-secret" not registered
Sep 16 00:34:42.469173 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:42.469138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkppg\" (UniqueName: \"kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg\") pod \"network-check-target-swcf8\" (UID: \"f3291aad-6696-43d4-b082-eee2b95fef20\") " pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:42.469415 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:42.469306    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 00:34:42.469415 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:42.469325    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 00:34:42.469415 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:42.469335    2563 projected.go:196] Error preparing data for projected volume kube-api-access-nkppg for pod openshift-network-diagnostics/network-check-target-swcf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:42.469415 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:42.469388    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg podName:f3291aad-6696-43d4-b082-eee2b95fef20 nodeName:}" failed. No retries permitted until 2026-09-16 00:35:14.469371444 +0000 UTC m=+65.272194501 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkppg" (UniqueName: "kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg") pod "network-check-target-swcf8" (UID: "f3291aad-6696-43d4-b082-eee2b95fef20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 00:34:42.661888 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:42.661817    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:42.661888 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:42.661852    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:42.662307 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:42.661931    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:42.662307 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:42.662045    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:43.662131 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:43.662097    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:43.662766 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:43.662243    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:43.871123 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:43.871043    2563 generic.go:356] "Generic (PLEG): container finished" podID="89e23aa3-969a-40ab-8ed1-8c1b7bb63199" containerID="75cac39e21c3e250bf6611f4d5c15d3e6e794017e47b70d96f6e9ac65be4cc7c" exitCode=0
Sep 16 00:34:43.871123 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:43.871107    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7n9lz" event={"ID":"89e23aa3-969a-40ab-8ed1-8c1b7bb63199","Type":"ContainerDied","Data":"75cac39e21c3e250bf6611f4d5c15d3e6e794017e47b70d96f6e9ac65be4cc7c"}
Sep 16 00:34:44.661468 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:44.661433    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:44.661700 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:44.661433    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:44.661700 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:44.661562    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:44.661700 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:44.661599    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:45.662200 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:45.662166    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:45.662620 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:45.662306    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:46.661488 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:46.661447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:46.661488 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:46.661486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:46.661772 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:46.661596    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:46.661901 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:46.661876    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:47.661431 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:47.661401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:47.661882 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:47.661522    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:48.661197 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:48.661111    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:48.661328 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:48.661230    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:48.661328 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:48.661265    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:48.661398 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:48.661324    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:48.887122 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:48.887086    2563 generic.go:356] "Generic (PLEG): container finished" podID="89e23aa3-969a-40ab-8ed1-8c1b7bb63199" containerID="a6e15510d683ae95bd74f8615278d46142be404131f870d7ce942830e52a765b" exitCode=0
Sep 16 00:34:48.887594 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:48.887138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7n9lz" event={"ID":"89e23aa3-969a-40ab-8ed1-8c1b7bb63199","Type":"ContainerDied","Data":"a6e15510d683ae95bd74f8615278d46142be404131f870d7ce942830e52a765b"}
Sep 16 00:34:49.662075 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:49.662036    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:49.662273 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:49.662153    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:49.892964 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:49.892930    2563 generic.go:356] "Generic (PLEG): container finished" podID="89e23aa3-969a-40ab-8ed1-8c1b7bb63199" containerID="8b7db397f91aaeea9840c106e351308a8505335129739457dcece698b67c4321" exitCode=0
Sep 16 00:34:49.893344 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:49.892975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7n9lz" event={"ID":"89e23aa3-969a-40ab-8ed1-8c1b7bb63199","Type":"ContainerDied","Data":"8b7db397f91aaeea9840c106e351308a8505335129739457dcece698b67c4321"}
Sep 16 00:34:50.662151 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:50.662120    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:50.662151 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:50.662156    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:50.662387 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:50.662228    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:50.662446 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:50.662376    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:50.899272 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:50.899240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7n9lz" event={"ID":"89e23aa3-969a-40ab-8ed1-8c1b7bb63199","Type":"ContainerStarted","Data":"f3e7b4762c1ec9ca332ceaf9d7c6b55ccc6bcb7e86c94fcb88f3da0ab389ad36"}
Sep 16 00:34:50.918568 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:50.918467    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7n9lz" podStartSLOduration=8.099469039 podStartE2EDuration="41.918450396s" totalImagesPullingTime="33.818981357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 00:34:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:34:50.918207284 +0000 UTC m=+41.721030348" watchObservedRunningTime="2026-09-16 00:34:50.918450396 +0000 UTC m=+41.721273450"
Sep 16 00:34:51.661954 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:51.661919    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:51.662181 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:51.662035    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:52.661795 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:52.661763    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:52.662180 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:52.661764    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:52.662180 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:52.661865    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:52.662180 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:52.661953    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:53.661678 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:53.661633    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:53.661860 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:53.661760    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:54.661506 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:54.661478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:54.661506 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:54.661498    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:54.661727 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:54.661574    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:54.661727 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:54.661639    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:55.661557 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:55.661521    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:55.661944 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:55.661648    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:56.662084 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:56.662051    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:56.662465 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:56.662051    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:56.662465 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:56.662153    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6l74x" podUID="ff05bc9e-4000-447e-ba95-1c553022a157"
Sep 16 00:34:56.662465 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:56.662245    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-swcf8" podUID="f3291aad-6696-43d4-b082-eee2b95fef20"
Sep 16 00:34:57.662004 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:57.661974    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:57.662252 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:34:57.662097    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87j7s" podUID="2489af70-f6d9-4573-b417-a837382d7240"
Sep 16 00:34:58.004510 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.004485    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-16.ec2.internal" event="NodeReady"
Sep 16 00:34:58.004685 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.004615    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 00:34:58.057766 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.057733    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wxgq8"]
Sep 16 00:34:58.067420 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.067397    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-52jxz"]
Sep 16 00:34:58.067563 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.067525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wxgq8"
Sep 16 00:34:58.070198 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.070052    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cs9kq\""
Sep 16 00:34:58.070198 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.070059    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 00:34:58.070198 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.070059    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 00:34:58.070431 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.070406    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 00:34:58.079589 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.079565    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wxgq8"]
Sep 16 00:34:58.079778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.079599    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-52jxz"]
Sep 16 00:34:58.079778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.079708    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.081077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.081056    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m4czn"]
Sep 16 00:34:58.081999 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.081978    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 00:34:58.082081 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.082033    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 00:34:58.082272 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.082259    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rpgmh\""
Sep 16 00:34:58.096058 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.096040    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m4czn"]
Sep 16 00:34:58.096148 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.096134    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.098391 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.098375    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 00:34:58.098599 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.098578    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 00:34:58.098599 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.098594    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 00:34:58.098776 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.098600    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 00:34:58.098776 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.098605    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q4hl7\""
Sep 16 00:34:58.174718 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.174648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b682231-d5f5-4481-9da5-138e7d76fbaf-metrics-tls\") pod \"dns-default-52jxz\" (UID: \"0b682231-d5f5-4481-9da5-138e7d76fbaf\") " pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.174718 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.174722    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b682231-d5f5-4481-9da5-138e7d76fbaf-tmp-dir\") pod \"dns-default-52jxz\" (UID: \"0b682231-d5f5-4481-9da5-138e7d76fbaf\") " pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.174975 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.174745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed443896-245f-4066-8efd-543b1447e5da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.174975 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.174781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0b682231-d5f5-4481-9da5-138e7d76fbaf-config-volume\") pod \"dns-default-52jxz\" (UID: \"0b682231-d5f5-4481-9da5-138e7d76fbaf\") " pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.174975 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.174799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmg8b\" (UniqueName: \"kubernetes.io/projected/0b682231-d5f5-4481-9da5-138e7d76fbaf-kube-api-access-qmg8b\") pod \"dns-default-52jxz\" (UID: \"0b682231-d5f5-4481-9da5-138e7d76fbaf\") " pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.174975 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.174869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz7bw\" (UniqueName: \"kubernetes.io/projected/ed443896-245f-4066-8efd-543b1447e5da-kube-api-access-qz7bw\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.175102 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.174998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed443896-245f-4066-8efd-543b1447e5da-data-volume\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.175102 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.175038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21ad5167-f857-4a02-b688-250965430ad5-cert\") pod \"ingress-canary-wxgq8\" (UID: \"21ad5167-f857-4a02-b688-250965430ad5\") " pod="openshift-ingress-canary/ingress-canary-wxgq8"
Sep 16 00:34:58.175102 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.175075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed443896-245f-4066-8efd-543b1447e5da-crio-socket\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.175201 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.175112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6l4f\" (UniqueName: \"kubernetes.io/projected/21ad5167-f857-4a02-b688-250965430ad5-kube-api-access-k6l4f\") pod \"ingress-canary-wxgq8\" (UID: \"21ad5167-f857-4a02-b688-250965430ad5\") " pod="openshift-ingress-canary/ingress-canary-wxgq8"
Sep 16 00:34:58.175201 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.175163    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed443896-245f-4066-8efd-543b1447e5da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.275559 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed443896-245f-4066-8efd-543b1447e5da-data-volume\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.275559 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21ad5167-f857-4a02-b688-250965430ad5-cert\") pod \"ingress-canary-wxgq8\" (UID: \"21ad5167-f857-4a02-b688-250965430ad5\") " pod="openshift-ingress-canary/ingress-canary-wxgq8"
Sep 16 00:34:58.275559 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed443896-245f-4066-8efd-543b1447e5da-crio-socket\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.275863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6l4f\" (UniqueName: \"kubernetes.io/projected/21ad5167-f857-4a02-b688-250965430ad5-kube-api-access-k6l4f\") pod \"ingress-canary-wxgq8\" (UID: \"21ad5167-f857-4a02-b688-250965430ad5\") " pod="openshift-ingress-canary/ingress-canary-wxgq8"
Sep 16 00:34:58.275863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed443896-245f-4066-8efd-543b1447e5da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.275863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b682231-d5f5-4481-9da5-138e7d76fbaf-metrics-tls\") pod \"dns-default-52jxz\" (UID: \"0b682231-d5f5-4481-9da5-138e7d76fbaf\") " pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.275863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b682231-d5f5-4481-9da5-138e7d76fbaf-tmp-dir\") pod \"dns-default-52jxz\" (UID: \"0b682231-d5f5-4481-9da5-138e7d76fbaf\") " pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.275863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed443896-245f-4066-8efd-543b1447e5da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.275863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0b682231-d5f5-4481-9da5-138e7d76fbaf-config-volume\") pod \"dns-default-52jxz\" (UID: \"0b682231-d5f5-4481-9da5-138e7d76fbaf\") " pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.275863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmg8b\" (UniqueName: \"kubernetes.io/projected/0b682231-d5f5-4481-9da5-138e7d76fbaf-kube-api-access-qmg8b\") pod \"dns-default-52jxz\" (UID: \"0b682231-d5f5-4481-9da5-138e7d76fbaf\") " pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.275863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz7bw\" (UniqueName: \"kubernetes.io/projected/ed443896-245f-4066-8efd-543b1447e5da-kube-api-access-qz7bw\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.276218 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275921    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed443896-245f-4066-8efd-543b1447e5da-data-volume\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.276218 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.275981    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed443896-245f-4066-8efd-543b1447e5da-crio-socket\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.276218 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.276098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b682231-d5f5-4481-9da5-138e7d76fbaf-tmp-dir\") pod \"dns-default-52jxz\" (UID: \"0b682231-d5f5-4481-9da5-138e7d76fbaf\") " pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.276353 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.276284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed443896-245f-4066-8efd-543b1447e5da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.276353 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.276316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0b682231-d5f5-4481-9da5-138e7d76fbaf-config-volume\") pod \"dns-default-52jxz\" (UID: \"0b682231-d5f5-4481-9da5-138e7d76fbaf\") " pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.280161 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.280133    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0b682231-d5f5-4481-9da5-138e7d76fbaf-metrics-tls\") pod \"dns-default-52jxz\" (UID: \"0b682231-d5f5-4481-9da5-138e7d76fbaf\") " pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.280278 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.280142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed443896-245f-4066-8efd-543b1447e5da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.280278 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.280176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21ad5167-f857-4a02-b688-250965430ad5-cert\") pod \"ingress-canary-wxgq8\" (UID: \"21ad5167-f857-4a02-b688-250965430ad5\") " pod="openshift-ingress-canary/ingress-canary-wxgq8"
Sep 16 00:34:58.283216 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.283187    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz7bw\" (UniqueName: \"kubernetes.io/projected/ed443896-245f-4066-8efd-543b1447e5da-kube-api-access-qz7bw\") pod \"insights-runtime-extractor-m4czn\" (UID: \"ed443896-245f-4066-8efd-543b1447e5da\") " pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.283473 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.283454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6l4f\" (UniqueName: \"kubernetes.io/projected/21ad5167-f857-4a02-b688-250965430ad5-kube-api-access-k6l4f\") pod \"ingress-canary-wxgq8\" (UID: \"21ad5167-f857-4a02-b688-250965430ad5\") " pod="openshift-ingress-canary/ingress-canary-wxgq8"
Sep 16 00:34:58.283530 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.283509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmg8b\" (UniqueName: \"kubernetes.io/projected/0b682231-d5f5-4481-9da5-138e7d76fbaf-kube-api-access-qmg8b\") pod \"dns-default-52jxz\" (UID: \"0b682231-d5f5-4481-9da5-138e7d76fbaf\") " pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.378737 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.378709    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wxgq8"
Sep 16 00:34:58.388087 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.388053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-52jxz"
Sep 16 00:34:58.408213 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.408185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m4czn"
Sep 16 00:34:58.662002 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.661925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:34:58.662155 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.662121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:34:58.664843 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.664781    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wxgq8"]
Sep 16 00:34:58.665234 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.664898    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 00:34:58.665234 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.664916    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wgg7z\""
Sep 16 00:34:58.665234 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.664925    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 00:34:58.665498 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.665486    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 00:34:58.665576 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.665556    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-52jxz"]
Sep 16 00:34:58.668627 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:58.668605    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b682231_d5f5_4481_9da5_138e7d76fbaf.slice/crio-0a6eb0033af14304e43c026c2fcf49a6f01ce21b71e80bfb8f5c6f97b7292bc9 WatchSource:0}: Error finding container 0a6eb0033af14304e43c026c2fcf49a6f01ce21b71e80bfb8f5c6f97b7292bc9: Status 404 returned error can't find the container with id 0a6eb0033af14304e43c026c2fcf49a6f01ce21b71e80bfb8f5c6f97b7292bc9
Sep 16 00:34:58.669230 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:58.669207    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ad5167_f857_4a02_b688_250965430ad5.slice/crio-e26ed71e92276139131ead97e65b7790ac430ed5c30cbef2958cc8482590ddbd WatchSource:0}: Error finding container e26ed71e92276139131ead97e65b7790ac430ed5c30cbef2958cc8482590ddbd: Status 404 returned error can't find the container with id e26ed71e92276139131ead97e65b7790ac430ed5c30cbef2958cc8482590ddbd
Sep 16 00:34:58.700402 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.700370    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m4czn"]
Sep 16 00:34:58.705226 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:34:58.705202    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded443896_245f_4066_8efd_543b1447e5da.slice/crio-376e700c2c9ddfab400ec88121d221dd929c0ec5541cc991247d98c7b97fb83f WatchSource:0}: Error finding container 376e700c2c9ddfab400ec88121d221dd929c0ec5541cc991247d98c7b97fb83f: Status 404 returned error can't find the container with id 376e700c2c9ddfab400ec88121d221dd929c0ec5541cc991247d98c7b97fb83f
Sep 16 00:34:58.919787 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.919693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m4czn" event={"ID":"ed443896-245f-4066-8efd-543b1447e5da","Type":"ContainerStarted","Data":"6b7e68a682330f8dcf3e19d6baa8cc07459800a559f2d47eae164bc6f5e7197d"}
Sep 16 00:34:58.919787 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.919754    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m4czn" event={"ID":"ed443896-245f-4066-8efd-543b1447e5da","Type":"ContainerStarted","Data":"376e700c2c9ddfab400ec88121d221dd929c0ec5541cc991247d98c7b97fb83f"}
Sep 16 00:34:58.920717 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.920693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-52jxz" event={"ID":"0b682231-d5f5-4481-9da5-138e7d76fbaf","Type":"ContainerStarted","Data":"0a6eb0033af14304e43c026c2fcf49a6f01ce21b71e80bfb8f5c6f97b7292bc9"}
Sep 16 00:34:58.921757 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:58.921739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wxgq8" event={"ID":"21ad5167-f857-4a02-b688-250965430ad5","Type":"ContainerStarted","Data":"e26ed71e92276139131ead97e65b7790ac430ed5c30cbef2958cc8482590ddbd"}
Sep 16 00:34:59.662767 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:59.662684    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:34:59.666011 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:59.665982    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g7jvk\""
Sep 16 00:34:59.666385 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:59.666223    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 00:34:59.928880 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:34:59.928756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m4czn" event={"ID":"ed443896-245f-4066-8efd-543b1447e5da","Type":"ContainerStarted","Data":"4e65b119b23ac885da37516c56619eeefb1454ce830449d06640ad2de09f437a"}
Sep 16 00:35:01.939680 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:01.939573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m4czn" event={"ID":"ed443896-245f-4066-8efd-543b1447e5da","Type":"ContainerStarted","Data":"684cdb1ed64ff95f031d11bfee92d57a4a5571a447f3abed1b6a788c69ef707f"}
Sep 16 00:35:01.941510 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:01.941485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-52jxz" event={"ID":"0b682231-d5f5-4481-9da5-138e7d76fbaf","Type":"ContainerStarted","Data":"3a9d598b7ab82902b4e73ca447bb345452052aebab6933677c4937f6745d576e"}
Sep 16 00:35:01.941660 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:01.941526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-52jxz" event={"ID":"0b682231-d5f5-4481-9da5-138e7d76fbaf","Type":"ContainerStarted","Data":"2f4e33cc8a0603e14fd7c614c74fd62e6666c6b0124dbc4f62c5439e274f6140"}
Sep 16 00:35:01.941660 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:01.941549    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-52jxz"
Sep 16 00:35:01.945164 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:01.945138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wxgq8" event={"ID":"21ad5167-f857-4a02-b688-250965430ad5","Type":"ContainerStarted","Data":"28686b0e0c3ec42986b48186e0fdd14a050c9bf52f0d52b3b1aad4c667b2bf26"}
Sep 16 00:35:01.983716 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:01.983642    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m4czn" podStartSLOduration=1.233581682 podStartE2EDuration="3.983628076s" totalImagesPullingTime="2.750046394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 00:34:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:01.983094495 +0000 UTC m=+52.785917559" watchObservedRunningTime="2026-09-16 00:35:01.983628076 +0000 UTC m=+52.786451139"
Sep 16 00:35:01.997145 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:01.997100    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wxgq8" podStartSLOduration=1.070618096 podStartE2EDuration="3.997086846s" totalImagesPullingTime="2.92646875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:01.996554662 +0000 UTC m=+52.799377724" watchObservedRunningTime="2026-09-16 00:35:01.997086846 +0000 UTC m=+52.799909905"
Sep 16 00:35:02.011643 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:02.011602    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-52jxz" podStartSLOduration=1.093154667 podStartE2EDuration="4.011585122s" totalImagesPullingTime="2.918430455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:02.010638111 +0000 UTC m=+52.813461176" watchObservedRunningTime="2026-09-16 00:35:02.011585122 +0000 UTC m=+52.814408190"
Sep 16 00:35:06.530723 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.530685    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c54dc9cfd-89nvz"]
Sep 16 00:35:06.533073 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.533056    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.535117 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.535090    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 00:35:06.535117 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.535091    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 00:35:06.535771 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.535748    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 00:35:06.535883 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.535777    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 00:35:06.536018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.535990    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 00:35:06.536115 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.536088    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 00:35:06.536182 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.536174    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 00:35:06.536288 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.536271    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fwwz4\""
Sep 16 00:35:06.543200 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.543181    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c54dc9cfd-89nvz"]
Sep 16 00:35:06.633970 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.633929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-oauth-config\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.633970 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.633971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-config\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.634191 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.633990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-oauth-serving-cert\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.634191 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.634058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxzfd\" (UniqueName: \"kubernetes.io/projected/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-kube-api-access-mxzfd\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.634191 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.634097    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-service-ca\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.634191 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.634131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-serving-cert\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.735077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.735047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-oauth-config\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.735077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.735080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-config\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.735335 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.735096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-oauth-serving-cert\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.735335 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.735117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxzfd\" (UniqueName: \"kubernetes.io/projected/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-kube-api-access-mxzfd\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.735335 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.735236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-service-ca\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.735335 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.735286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-serving-cert\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.735890 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.735808    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-oauth-serving-cert\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.735890 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.735887    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-config\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.735890 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.735939    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-service-ca\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.737635 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.737612    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-oauth-config\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.737756 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.737739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-serving-cert\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.742598 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.742571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxzfd\" (UniqueName: \"kubernetes.io/projected/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-kube-api-access-mxzfd\") pod \"console-c54dc9cfd-89nvz\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") " pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:06.841738 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:06.841631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:07.107465 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:07.107369    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c54dc9cfd-89nvz"]
Sep 16 00:35:07.111400 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:35:07.111367    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4074e67_696a_4ef3_abd0_ac4fa4cbbe1e.slice/crio-2ca28e9162c17e49774e5e9546c5b9b2e8fe341316aab9330e972521a2088d8e WatchSource:0}: Error finding container 2ca28e9162c17e49774e5e9546c5b9b2e8fe341316aab9330e972521a2088d8e: Status 404 returned error can't find the container with id 2ca28e9162c17e49774e5e9546c5b9b2e8fe341316aab9330e972521a2088d8e
Sep 16 00:35:07.964819 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:07.964784    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c54dc9cfd-89nvz" event={"ID":"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e","Type":"ContainerStarted","Data":"2ca28e9162c17e49774e5e9546c5b9b2e8fe341316aab9330e972521a2088d8e"}
Sep 16 00:35:08.866555 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:08.863731    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xjfsh"
Sep 16 00:35:10.178218 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.178182    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p"]
Sep 16 00:35:10.189499 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.189469    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p"]
Sep 16 00:35:10.189660 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.189583    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p"
Sep 16 00:35:10.191571 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.191537    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-65bnb\""
Sep 16 00:35:10.191716 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.191575    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 16 00:35:10.362264 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.362232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/70653cdb-96b6-49fa-9926-f3f500823bf7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-pdd4p\" (UID: \"70653cdb-96b6-49fa-9926-f3f500823bf7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p"
Sep 16 00:35:10.463131 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.463090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/70653cdb-96b6-49fa-9926-f3f500823bf7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-pdd4p\" (UID: \"70653cdb-96b6-49fa-9926-f3f500823bf7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p"
Sep 16 00:35:10.465716 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.465696    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/70653cdb-96b6-49fa-9926-f3f500823bf7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-pdd4p\" (UID: \"70653cdb-96b6-49fa-9926-f3f500823bf7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p"
Sep 16 00:35:10.499037 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.498985    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p"
Sep 16 00:35:10.775595 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.775517    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p"]
Sep 16 00:35:10.779277 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:35:10.779245    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70653cdb_96b6_49fa_9926_f3f500823bf7.slice/crio-fbecfde735e77fc692918851399224e6e21e8ea8765beab64b41e34b6d742f30 WatchSource:0}: Error finding container fbecfde735e77fc692918851399224e6e21e8ea8765beab64b41e34b6d742f30: Status 404 returned error can't find the container with id fbecfde735e77fc692918851399224e6e21e8ea8765beab64b41e34b6d742f30
Sep 16 00:35:10.977103 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.977037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c54dc9cfd-89nvz" event={"ID":"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e","Type":"ContainerStarted","Data":"37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8"}
Sep 16 00:35:10.978381 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.978348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p" event={"ID":"70653cdb-96b6-49fa-9926-f3f500823bf7","Type":"ContainerStarted","Data":"fbecfde735e77fc692918851399224e6e21e8ea8765beab64b41e34b6d742f30"}
Sep 16 00:35:10.997774 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:10.997711    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c54dc9cfd-89nvz" podStartSLOduration=1.867757414 podStartE2EDuration="4.997692868s" totalImagesPullingTime="3.129935454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:10.997232467 +0000 UTC m=+61.800055531" watchObservedRunningTime="2026-09-16 00:35:10.997692868 +0000 UTC m=+61.800515927"
Sep 16 00:35:11.950628 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:11.950600    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-52jxz"
Sep 16 00:35:12.986601 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:12.986567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p" event={"ID":"70653cdb-96b6-49fa-9926-f3f500823bf7","Type":"ContainerStarted","Data":"bb3af702bf62cb3a9a379b44e8c87e3e84fa32adc961b7975834d9c100583d6f"}
Sep 16 00:35:12.987077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:12.986786    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p"
Sep 16 00:35:12.991473 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:12.991445    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p"
Sep 16 00:35:13.001038 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.000991    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-pdd4p" podStartSLOduration=1.8285163789999999 podStartE2EDuration="3.000975741s" totalImagesPullingTime="1.172459362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:12.999478348 +0000 UTC m=+63.802301412" watchObservedRunningTime="2026-09-16 00:35:13.000975741 +0000 UTC m=+63.803798804"
Sep 16 00:35:13.097482 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.097449    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65f7bf6bbb-khx2m"]
Sep 16 00:35:13.099589 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.099572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.105870 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.105844    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 00:35:13.110452 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.110418    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f7bf6bbb-khx2m"]
Sep 16 00:35:13.289220 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.289127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b46b7fb0-5666-4eda-82fd-e90754251a78-console-serving-cert\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.289220 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.289178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-console-config\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.289220 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.289206    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-oauth-serving-cert\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.289431 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.289276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b46b7fb0-5666-4eda-82fd-e90754251a78-console-oauth-config\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.289431 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.289340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kbgd\" (UniqueName: \"kubernetes.io/projected/b46b7fb0-5666-4eda-82fd-e90754251a78-kube-api-access-8kbgd\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.289431 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.289364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-trusted-ca-bundle\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.289431 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.289393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-service-ca\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.389735 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.389694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b46b7fb0-5666-4eda-82fd-e90754251a78-console-oauth-config\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.389878 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.389751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kbgd\" (UniqueName: \"kubernetes.io/projected/b46b7fb0-5666-4eda-82fd-e90754251a78-kube-api-access-8kbgd\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.389878 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.389771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-trusted-ca-bundle\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.389878 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.389799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-service-ca\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.389878 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.389835    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b46b7fb0-5666-4eda-82fd-e90754251a78-console-serving-cert\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.389878 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.389864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-console-config\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.390146 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.389890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-oauth-serving-cert\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.390733 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.390708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-oauth-serving-cert\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.390860 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.390708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-service-ca\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.390979 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.390900    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-trusted-ca-bundle\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.390979 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.390930    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-console-config\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.392356 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.392323    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b46b7fb0-5666-4eda-82fd-e90754251a78-console-oauth-config\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.392448 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.392424    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b46b7fb0-5666-4eda-82fd-e90754251a78-console-serving-cert\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.397331 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.397308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kbgd\" (UniqueName: \"kubernetes.io/projected/b46b7fb0-5666-4eda-82fd-e90754251a78-kube-api-access-8kbgd\") pod \"console-65f7bf6bbb-khx2m\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") " pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.409035 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.409000    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:13.680972 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.680900    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f7bf6bbb-khx2m"]
Sep 16 00:35:13.683835 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:35:13.683807    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46b7fb0_5666_4eda_82fd_e90754251a78.slice/crio-24a32f7657b1826a8dba0e1c7936cb8ed3134d4f5c566f0f599838667478f96c WatchSource:0}: Error finding container 24a32f7657b1826a8dba0e1c7936cb8ed3134d4f5c566f0f599838667478f96c: Status 404 returned error can't find the container with id 24a32f7657b1826a8dba0e1c7936cb8ed3134d4f5c566f0f599838667478f96c
Sep 16 00:35:13.991241 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.991204    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f7bf6bbb-khx2m" event={"ID":"b46b7fb0-5666-4eda-82fd-e90754251a78","Type":"ContainerStarted","Data":"5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f"}
Sep 16 00:35:13.991241 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:13.991250    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f7bf6bbb-khx2m" event={"ID":"b46b7fb0-5666-4eda-82fd-e90754251a78","Type":"ContainerStarted","Data":"24a32f7657b1826a8dba0e1c7936cb8ed3134d4f5c566f0f599838667478f96c"}
Sep 16 00:35:14.006113 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.006056    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65f7bf6bbb-khx2m" podStartSLOduration=1.006040048 podStartE2EDuration="1.006040048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:14.005713678 +0000 UTC m=+64.808536740" watchObservedRunningTime="2026-09-16 00:35:14.006040048 +0000 UTC m=+64.808863155"
Sep 16 00:35:14.297895 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.297785    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:35:14.297895 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.297850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:35:14.300040 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.300019    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 00:35:14.300162 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.300019    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 00:35:14.310924 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.310892    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2489af70-f6d9-4573-b417-a837382d7240-metrics-certs\") pod \"network-metrics-daemon-87j7s\" (UID: \"2489af70-f6d9-4573-b417-a837382d7240\") " pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:35:14.311039 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.310956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff05bc9e-4000-447e-ba95-1c553022a157-original-pull-secret\") pod \"global-pull-secret-syncer-6l74x\" (UID: \"ff05bc9e-4000-447e-ba95-1c553022a157\") " pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:35:14.375993 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.375965    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g7jvk\""
Sep 16 00:35:14.384483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.384463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87j7s"
Sep 16 00:35:14.499110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.499066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkppg\" (UniqueName: \"kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg\") pod \"network-check-target-swcf8\" (UID: \"f3291aad-6696-43d4-b082-eee2b95fef20\") " pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:35:14.501793 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.501768    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 00:35:14.511045 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.511021    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 00:35:14.523017 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.522990    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkppg\" (UniqueName: \"kubernetes.io/projected/f3291aad-6696-43d4-b082-eee2b95fef20-kube-api-access-nkppg\") pod \"network-check-target-swcf8\" (UID: \"f3291aad-6696-43d4-b082-eee2b95fef20\") " pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:35:14.576485 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.576402    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wgg7z\""
Sep 16 00:35:14.579927 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.579910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6l74x"
Sep 16 00:35:14.585345 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.585316    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:35:14.654207 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.654044    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-87j7s"]
Sep 16 00:35:14.657207 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:35:14.657184    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2489af70_f6d9_4573_b417_a837382d7240.slice/crio-363f1c9ff6d8eacf61083d753a11adc514730ad99f8261c5c7c4525f91d59373 WatchSource:0}: Error finding container 363f1c9ff6d8eacf61083d753a11adc514730ad99f8261c5c7c4525f91d59373: Status 404 returned error can't find the container with id 363f1c9ff6d8eacf61083d753a11adc514730ad99f8261c5c7c4525f91d59373
Sep 16 00:35:14.850370 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.850285    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6l74x"]
Sep 16 00:35:14.853122 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:35:14.853094    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff05bc9e_4000_447e_ba95_1c553022a157.slice/crio-f52bb7da1c07342b6b8140b53ffa9345136f6bc14c0833aab8c4167a54f79692 WatchSource:0}: Error finding container f52bb7da1c07342b6b8140b53ffa9345136f6bc14c0833aab8c4167a54f79692: Status 404 returned error can't find the container with id f52bb7da1c07342b6b8140b53ffa9345136f6bc14c0833aab8c4167a54f79692
Sep 16 00:35:14.856249 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.856222    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-swcf8"]
Sep 16 00:35:14.859095 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:35:14.859071    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3291aad_6696_43d4_b082_eee2b95fef20.slice/crio-d421fa1c3107d098f111586f2e1e52538078205849e0b76407e24a8c948fa23c WatchSource:0}: Error finding container d421fa1c3107d098f111586f2e1e52538078205849e0b76407e24a8c948fa23c: Status 404 returned error can't find the container with id d421fa1c3107d098f111586f2e1e52538078205849e0b76407e24a8c948fa23c
Sep 16 00:35:14.995468 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.995420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6l74x" event={"ID":"ff05bc9e-4000-447e-ba95-1c553022a157","Type":"ContainerStarted","Data":"f52bb7da1c07342b6b8140b53ffa9345136f6bc14c0833aab8c4167a54f79692"}
Sep 16 00:35:14.996714 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.996688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-swcf8" event={"ID":"f3291aad-6696-43d4-b082-eee2b95fef20","Type":"ContainerStarted","Data":"d421fa1c3107d098f111586f2e1e52538078205849e0b76407e24a8c948fa23c"}
Sep 16 00:35:14.997842 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:14.997818    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-87j7s" event={"ID":"2489af70-f6d9-4573-b417-a837382d7240","Type":"ContainerStarted","Data":"363f1c9ff6d8eacf61083d753a11adc514730ad99f8261c5c7c4525f91d59373"}
Sep 16 00:35:16.841884 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:16.841842    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:16.842301 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:16.841954    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:16.848159 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:16.848134    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:17.009579 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:17.009539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-87j7s" event={"ID":"2489af70-f6d9-4573-b417-a837382d7240","Type":"ContainerStarted","Data":"dbc9cccfd0ab11f906ea9fb8bea0301de6ae0b522b95b9b3e3203bf25c6bbab8"}
Sep 16 00:35:17.009909 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:17.009608    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-87j7s" event={"ID":"2489af70-f6d9-4573-b417-a837382d7240","Type":"ContainerStarted","Data":"1908aad9f883b9d5db1da8ff15594d61732817c7ec645f29ef25fdb15914d24c"}
Sep 16 00:35:17.015082 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:17.015055    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:17.025590 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:17.025532    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-87j7s" podStartSLOduration=66.648841275 podStartE2EDuration="1m8.025512027s" totalImagesPullingTime="1.376670752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:17.024305995 +0000 UTC m=+67.827129062" watchObservedRunningTime="2026-09-16 00:35:17.025512027 +0000 UTC m=+67.828335091"
Sep 16 00:35:18.620554 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.620524    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n9wfd"]
Sep 16 00:35:18.623760 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.623726    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.626168 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.626143    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 00:35:18.626168 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.626165    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 00:35:18.626359 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.626164    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 00:35:18.626359 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.626151    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 00:35:18.626971 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.626946    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f98b9\""
Sep 16 00:35:18.627101 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.627038    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 00:35:18.627164 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.627137    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 00:35:18.630620 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.630597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-wtmp\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.630742 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.630642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e562619d-ddd7-47cc-8d6a-14735e687b60-metrics-client-ca\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.630742 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.630706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e562619d-ddd7-47cc-8d6a-14735e687b60-sys\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.630859 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.630772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.630859 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.630806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e562619d-ddd7-47cc-8d6a-14735e687b60-root\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.630965 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.630871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-tls\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.630965 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.630905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t7gc\" (UniqueName: \"kubernetes.io/projected/e562619d-ddd7-47cc-8d6a-14735e687b60-kube-api-access-5t7gc\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.630965 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.630941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-textfile\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.631114 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.631020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.731580 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.731546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.731805 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.731589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-wtmp\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.731805 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.731611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e562619d-ddd7-47cc-8d6a-14735e687b60-metrics-client-ca\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.731805 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.731633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e562619d-ddd7-47cc-8d6a-14735e687b60-sys\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.731805 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.731718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e562619d-ddd7-47cc-8d6a-14735e687b60-sys\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.731805 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.731769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.731805 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.731792    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-wtmp\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.731805 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.731805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e562619d-ddd7-47cc-8d6a-14735e687b60-root\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.732161 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.731857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-tls\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.732161 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.731862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e562619d-ddd7-47cc-8d6a-14735e687b60-root\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.732161 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.731892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t7gc\" (UniqueName: \"kubernetes.io/projected/e562619d-ddd7-47cc-8d6a-14735e687b60-kube-api-access-5t7gc\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.732161 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.731921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-textfile\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.732368 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.732183    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-textfile\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.732368 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.732252    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e562619d-ddd7-47cc-8d6a-14735e687b60-metrics-client-ca\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.732368 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.732287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.734569 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.734543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-tls\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.734820 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.734801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e562619d-ddd7-47cc-8d6a-14735e687b60-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.741051 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.741027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t7gc\" (UniqueName: \"kubernetes.io/projected/e562619d-ddd7-47cc-8d6a-14735e687b60-kube-api-access-5t7gc\") pod \"node-exporter-n9wfd\" (UID: \"e562619d-ddd7-47cc-8d6a-14735e687b60\") " pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:18.934213 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:18.934127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n9wfd"
Sep 16 00:35:19.660488 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.660456    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 00:35:19.664210 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.664185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.666615 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.666457    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 16 00:35:19.666615 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.666459    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 16 00:35:19.666615 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.666460    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 16 00:35:19.666615 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.666532    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 16 00:35:19.666615 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.666593    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 16 00:35:19.666999 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.666867    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 16 00:35:19.666999 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.666902    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 16 00:35:19.666999 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.666919    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 16 00:35:19.666999 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.666948    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 16 00:35:19.666999 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.666903    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qf5xd\""
Sep 16 00:35:19.680096 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.680070    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 00:35:19.739448 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-config-volume\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.739448 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739459    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.739751 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.739751 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.739751 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.739751 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.739751 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739632    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.739751 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.739751 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dtzq\" (UniqueName: \"kubernetes.io/projected/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-kube-api-access-9dtzq\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.740059 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.740059 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-config-out\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.740059 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.740059 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.739937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-web-config\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841216 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-config-volume\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841216 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtzq\" (UniqueName: \"kubernetes.io/projected/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-kube-api-access-9dtzq\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841933 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-config-out\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841933 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841933 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841548    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-web-config\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.841933 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.841759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.842609 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.842579    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.842931 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:35:19.842787    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-alertmanager-trusted-ca-bundle podName:d21ea078-1e76-4528-a5a1-6a1a3b1b2803 nodeName:}" failed. No retries permitted until 2026-09-16 00:35:20.342767082 +0000 UTC m=+71.145590127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "d21ea078-1e76-4528-a5a1-6a1a3b1b2803") : configmap references non-existent config key: ca-bundle.crt
Sep 16 00:35:19.844600 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.844551    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-config-volume\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.845166 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.845116    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-web-config\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.845945 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.845899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.846038 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.846005    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.846165 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.846143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.846484 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.846457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-config-out\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.846828 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.846800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.846828 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.846818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.847387 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.847367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:19.854587 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:19.854560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dtzq\" (UniqueName: \"kubernetes.io/projected/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-kube-api-access-9dtzq\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:20.038404 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:35:20.038380    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode562619d_ddd7_47cc_8d6a_14735e687b60.slice/crio-e84ec13b431c966916c4ccb9769bfa628fd4206a79f303b7735085fdecd96b28 WatchSource:0}: Error finding container e84ec13b431c966916c4ccb9769bfa628fd4206a79f303b7735085fdecd96b28: Status 404 returned error can't find the container with id e84ec13b431c966916c4ccb9769bfa628fd4206a79f303b7735085fdecd96b28
Sep 16 00:35:20.344571 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:20.344477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:20.345238 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:20.345219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21ea078-1e76-4528-a5a1-6a1a3b1b2803-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d21ea078-1e76-4528-a5a1-6a1a3b1b2803\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:20.575968 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:20.575925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 00:35:20.856864 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:20.856841    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 00:35:20.859079 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:35:20.859053    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21ea078_1e76_4528_a5a1_6a1a3b1b2803.slice/crio-3b1d94ca1f883a2a6ef78c38089818bd4ae29d6f85582364eabe98c8e7525e27 WatchSource:0}: Error finding container 3b1d94ca1f883a2a6ef78c38089818bd4ae29d6f85582364eabe98c8e7525e27: Status 404 returned error can't find the container with id 3b1d94ca1f883a2a6ef78c38089818bd4ae29d6f85582364eabe98c8e7525e27
Sep 16 00:35:21.030012 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.029970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6l74x" event={"ID":"ff05bc9e-4000-447e-ba95-1c553022a157","Type":"ContainerStarted","Data":"3ade5a99e17ce95d13e10e473063b208b3e4a2dd1fe899b6f724db69d2701155"}
Sep 16 00:35:21.031361 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.031333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d21ea078-1e76-4528-a5a1-6a1a3b1b2803","Type":"ContainerStarted","Data":"3b1d94ca1f883a2a6ef78c38089818bd4ae29d6f85582364eabe98c8e7525e27"}
Sep 16 00:35:21.032879 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.032857    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-swcf8" event={"ID":"f3291aad-6696-43d4-b082-eee2b95fef20","Type":"ContainerStarted","Data":"b3cbe4fe621037d45f4e109a388bd748ac0bba447e0213e31db8e95d20c3123f"}
Sep 16 00:35:21.033011 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.032958    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:35:21.034262 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.034239    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9wfd" event={"ID":"e562619d-ddd7-47cc-8d6a-14735e687b60","Type":"ContainerStarted","Data":"e84ec13b431c966916c4ccb9769bfa628fd4206a79f303b7735085fdecd96b28"}
Sep 16 00:35:21.046332 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.046271    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6l74x" podStartSLOduration=66.84989184 podStartE2EDuration="1m12.046253006s" totalImagesPullingTime="5.196361166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 00:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:21.045751514 +0000 UTC m=+71.848574577" watchObservedRunningTime="2026-09-16 00:35:21.046253006 +0000 UTC m=+71.849076064"
Sep 16 00:35:21.067045 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.066985    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-swcf8" podStartSLOduration=66.888445192 podStartE2EDuration="1m12.066968157s" totalImagesPullingTime="5.178522965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:21.065644298 +0000 UTC m=+71.868467361" watchObservedRunningTime="2026-09-16 00:35:21.066968157 +0000 UTC m=+71.869791220"
Sep 16 00:35:21.685086 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.685051    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"]
Sep 16 00:35:21.720610 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.720576    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"]
Sep 16 00:35:21.720748 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.720735    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.723576 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.723551    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cpln6\""
Sep 16 00:35:21.723830 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.723811    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 16 00:35:21.723946 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.723883    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 16 00:35:21.724032 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.724005    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 16 00:35:21.724142 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.724100    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b5jsksgth2bj6\""
Sep 16 00:35:21.724142 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.724119    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 16 00:35:21.724389 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.724369    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 16 00:35:21.753965 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.753938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/169e1119-441a-409d-8572-e40ba2a8e3f6-metrics-client-ca\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.754078 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.753986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.754078 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.754025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2z64\" (UniqueName: \"kubernetes.io/projected/169e1119-441a-409d-8572-e40ba2a8e3f6-kube-api-access-h2z64\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.754195 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.754115    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.754195 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.754151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.754288 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.754201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-tls\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.754288 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.754262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.754429 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.754290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-grpc-tls\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.854968 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.854926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.855163 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.854985    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-grpc-tls\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.855163 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.855027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/169e1119-441a-409d-8572-e40ba2a8e3f6-metrics-client-ca\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.855163 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.855059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.855163 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.855095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2z64\" (UniqueName: \"kubernetes.io/projected/169e1119-441a-409d-8572-e40ba2a8e3f6-kube-api-access-h2z64\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.855163 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.855130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.855163 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.855152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.855477 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.855196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-tls\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.856403 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.856356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/169e1119-441a-409d-8572-e40ba2a8e3f6-metrics-client-ca\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.858562 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.858531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.858947 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.858866    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.859364 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.859326    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-grpc-tls\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.859953 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.859904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.860302 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.860276    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.861780 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.861755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/169e1119-441a-409d-8572-e40ba2a8e3f6-secret-thanos-querier-tls\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:21.863318 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:21.863292    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2z64\" (UniqueName: \"kubernetes.io/projected/169e1119-441a-409d-8572-e40ba2a8e3f6-kube-api-access-h2z64\") pod \"thanos-querier-75c9dc99d8-qqfzs\" (UID: \"169e1119-441a-409d-8572-e40ba2a8e3f6\") " pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:22.032333 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.032296    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:22.040865 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.040830    2563 generic.go:356] "Generic (PLEG): container finished" podID="e562619d-ddd7-47cc-8d6a-14735e687b60" containerID="ad104a7ca5e4db9d6f203cb00b3406ce440c8ace1414c4ba7b55ffe19533cba8" exitCode=0
Sep 16 00:35:22.041021 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.040923    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9wfd" event={"ID":"e562619d-ddd7-47cc-8d6a-14735e687b60","Type":"ContainerDied","Data":"ad104a7ca5e4db9d6f203cb00b3406ce440c8ace1414c4ba7b55ffe19533cba8"}
Sep 16 00:35:22.589005 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.588979    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"]
Sep 16 00:35:22.591688 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:35:22.591643    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169e1119_441a_409d_8572_e40ba2a8e3f6.slice/crio-abaa18f4757534e6119423dc6c6f796a09df87584f96bb71f645a8297abf1631 WatchSource:0}: Error finding container abaa18f4757534e6119423dc6c6f796a09df87584f96bb71f645a8297abf1631: Status 404 returned error can't find the container with id abaa18f4757534e6119423dc6c6f796a09df87584f96bb71f645a8297abf1631
Sep 16 00:35:22.934278 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.934205    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-758f9c44f-vbc4h"]
Sep 16 00:35:22.937403 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.937386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:22.939701 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.939656    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 16 00:35:22.940015 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.939994    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 16 00:35:22.940066 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.940031    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 16 00:35:22.940066 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.940039    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 16 00:35:22.941323 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.940928    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5dsejhq1799vg\""
Sep 16 00:35:22.941323 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.941306    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6jkzw\""
Sep 16 00:35:22.946943 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.946917    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-758f9c44f-vbc4h"]
Sep 16 00:35:22.963199 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.963168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/436485ec-b65c-4d7d-b1af-59d4b5219d4e-secret-metrics-server-tls\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:22.963322 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.963230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llb5s\" (UniqueName: \"kubernetes.io/projected/436485ec-b65c-4d7d-b1af-59d4b5219d4e-kube-api-access-llb5s\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:22.963322 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.963251    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/436485ec-b65c-4d7d-b1af-59d4b5219d4e-client-ca-bundle\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:22.963322 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.963267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/436485ec-b65c-4d7d-b1af-59d4b5219d4e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:22.963322 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.963297    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/436485ec-b65c-4d7d-b1af-59d4b5219d4e-secret-metrics-server-client-certs\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:22.963462 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.963363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/436485ec-b65c-4d7d-b1af-59d4b5219d4e-metrics-server-audit-profiles\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:22.963462 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:22.963424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/436485ec-b65c-4d7d-b1af-59d4b5219d4e-audit-log\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.045678 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.045629    2563 generic.go:356] "Generic (PLEG): container finished" podID="d21ea078-1e76-4528-a5a1-6a1a3b1b2803" containerID="c2764f0dcd9624c14853514716e7653cd5dddc5ca065627de2870b9cb5a75034" exitCode=0
Sep 16 00:35:23.045859 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.045714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d21ea078-1e76-4528-a5a1-6a1a3b1b2803","Type":"ContainerDied","Data":"c2764f0dcd9624c14853514716e7653cd5dddc5ca065627de2870b9cb5a75034"}
Sep 16 00:35:23.047134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.047106    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs" event={"ID":"169e1119-441a-409d-8572-e40ba2a8e3f6","Type":"ContainerStarted","Data":"abaa18f4757534e6119423dc6c6f796a09df87584f96bb71f645a8297abf1631"}
Sep 16 00:35:23.049493 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.049471    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9wfd" event={"ID":"e562619d-ddd7-47cc-8d6a-14735e687b60","Type":"ContainerStarted","Data":"e02eae9f774125c60068b1695cfe95cd65d7ab1fc169c4a65a24669cbf330340"}
Sep 16 00:35:23.049594 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.049510    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9wfd" event={"ID":"e562619d-ddd7-47cc-8d6a-14735e687b60","Type":"ContainerStarted","Data":"e241a5205f17efbeceb3f6e230eb363930557595b07b0cfe28ad4c1d3f8f7132"}
Sep 16 00:35:23.064766 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.064742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llb5s\" (UniqueName: \"kubernetes.io/projected/436485ec-b65c-4d7d-b1af-59d4b5219d4e-kube-api-access-llb5s\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.064873 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.064771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/436485ec-b65c-4d7d-b1af-59d4b5219d4e-client-ca-bundle\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.064873 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.064806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/436485ec-b65c-4d7d-b1af-59d4b5219d4e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.064873 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.064832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/436485ec-b65c-4d7d-b1af-59d4b5219d4e-secret-metrics-server-client-certs\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.065054 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.065026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/436485ec-b65c-4d7d-b1af-59d4b5219d4e-metrics-server-audit-profiles\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.065398 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.065374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/436485ec-b65c-4d7d-b1af-59d4b5219d4e-audit-log\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.065549 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.065466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/436485ec-b65c-4d7d-b1af-59d4b5219d4e-secret-metrics-server-tls\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.065811 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.065755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/436485ec-b65c-4d7d-b1af-59d4b5219d4e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.066067 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.066046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/436485ec-b65c-4d7d-b1af-59d4b5219d4e-metrics-server-audit-profiles\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.066385 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.066364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/436485ec-b65c-4d7d-b1af-59d4b5219d4e-audit-log\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.067980 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.067954    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/436485ec-b65c-4d7d-b1af-59d4b5219d4e-secret-metrics-server-client-certs\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.068041 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.068019    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/436485ec-b65c-4d7d-b1af-59d4b5219d4e-secret-metrics-server-tls\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.068081 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.068041    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/436485ec-b65c-4d7d-b1af-59d4b5219d4e-client-ca-bundle\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.073531 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.073507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llb5s\" (UniqueName: \"kubernetes.io/projected/436485ec-b65c-4d7d-b1af-59d4b5219d4e-kube-api-access-llb5s\") pod \"metrics-server-758f9c44f-vbc4h\" (UID: \"436485ec-b65c-4d7d-b1af-59d4b5219d4e\") " pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.086209 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.086166    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n9wfd" podStartSLOduration=3.36034317 podStartE2EDuration="5.086153066s" totalImagesPullingTime="1.620630343s" totalInitContainerRuntime="105.179553ms" isStatefulPod=true podCreationTimestamp="2026-09-16 00:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:23.08545127 +0000 UTC m=+73.888274335" watchObservedRunningTime="2026-09-16 00:35:23.086153066 +0000 UTC m=+73.888976187"
Sep 16 00:35:23.250992 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.250953    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:23.405072 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.405037    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f7bf6bbb-khx2m"]
Sep 16 00:35:23.406381 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.406350    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"]
Sep 16 00:35:23.409806 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.409406    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"
Sep 16 00:35:23.409806 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.409518    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:23.411815 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.411621    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 16 00:35:23.411815 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.411729    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bq2wg\""
Sep 16 00:35:23.414565 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.414543    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"]
Sep 16 00:35:23.469815 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.469782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa6af43e-df1b-466f-a0ba-f4b36aef4781-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-vv6rr\" (UID: \"fa6af43e-df1b-466f-a0ba-f4b36aef4781\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"
Sep 16 00:35:23.470006 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.469844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9r74\" (UniqueName: \"kubernetes.io/projected/fa6af43e-df1b-466f-a0ba-f4b36aef4781-kube-api-access-l9r74\") pod \"monitoring-plugin-5d85778b9d-vv6rr\" (UID: \"fa6af43e-df1b-466f-a0ba-f4b36aef4781\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"
Sep 16 00:35:23.523066 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.523040    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-758f9c44f-vbc4h"]
Sep 16 00:35:23.526390 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:35:23.526361    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436485ec_b65c_4d7d_b1af_59d4b5219d4e.slice/crio-c9a214f34befcb094be1041924d89a162daa18bd68d470f9e14428587ae6fec6 WatchSource:0}: Error finding container c9a214f34befcb094be1041924d89a162daa18bd68d470f9e14428587ae6fec6: Status 404 returned error can't find the container with id c9a214f34befcb094be1041924d89a162daa18bd68d470f9e14428587ae6fec6
Sep 16 00:35:23.570829 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.570798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa6af43e-df1b-466f-a0ba-f4b36aef4781-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-vv6rr\" (UID: \"fa6af43e-df1b-466f-a0ba-f4b36aef4781\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"
Sep 16 00:35:23.570979 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.570862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9r74\" (UniqueName: \"kubernetes.io/projected/fa6af43e-df1b-466f-a0ba-f4b36aef4781-kube-api-access-l9r74\") pod \"monitoring-plugin-5d85778b9d-vv6rr\" (UID: \"fa6af43e-df1b-466f-a0ba-f4b36aef4781\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"
Sep 16 00:35:23.570979 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:35:23.570953    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 16 00:35:23.571083 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:35:23.571019    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa6af43e-df1b-466f-a0ba-f4b36aef4781-monitoring-plugin-cert podName:fa6af43e-df1b-466f-a0ba-f4b36aef4781 nodeName:}" failed. No retries permitted until 2026-09-16 00:35:24.071002673 +0000 UTC m=+74.873825734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/fa6af43e-df1b-466f-a0ba-f4b36aef4781-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-vv6rr" (UID: "fa6af43e-df1b-466f-a0ba-f4b36aef4781") : secret "monitoring-plugin-cert" not found
Sep 16 00:35:23.579181 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:23.579148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9r74\" (UniqueName: \"kubernetes.io/projected/fa6af43e-df1b-466f-a0ba-f4b36aef4781-kube-api-access-l9r74\") pod \"monitoring-plugin-5d85778b9d-vv6rr\" (UID: \"fa6af43e-df1b-466f-a0ba-f4b36aef4781\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"
Sep 16 00:35:24.054652 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.054613    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h" event={"ID":"436485ec-b65c-4d7d-b1af-59d4b5219d4e","Type":"ContainerStarted","Data":"c9a214f34befcb094be1041924d89a162daa18bd68d470f9e14428587ae6fec6"}
Sep 16 00:35:24.075635 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.075598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa6af43e-df1b-466f-a0ba-f4b36aef4781-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-vv6rr\" (UID: \"fa6af43e-df1b-466f-a0ba-f4b36aef4781\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"
Sep 16 00:35:24.075873 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:35:24.075855    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 16 00:35:24.075974 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:35:24.075948    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa6af43e-df1b-466f-a0ba-f4b36aef4781-monitoring-plugin-cert podName:fa6af43e-df1b-466f-a0ba-f4b36aef4781 nodeName:}" failed. No retries permitted until 2026-09-16 00:35:25.075927814 +0000 UTC m=+75.878750871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/fa6af43e-df1b-466f-a0ba-f4b36aef4781-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-vv6rr" (UID: "fa6af43e-df1b-466f-a0ba-f4b36aef4781") : secret "monitoring-plugin-cert" not found
Sep 16 00:35:24.841076 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.841043    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 00:35:24.844983 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.844958    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.847334 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.847314    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 16 00:35:24.847432 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.847314    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-77jc5\""
Sep 16 00:35:24.848146 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.847729    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 16 00:35:24.848146 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.847755    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 16 00:35:24.848146 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.847815    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 16 00:35:24.848146 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.847815    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 16 00:35:24.848146 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.848017    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 16 00:35:24.848146 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.848052    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 16 00:35:24.848418 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.848312    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 16 00:35:24.848418 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.848368    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 16 00:35:24.848418 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.848395    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 16 00:35:24.848567 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.848420    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 16 00:35:24.848932 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.848898    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2jqvc0nomlk65\""
Sep 16 00:35:24.849041 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.848966    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 16 00:35:24.853963 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.849739    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 16 00:35:24.856766 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.856742    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 16 00:35:24.861971 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.861948    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 00:35:24.883874 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.883836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ab2d176-0b2b-4ace-9967-46d985adaeb1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884001 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.883921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884001 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.883950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-web-config\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884001 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.883980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884153 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884153 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884153 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884255 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884255 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884255 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884255 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884397 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884397 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884378    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884541 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884541 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rt7z\" (UniqueName: \"kubernetes.io/projected/2ab2d176-0b2b-4ace-9967-46d985adaeb1-kube-api-access-8rt7z\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884541 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884512    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-config\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884541 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884754 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884754 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ab2d176-0b2b-4ace-9967-46d985adaeb1-config-out\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.884754 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.884712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986149 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986149 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-web-config\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986396 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986396 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986396 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986396 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986396 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986396 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986396 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986396 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986396 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986875 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986875 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986875 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rt7z\" (UniqueName: \"kubernetes.io/projected/2ab2d176-0b2b-4ace-9967-46d985adaeb1-kube-api-access-8rt7z\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986875 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-config\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986875 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986875 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986875 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ab2d176-0b2b-4ace-9967-46d985adaeb1-config-out\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986875 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.986875 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.986629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ab2d176-0b2b-4ace-9967-46d985adaeb1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.987430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.987034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.987430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.987049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.987430 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.987226    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.987578 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.987520    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.987629 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.987609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.989751 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.988529    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.989751 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.989365    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.990136 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.990087    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.990136 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.990097    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.991229 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.991169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ab2d176-0b2b-4ace-9967-46d985adaeb1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.991335 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.991233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.991407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.991318    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ab2d176-0b2b-4ace-9967-46d985adaeb1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.992803 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.992762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.993202 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.993180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.993594 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.993569    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ab2d176-0b2b-4ace-9967-46d985adaeb1-config-out\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.994003 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.993960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-config\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.994223 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.994183    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-web-config\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.994633 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.994610    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.994633 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.994624    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ab2d176-0b2b-4ace-9967-46d985adaeb1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:24.995930 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:24.995898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rt7z\" (UniqueName: \"kubernetes.io/projected/2ab2d176-0b2b-4ace-9967-46d985adaeb1-kube-api-access-8rt7z\") pod \"prometheus-k8s-0\" (UID: \"2ab2d176-0b2b-4ace-9967-46d985adaeb1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:25.087519 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:25.087478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa6af43e-df1b-466f-a0ba-f4b36aef4781-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-vv6rr\" (UID: \"fa6af43e-df1b-466f-a0ba-f4b36aef4781\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"
Sep 16 00:35:25.090358 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:25.090337    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa6af43e-df1b-466f-a0ba-f4b36aef4781-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-vv6rr\" (UID: \"fa6af43e-df1b-466f-a0ba-f4b36aef4781\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"
Sep 16 00:35:25.158495 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:25.158409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:25.222989 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:25.222949    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"
Sep 16 00:35:25.860938 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:25.860897    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"]
Sep 16 00:35:25.863766 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:35:25.863736    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6af43e_df1b_466f_a0ba_f4b36aef4781.slice/crio-e800292eccd36a4ccc7c5b773e96a483501d5df3e40eb718f369b74b70c8ddb8 WatchSource:0}: Error finding container e800292eccd36a4ccc7c5b773e96a483501d5df3e40eb718f369b74b70c8ddb8: Status 404 returned error can't find the container with id e800292eccd36a4ccc7c5b773e96a483501d5df3e40eb718f369b74b70c8ddb8
Sep 16 00:35:25.870702 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:25.870653    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 00:35:25.873110 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:35:25.873077    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab2d176_0b2b_4ace_9967_46d985adaeb1.slice/crio-9dd9c83cf560dcb1f7a2b5d777f571bf6856be6d7ec26bf01ce6d4b973bdb862 WatchSource:0}: Error finding container 9dd9c83cf560dcb1f7a2b5d777f571bf6856be6d7ec26bf01ce6d4b973bdb862: Status 404 returned error can't find the container with id 9dd9c83cf560dcb1f7a2b5d777f571bf6856be6d7ec26bf01ce6d4b973bdb862
Sep 16 00:35:26.071351 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.071257    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs" event={"ID":"169e1119-441a-409d-8572-e40ba2a8e3f6","Type":"ContainerStarted","Data":"cfd5e921a3835964f6ca2d1ed9965d5e08e519a8e97a393654d62894fe123ef3"}
Sep 16 00:35:26.071484 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.071365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs" event={"ID":"169e1119-441a-409d-8572-e40ba2a8e3f6","Type":"ContainerStarted","Data":"ac60e2c0aa6451892ca984e7c4d4d0cf7dee199549067e8674d4f5485941702a"}
Sep 16 00:35:26.071484 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.071404    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs" event={"ID":"169e1119-441a-409d-8572-e40ba2a8e3f6","Type":"ContainerStarted","Data":"08ea98eadc192be1b817f1841e32f6abd5c8ec730c124a609f76a90d9d105794"}
Sep 16 00:35:26.072989 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.072956    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h" event={"ID":"436485ec-b65c-4d7d-b1af-59d4b5219d4e","Type":"ContainerStarted","Data":"7c5f18efedf104e2b516eea1f39b13fba85f67116e94cc25446e9ba1a9143c7f"}
Sep 16 00:35:26.074317 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.074295    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr" event={"ID":"fa6af43e-df1b-466f-a0ba-f4b36aef4781","Type":"ContainerStarted","Data":"e800292eccd36a4ccc7c5b773e96a483501d5df3e40eb718f369b74b70c8ddb8"}
Sep 16 00:35:26.075930 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.075907    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ab2d176-0b2b-4ace-9967-46d985adaeb1" containerID="5356abda213e295939214cc453cda681fde166e6986db5819c3c7ab3cad4acda" exitCode=0
Sep 16 00:35:26.076049 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.075969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab2d176-0b2b-4ace-9967-46d985adaeb1","Type":"ContainerDied","Data":"5356abda213e295939214cc453cda681fde166e6986db5819c3c7ab3cad4acda"}
Sep 16 00:35:26.076110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.076047    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab2d176-0b2b-4ace-9967-46d985adaeb1","Type":"ContainerStarted","Data":"9dd9c83cf560dcb1f7a2b5d777f571bf6856be6d7ec26bf01ce6d4b973bdb862"}
Sep 16 00:35:26.079614 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.079591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d21ea078-1e76-4528-a5a1-6a1a3b1b2803","Type":"ContainerStarted","Data":"3dc0433f504a80c73072494f2dcd6ff26be3ed3cdfe44cae163bdf9236a48e63"}
Sep 16 00:35:26.079717 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.079644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d21ea078-1e76-4528-a5a1-6a1a3b1b2803","Type":"ContainerStarted","Data":"494bc88e25fc0a07dedee9cab0d076c840a9821d4f33c292f5312fa95b2b1efa"}
Sep 16 00:35:26.079717 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.079698    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d21ea078-1e76-4528-a5a1-6a1a3b1b2803","Type":"ContainerStarted","Data":"305ffbfe076f471b03f00180e84e836e8dc95ed6b0dcb6e5081707bfb4442884"}
Sep 16 00:35:26.079865 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.079726    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d21ea078-1e76-4528-a5a1-6a1a3b1b2803","Type":"ContainerStarted","Data":"fda9fb6c6151c7603f5f0de3ed4ff031b2bc3afdbb61f42aedc7b3250722674c"}
Sep 16 00:35:26.079865 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.079750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d21ea078-1e76-4528-a5a1-6a1a3b1b2803","Type":"ContainerStarted","Data":"3e0086a785048d02f2afa9b92370585be2b103061866dbd24aaadb3661ee0f91"}
Sep 16 00:35:26.090783 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:26.090745    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h" podStartSLOduration=2.038105164 podStartE2EDuration="4.090731301s" totalImagesPullingTime="2.052626137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:26.089599358 +0000 UTC m=+76.892422421" watchObservedRunningTime="2026-09-16 00:35:26.090731301 +0000 UTC m=+76.893554364"
Sep 16 00:35:28.091712 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:28.091648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d21ea078-1e76-4528-a5a1-6a1a3b1b2803","Type":"ContainerStarted","Data":"b953f943b92175965d21ccb9ef773a68e4c1a77923e7a6bf4459fca74ff26dc6"}
Sep 16 00:35:28.094744 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:28.094706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs" event={"ID":"169e1119-441a-409d-8572-e40ba2a8e3f6","Type":"ContainerStarted","Data":"313abafe048ff83cffc739821384fc939d6e589f1ce55d469535055fb6b7ae11"}
Sep 16 00:35:28.094905 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:28.094796    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs" event={"ID":"169e1119-441a-409d-8572-e40ba2a8e3f6","Type":"ContainerStarted","Data":"aed5dde4a450210e0a5df60ffca1d1738e954378ff6e3a03f44ebcaccc751cc1"}
Sep 16 00:35:28.094905 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:28.094841    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs" event={"ID":"169e1119-441a-409d-8572-e40ba2a8e3f6","Type":"ContainerStarted","Data":"c2f87884c765046b8499fc5e36c2b771ca580af13adc9c8c0a74bb8adf8a203f"}
Sep 16 00:35:28.094905 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:28.094887    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:28.096413 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:28.096382    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr" event={"ID":"fa6af43e-df1b-466f-a0ba-f4b36aef4781","Type":"ContainerStarted","Data":"198b418fe243fac47d8bac3b57c3beb10b1d357150b72293b84eaa845895284a"}
Sep 16 00:35:28.096561 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:28.096543    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"
Sep 16 00:35:28.101913 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:28.101893    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr"
Sep 16 00:35:28.116217 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:28.116164    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.084708179 podStartE2EDuration="9.116144025s" totalImagesPullingTime="5.008739173s" totalInitContainerRuntime="22.696673ms" isStatefulPod=false podCreationTimestamp="2026-09-16 00:35:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:28.115575956 +0000 UTC m=+78.918399024" watchObservedRunningTime="2026-09-16 00:35:28.116144025 +0000 UTC m=+78.918967089"
Sep 16 00:35:28.136635 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:28.136587    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs" podStartSLOduration=3.036177442 podStartE2EDuration="7.136570464s" totalImagesPullingTime="4.100393022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:35:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:28.135281214 +0000 UTC m=+78.938104278" watchObservedRunningTime="2026-09-16 00:35:28.136570464 +0000 UTC m=+78.939393526"
Sep 16 00:35:28.150288 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:28.150234    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vv6rr" podStartSLOduration=3.634262845 podStartE2EDuration="5.150218214s" totalImagesPullingTime="1.515955369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:28.148698199 +0000 UTC m=+78.951521267" watchObservedRunningTime="2026-09-16 00:35:28.150218214 +0000 UTC m=+78.953041276"
Sep 16 00:35:30.112221 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:30.112129    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab2d176-0b2b-4ace-9967-46d985adaeb1","Type":"ContainerStarted","Data":"3ba9afbdc94ce671c2deea1364f94fb18cbf224c8aa83d57723c6d0b3fa90cbe"}
Sep 16 00:35:30.112627 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:30.112223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab2d176-0b2b-4ace-9967-46d985adaeb1","Type":"ContainerStarted","Data":"bcaeacd50c2f2d1e58cbdd80e9b3c0b4b6d25fe5c1f46ae09f50d5f1750ae3c3"}
Sep 16 00:35:30.112627 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:30.112257    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab2d176-0b2b-4ace-9967-46d985adaeb1","Type":"ContainerStarted","Data":"a72d571bf23a7ed7c040d0485a6d1d07964ba2fef51adf54ec5ca403bfaf12ad"}
Sep 16 00:35:30.112627 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:30.112282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab2d176-0b2b-4ace-9967-46d985adaeb1","Type":"ContainerStarted","Data":"80079511dc3918695683c4858cc8774bd226c0911e4ec3a302a791bcf4de3c73"}
Sep 16 00:35:30.112627 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:30.112307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab2d176-0b2b-4ace-9967-46d985adaeb1","Type":"ContainerStarted","Data":"87caa34753252f0eac5e7f0f5e70f7a4cf3a73c48d69b328fc28859417c1b6e9"}
Sep 16 00:35:30.112627 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:30.112330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab2d176-0b2b-4ace-9967-46d985adaeb1","Type":"ContainerStarted","Data":"95e806b974c969044a438a0e94cae8a5d4a3c00b5a09b4b7536ae6aab5e277ca"}
Sep 16 00:35:30.137921 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:30.137869    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.746951826 podStartE2EDuration="6.137850392s" totalImagesPullingTime="3.368165246s" totalInitContainerRuntime="22.73332ms" isStatefulPod=false podCreationTimestamp="2026-09-16 00:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:35:30.135163147 +0000 UTC m=+80.937986209" watchObservedRunningTime="2026-09-16 00:35:30.137850392 +0000 UTC m=+80.940673454"
Sep 16 00:35:30.159332 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:30.159307    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:35:34.111085 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:34.110969    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-75c9dc99d8-qqfzs"
Sep 16 00:35:34.553037 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:34.552999    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c54dc9cfd-89nvz"]
Sep 16 00:35:43.251114 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:43.251072    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:43.251580 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:43.251155    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:35:48.431423 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.431362    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65f7bf6bbb-khx2m" podUID="b46b7fb0-5666-4eda-82fd-e90754251a78" containerName="console" containerID="cri-o://5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f" gracePeriod=15
Sep 16 00:35:48.679811 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.679783    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:48.796491 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.796451    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-oauth-serving-cert\") pod \"b46b7fb0-5666-4eda-82fd-e90754251a78\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") "
Sep 16 00:35:48.796491 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.796491    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-service-ca\") pod \"b46b7fb0-5666-4eda-82fd-e90754251a78\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") "
Sep 16 00:35:48.796767 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.796531    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kbgd\" (UniqueName: \"kubernetes.io/projected/b46b7fb0-5666-4eda-82fd-e90754251a78-kube-api-access-8kbgd\") pod \"b46b7fb0-5666-4eda-82fd-e90754251a78\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") "
Sep 16 00:35:48.796767 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.796580    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-trusted-ca-bundle\") pod \"b46b7fb0-5666-4eda-82fd-e90754251a78\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") "
Sep 16 00:35:48.796767 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.796621    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-console-config\") pod \"b46b7fb0-5666-4eda-82fd-e90754251a78\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") "
Sep 16 00:35:48.796767 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.796650    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b46b7fb0-5666-4eda-82fd-e90754251a78-console-serving-cert\") pod \"b46b7fb0-5666-4eda-82fd-e90754251a78\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") "
Sep 16 00:35:48.796995 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.796862    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b46b7fb0-5666-4eda-82fd-e90754251a78-console-oauth-config\") pod \"b46b7fb0-5666-4eda-82fd-e90754251a78\" (UID: \"b46b7fb0-5666-4eda-82fd-e90754251a78\") "
Sep 16 00:35:48.796995 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.796900    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-service-ca" (OuterVolumeSpecName: "service-ca") pod "b46b7fb0-5666-4eda-82fd-e90754251a78" (UID: "b46b7fb0-5666-4eda-82fd-e90754251a78"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:35:48.797107 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.797039    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b46b7fb0-5666-4eda-82fd-e90754251a78" (UID: "b46b7fb0-5666-4eda-82fd-e90754251a78"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:35:48.797170 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.797115    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-console-config" (OuterVolumeSpecName: "console-config") pod "b46b7fb0-5666-4eda-82fd-e90754251a78" (UID: "b46b7fb0-5666-4eda-82fd-e90754251a78"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:35:48.797170 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.797124    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b46b7fb0-5666-4eda-82fd-e90754251a78" (UID: "b46b7fb0-5666-4eda-82fd-e90754251a78"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:35:48.797293 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.797273    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-oauth-serving-cert\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:35:48.797347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.797299    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-service-ca\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:35:48.797347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.797313    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-trusted-ca-bundle\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:35:48.797347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.797326    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b46b7fb0-5666-4eda-82fd-e90754251a78-console-config\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:35:48.799221 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.799199    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46b7fb0-5666-4eda-82fd-e90754251a78-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b46b7fb0-5666-4eda-82fd-e90754251a78" (UID: "b46b7fb0-5666-4eda-82fd-e90754251a78"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:35:48.799324 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.799279    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46b7fb0-5666-4eda-82fd-e90754251a78-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b46b7fb0-5666-4eda-82fd-e90754251a78" (UID: "b46b7fb0-5666-4eda-82fd-e90754251a78"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:35:48.799363 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.799333    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46b7fb0-5666-4eda-82fd-e90754251a78-kube-api-access-8kbgd" (OuterVolumeSpecName: "kube-api-access-8kbgd") pod "b46b7fb0-5666-4eda-82fd-e90754251a78" (UID: "b46b7fb0-5666-4eda-82fd-e90754251a78"). InnerVolumeSpecName "kube-api-access-8kbgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:35:48.898445 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.898394    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kbgd\" (UniqueName: \"kubernetes.io/projected/b46b7fb0-5666-4eda-82fd-e90754251a78-kube-api-access-8kbgd\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:35:48.898445 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.898437    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b46b7fb0-5666-4eda-82fd-e90754251a78-console-serving-cert\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:35:48.898445 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:48.898447    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b46b7fb0-5666-4eda-82fd-e90754251a78-console-oauth-config\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:35:49.190095 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:49.190006    2563 generic.go:356] "Generic (PLEG): container finished" podID="b46b7fb0-5666-4eda-82fd-e90754251a78" containerID="5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f" exitCode=0
Sep 16 00:35:49.190095 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:49.190053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f7bf6bbb-khx2m" event={"ID":"b46b7fb0-5666-4eda-82fd-e90754251a78","Type":"ContainerDied","Data":"5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f"}
Sep 16 00:35:49.190095 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:49.190058    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f7bf6bbb-khx2m"
Sep 16 00:35:49.190329 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:49.190103    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f7bf6bbb-khx2m" event={"ID":"b46b7fb0-5666-4eda-82fd-e90754251a78","Type":"ContainerDied","Data":"24a32f7657b1826a8dba0e1c7936cb8ed3134d4f5c566f0f599838667478f96c"}
Sep 16 00:35:49.190329 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:49.190136    2563 scope.go:117] "RemoveContainer" containerID="5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f"
Sep 16 00:35:49.198650 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:49.198632    2563 scope.go:117] "RemoveContainer" containerID="5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f"
Sep 16 00:35:49.198967 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:35:49.198942    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f\": container with ID starting with 5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f not found: ID does not exist" containerID="5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f"
Sep 16 00:35:49.199045 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:49.198979    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f"} err="failed to get container status \"5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f\": rpc error: code = NotFound desc = could not find container \"5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f\": container with ID starting with 5269abfcc7891088326a7c920e7a96deb5295a30f9d9106436011fd7c93e109f not found: ID does not exist"
Sep 16 00:35:49.209406 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:49.209380    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f7bf6bbb-khx2m"]
Sep 16 00:35:49.217525 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:49.217502    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65f7bf6bbb-khx2m"]
Sep 16 00:35:49.668326 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:49.668295    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b46b7fb0-5666-4eda-82fd-e90754251a78" path="/var/lib/kubelet/pods/b46b7fb0-5666-4eda-82fd-e90754251a78/volumes"
Sep 16 00:35:52.043768 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:52.043736    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-swcf8"
Sep 16 00:35:59.572715 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.572631    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c54dc9cfd-89nvz" podUID="b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e" containerName="console" containerID="cri-o://37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8" gracePeriod=15
Sep 16 00:35:59.868613 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.868583    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:35:59.994005 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.993970    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-oauth-serving-cert\") pod \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") "
Sep 16 00:35:59.994203 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.994023    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-service-ca\") pod \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") "
Sep 16 00:35:59.994203 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.994061    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxzfd\" (UniqueName: \"kubernetes.io/projected/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-kube-api-access-mxzfd\") pod \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") "
Sep 16 00:35:59.994203 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.994083    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-config\") pod \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") "
Sep 16 00:35:59.994203 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.994111    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-serving-cert\") pod \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") "
Sep 16 00:35:59.994203 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.994142    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-oauth-config\") pod \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\" (UID: \"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e\") "
Sep 16 00:35:59.994523 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.994491    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-config" (OuterVolumeSpecName: "console-config") pod "b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e" (UID: "b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:35:59.994523 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.994512    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-service-ca" (OuterVolumeSpecName: "service-ca") pod "b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e" (UID: "b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:35:59.994648 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.994501    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e" (UID: "b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:35:59.996592 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.996565    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e" (UID: "b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:35:59.996944 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.996925    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e" (UID: "b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:35:59.997037 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:35:59.997013    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-kube-api-access-mxzfd" (OuterVolumeSpecName: "kube-api-access-mxzfd") pod "b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e" (UID: "b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e"). InnerVolumeSpecName "kube-api-access-mxzfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:36:00.095725 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.095612    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-serving-cert\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:36:00.095725 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.095645    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-oauth-config\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:36:00.095725 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.095655    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-oauth-serving-cert\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:36:00.095725 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.095689    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-service-ca\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:36:00.095725 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.095699    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxzfd\" (UniqueName: \"kubernetes.io/projected/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-kube-api-access-mxzfd\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:36:00.095725 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.095707    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e-console-config\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:36:00.234766 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.234729    2563 generic.go:356] "Generic (PLEG): container finished" podID="b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e" containerID="37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8" exitCode=0
Sep 16 00:36:00.234954 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.234794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c54dc9cfd-89nvz" event={"ID":"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e","Type":"ContainerDied","Data":"37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8"}
Sep 16 00:36:00.234954 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.234795    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c54dc9cfd-89nvz"
Sep 16 00:36:00.234954 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.234858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c54dc9cfd-89nvz" event={"ID":"b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e","Type":"ContainerDied","Data":"2ca28e9162c17e49774e5e9546c5b9b2e8fe341316aab9330e972521a2088d8e"}
Sep 16 00:36:00.234954 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.234879    2563 scope.go:117] "RemoveContainer" containerID="37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8"
Sep 16 00:36:00.243398 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.243380    2563 scope.go:117] "RemoveContainer" containerID="37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8"
Sep 16 00:36:00.243718 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:36:00.243699    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8\": container with ID starting with 37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8 not found: ID does not exist" containerID="37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8"
Sep 16 00:36:00.243802 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.243727    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8"} err="failed to get container status \"37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8\": rpc error: code = NotFound desc = could not find container \"37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8\": container with ID starting with 37a4486f036739abf46d94509e04b81a56a6c32703f4591a5a2fa36dd8e233f8 not found: ID does not exist"
Sep 16 00:36:00.257408 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.257382    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c54dc9cfd-89nvz"]
Sep 16 00:36:00.261212 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:00.261188    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c54dc9cfd-89nvz"]
Sep 16 00:36:01.666580 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:01.666546    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e" path="/var/lib/kubelet/pods/b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e/volumes"
Sep 16 00:36:03.257314 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:03.257282    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:36:03.261222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:03.261203    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-758f9c44f-vbc4h"
Sep 16 00:36:25.158831 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:25.158787    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:36:25.178407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:25.178376    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:36:25.351612 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:36:25.351583    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 00:38:19.340607 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.340567    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr"]
Sep 16 00:38:19.341119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.340878    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e" containerName="console"
Sep 16 00:38:19.341119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.340894    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e" containerName="console"
Sep 16 00:38:19.341119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.340921    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46b7fb0-5666-4eda-82fd-e90754251a78" containerName="console"
Sep 16 00:38:19.341119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.340927    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46b7fb0-5666-4eda-82fd-e90754251a78" containerName="console"
Sep 16 00:38:19.341119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.340981    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4074e67-696a-4ef3-abd0-ac4fa4cbbe1e" containerName="console"
Sep 16 00:38:19.341119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.340991    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46b7fb0-5666-4eda-82fd-e90754251a78" containerName="console"
Sep 16 00:38:19.344033 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.344016    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr"
Sep 16 00:38:19.347132 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.346858    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 16 00:38:19.347290 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.347240    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-lqxmf\""
Sep 16 00:38:19.350048 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.347488    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 16 00:38:19.351064 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.351028    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr"]
Sep 16 00:38:19.442599 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.442559    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwmck\" (UniqueName: \"kubernetes.io/projected/25d4cbdb-e142-447a-8b60-e0fac7c6f7e0-kube-api-access-kwmck\") pod \"cert-manager-cainjector-559cdd8c87-jk5gr\" (UID: \"25d4cbdb-e142-447a-8b60-e0fac7c6f7e0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr"
Sep 16 00:38:19.442796 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.442617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25d4cbdb-e142-447a-8b60-e0fac7c6f7e0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jk5gr\" (UID: \"25d4cbdb-e142-447a-8b60-e0fac7c6f7e0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr"
Sep 16 00:38:19.543838 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.543800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwmck\" (UniqueName: \"kubernetes.io/projected/25d4cbdb-e142-447a-8b60-e0fac7c6f7e0-kube-api-access-kwmck\") pod \"cert-manager-cainjector-559cdd8c87-jk5gr\" (UID: \"25d4cbdb-e142-447a-8b60-e0fac7c6f7e0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr"
Sep 16 00:38:19.544045 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.543857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25d4cbdb-e142-447a-8b60-e0fac7c6f7e0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jk5gr\" (UID: \"25d4cbdb-e142-447a-8b60-e0fac7c6f7e0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr"
Sep 16 00:38:19.551686 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.551644    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25d4cbdb-e142-447a-8b60-e0fac7c6f7e0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jk5gr\" (UID: \"25d4cbdb-e142-447a-8b60-e0fac7c6f7e0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr"
Sep 16 00:38:19.551796 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.551731    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwmck\" (UniqueName: \"kubernetes.io/projected/25d4cbdb-e142-447a-8b60-e0fac7c6f7e0-kube-api-access-kwmck\") pod \"cert-manager-cainjector-559cdd8c87-jk5gr\" (UID: \"25d4cbdb-e142-447a-8b60-e0fac7c6f7e0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr"
Sep 16 00:38:19.673711 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.673606    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr"
Sep 16 00:38:19.943797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:19.943766    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr"]
Sep 16 00:38:19.947071 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:38:19.947031    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25d4cbdb_e142_447a_8b60_e0fac7c6f7e0.slice/crio-76cec59e8d662f1019e1db8ad401cebce814087bf6c67e320e04d3f36eeee7ff WatchSource:0}: Error finding container 76cec59e8d662f1019e1db8ad401cebce814087bf6c67e320e04d3f36eeee7ff: Status 404 returned error can't find the container with id 76cec59e8d662f1019e1db8ad401cebce814087bf6c67e320e04d3f36eeee7ff
Sep 16 00:38:20.753576 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:20.753533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr" event={"ID":"25d4cbdb-e142-447a-8b60-e0fac7c6f7e0","Type":"ContainerStarted","Data":"76cec59e8d662f1019e1db8ad401cebce814087bf6c67e320e04d3f36eeee7ff"}
Sep 16 00:38:23.768209 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:23.768172    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr" event={"ID":"25d4cbdb-e142-447a-8b60-e0fac7c6f7e0","Type":"ContainerStarted","Data":"3a8af5eedafce2cd17f80b64de719bcc111b1bc6055dde8d3b6adc5b237951c2"}
Sep 16 00:38:23.784145 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:23.784089    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jk5gr" podStartSLOduration=1.8580023460000001 podStartE2EDuration="4.78407283s" totalImagesPullingTime="2.926070484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:38:23.782882938 +0000 UTC m=+254.585706003" watchObservedRunningTime="2026-09-16 00:38:23.78407283 +0000 UTC m=+254.586895893"
Sep 16 00:38:31.776640 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:31.776547    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vgsb8"]
Sep 16 00:38:31.780004 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:31.779980    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vgsb8"
Sep 16 00:38:31.782696 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:31.782655    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-t92lw\""
Sep 16 00:38:31.791448 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:31.791424    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vgsb8"]
Sep 16 00:38:31.856726 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:31.856685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t444\" (UniqueName: \"kubernetes.io/projected/c5a25883-06e3-4f10-9ef3-af9fb836f59d-kube-api-access-6t444\") pod \"cert-manager-55b4d954d5-vgsb8\" (UID: \"c5a25883-06e3-4f10-9ef3-af9fb836f59d\") " pod="cert-manager/cert-manager-55b4d954d5-vgsb8"
Sep 16 00:38:31.856873 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:31.856746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5a25883-06e3-4f10-9ef3-af9fb836f59d-bound-sa-token\") pod \"cert-manager-55b4d954d5-vgsb8\" (UID: \"c5a25883-06e3-4f10-9ef3-af9fb836f59d\") " pod="cert-manager/cert-manager-55b4d954d5-vgsb8"
Sep 16 00:38:31.958213 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:31.958154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t444\" (UniqueName: \"kubernetes.io/projected/c5a25883-06e3-4f10-9ef3-af9fb836f59d-kube-api-access-6t444\") pod \"cert-manager-55b4d954d5-vgsb8\" (UID: \"c5a25883-06e3-4f10-9ef3-af9fb836f59d\") " pod="cert-manager/cert-manager-55b4d954d5-vgsb8"
Sep 16 00:38:31.958213 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:31.958232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5a25883-06e3-4f10-9ef3-af9fb836f59d-bound-sa-token\") pod \"cert-manager-55b4d954d5-vgsb8\" (UID: \"c5a25883-06e3-4f10-9ef3-af9fb836f59d\") " pod="cert-manager/cert-manager-55b4d954d5-vgsb8"
Sep 16 00:38:31.966034 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:31.965999    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5a25883-06e3-4f10-9ef3-af9fb836f59d-bound-sa-token\") pod \"cert-manager-55b4d954d5-vgsb8\" (UID: \"c5a25883-06e3-4f10-9ef3-af9fb836f59d\") " pod="cert-manager/cert-manager-55b4d954d5-vgsb8"
Sep 16 00:38:31.966324 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:31.966305    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t444\" (UniqueName: \"kubernetes.io/projected/c5a25883-06e3-4f10-9ef3-af9fb836f59d-kube-api-access-6t444\") pod \"cert-manager-55b4d954d5-vgsb8\" (UID: \"c5a25883-06e3-4f10-9ef3-af9fb836f59d\") " pod="cert-manager/cert-manager-55b4d954d5-vgsb8"
Sep 16 00:38:32.088306 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:32.088210    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vgsb8"
Sep 16 00:38:32.361907 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:32.361824    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vgsb8"]
Sep 16 00:38:32.365046 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:38:32.365016    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5a25883_06e3_4f10_9ef3_af9fb836f59d.slice/crio-91376ac9c29c5637fd9f2d04ecaa11143b73e27168ac7e12bf8b76436aa08342 WatchSource:0}: Error finding container 91376ac9c29c5637fd9f2d04ecaa11143b73e27168ac7e12bf8b76436aa08342: Status 404 returned error can't find the container with id 91376ac9c29c5637fd9f2d04ecaa11143b73e27168ac7e12bf8b76436aa08342
Sep 16 00:38:32.804650 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:32.804614    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vgsb8" event={"ID":"c5a25883-06e3-4f10-9ef3-af9fb836f59d","Type":"ContainerStarted","Data":"398b6c5f691865fc062376075d71fb21cb696c2a51a531a32cd70b11530b90c0"}
Sep 16 00:38:32.805077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:32.804680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vgsb8" event={"ID":"c5a25883-06e3-4f10-9ef3-af9fb836f59d","Type":"ContainerStarted","Data":"91376ac9c29c5637fd9f2d04ecaa11143b73e27168ac7e12bf8b76436aa08342"}
Sep 16 00:38:32.820427 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:32.820379    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-vgsb8" podStartSLOduration=1.820361822 podStartE2EDuration="1.820361822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:38:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:38:32.819261554 +0000 UTC m=+263.622084618" watchObservedRunningTime="2026-09-16 00:38:32.820361822 +0000 UTC m=+263.623184885"
Sep 16 00:38:48.492494 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.492453    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"]
Sep 16 00:38:48.495961 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.495937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.498109 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.498086    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 00:38:48.498242 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.498220    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zp8vf\""
Sep 16 00:38:48.498301 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.498259    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 00:38:48.498470 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.498455    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 00:38:48.498654 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.498633    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 00:38:48.508258 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.508232    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"]
Sep 16 00:38:48.595345 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.595307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20452936-0e7c-472a-b7fa-6f69ebf322e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.595516 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.595377    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20452936-0e7c-472a-b7fa-6f69ebf322e2-tmp\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.595516 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.595410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20452936-0e7c-472a-b7fa-6f69ebf322e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.595516 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.595432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20452936-0e7c-472a-b7fa-6f69ebf322e2-manifests\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.595516 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.595508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd8k4\" (UniqueName: \"kubernetes.io/projected/20452936-0e7c-472a-b7fa-6f69ebf322e2-kube-api-access-kd8k4\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.696935 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.696897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20452936-0e7c-472a-b7fa-6f69ebf322e2-tmp\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.696935 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.696938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20452936-0e7c-472a-b7fa-6f69ebf322e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.697185 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.696965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20452936-0e7c-472a-b7fa-6f69ebf322e2-manifests\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.697185 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.697002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd8k4\" (UniqueName: \"kubernetes.io/projected/20452936-0e7c-472a-b7fa-6f69ebf322e2-kube-api-access-kd8k4\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.697185 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.697030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20452936-0e7c-472a-b7fa-6f69ebf322e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.697478 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.697433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20452936-0e7c-472a-b7fa-6f69ebf322e2-manifests\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.699584 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.699554    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20452936-0e7c-472a-b7fa-6f69ebf322e2-tmp\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.699732 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.699699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20452936-0e7c-472a-b7fa-6f69ebf322e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.699732 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.699698    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20452936-0e7c-472a-b7fa-6f69ebf322e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.708017 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.707995    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd8k4\" (UniqueName: \"kubernetes.io/projected/20452936-0e7c-472a-b7fa-6f69ebf322e2-kube-api-access-kd8k4\") pod \"opendatahub-operator-controller-manager-55d645f7ff-rgj9q\" (UID: \"20452936-0e7c-472a-b7fa-6f69ebf322e2\") " pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:48.807372 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:48.807274    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:49.090132 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:49.090036    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"]
Sep 16 00:38:49.093027 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:38:49.092999    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20452936_0e7c_472a_b7fa_6f69ebf322e2.slice/crio-7cc6d29478c0366b69ef26e7165b21918af5df2623b60c93b854ae4ff3503035 WatchSource:0}: Error finding container 7cc6d29478c0366b69ef26e7165b21918af5df2623b60c93b854ae4ff3503035: Status 404 returned error can't find the container with id 7cc6d29478c0366b69ef26e7165b21918af5df2623b60c93b854ae4ff3503035
Sep 16 00:38:49.873276 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:49.873211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q" event={"ID":"20452936-0e7c-472a-b7fa-6f69ebf322e2","Type":"ContainerStarted","Data":"7cc6d29478c0366b69ef26e7165b21918af5df2623b60c93b854ae4ff3503035"}
Sep 16 00:38:52.889508 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:52.889474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q" event={"ID":"20452936-0e7c-472a-b7fa-6f69ebf322e2","Type":"ContainerStarted","Data":"441fee2f5064e11a22e0c9ad6e21f16c69eeba6f5f70a20635fe2b667e948303"}
Sep 16 00:38:53.899490 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:53.899453    2563 generic.go:356] "Generic (PLEG): container finished" podID="20452936-0e7c-472a-b7fa-6f69ebf322e2" containerID="441fee2f5064e11a22e0c9ad6e21f16c69eeba6f5f70a20635fe2b667e948303" exitCode=0
Sep 16 00:38:53.899891 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:53.899508    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q" event={"ID":"20452936-0e7c-472a-b7fa-6f69ebf322e2","Type":"ContainerDied","Data":"441fee2f5064e11a22e0c9ad6e21f16c69eeba6f5f70a20635fe2b667e948303"}
Sep 16 00:38:54.906001 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:54.905962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q" event={"ID":"20452936-0e7c-472a-b7fa-6f69ebf322e2","Type":"ContainerStarted","Data":"80c7492eb4798d0e767f73c4f7ae99de78ab417c9b122d8c7f518f3ff67eab2d"}
Sep 16 00:38:54.906481 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:54.906066    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:38:54.926729 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:38:54.926653    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q" podStartSLOduration=2.553167717 podStartE2EDuration="6.926638449s" totalImagesPullingTime="3.362819814s" totalInitContainerRuntime="1.010650918s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:38:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:38:54.926301243 +0000 UTC m=+285.729124343" watchObservedRunningTime="2026-09-16 00:38:54.926638449 +0000 UTC m=+285.729461512"
Sep 16 00:39:05.913043 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:05.913011    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-55d645f7ff-rgj9q"
Sep 16 00:39:06.227406 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.227376    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-864798458c-glhn5"]
Sep 16 00:39:06.230750 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.230732    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.235937 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.235909    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 00:39:06.236085 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.235909    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 16 00:39:06.236085 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.235959    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cbpxz\""
Sep 16 00:39:06.236085 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.236055    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 00:39:06.236783 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.236766    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 16 00:39:06.236868 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.236802    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 16 00:39:06.243264 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.243237    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-864798458c-glhn5"]
Sep 16 00:39:06.349014 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.348983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f51604b0-65c0-44e7-a8ee-d7f1516ede35-cert\") pod \"lws-controller-manager-864798458c-glhn5\" (UID: \"f51604b0-65c0-44e7-a8ee-d7f1516ede35\") " pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.349014 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.349025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f51604b0-65c0-44e7-a8ee-d7f1516ede35-metrics-cert\") pod \"lws-controller-manager-864798458c-glhn5\" (UID: \"f51604b0-65c0-44e7-a8ee-d7f1516ede35\") " pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.349237 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.349053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f51604b0-65c0-44e7-a8ee-d7f1516ede35-manager-config\") pod \"lws-controller-manager-864798458c-glhn5\" (UID: \"f51604b0-65c0-44e7-a8ee-d7f1516ede35\") " pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.349237 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.349150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twfjv\" (UniqueName: \"kubernetes.io/projected/f51604b0-65c0-44e7-a8ee-d7f1516ede35-kube-api-access-twfjv\") pod \"lws-controller-manager-864798458c-glhn5\" (UID: \"f51604b0-65c0-44e7-a8ee-d7f1516ede35\") " pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.450304 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.450261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f51604b0-65c0-44e7-a8ee-d7f1516ede35-cert\") pod \"lws-controller-manager-864798458c-glhn5\" (UID: \"f51604b0-65c0-44e7-a8ee-d7f1516ede35\") " pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.450304 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.450304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f51604b0-65c0-44e7-a8ee-d7f1516ede35-metrics-cert\") pod \"lws-controller-manager-864798458c-glhn5\" (UID: \"f51604b0-65c0-44e7-a8ee-d7f1516ede35\") " pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.450565 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.450336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f51604b0-65c0-44e7-a8ee-d7f1516ede35-manager-config\") pod \"lws-controller-manager-864798458c-glhn5\" (UID: \"f51604b0-65c0-44e7-a8ee-d7f1516ede35\") " pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.450565 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.450383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twfjv\" (UniqueName: \"kubernetes.io/projected/f51604b0-65c0-44e7-a8ee-d7f1516ede35-kube-api-access-twfjv\") pod \"lws-controller-manager-864798458c-glhn5\" (UID: \"f51604b0-65c0-44e7-a8ee-d7f1516ede35\") " pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.451076 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.451056    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f51604b0-65c0-44e7-a8ee-d7f1516ede35-manager-config\") pod \"lws-controller-manager-864798458c-glhn5\" (UID: \"f51604b0-65c0-44e7-a8ee-d7f1516ede35\") " pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.453183 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.453159    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f51604b0-65c0-44e7-a8ee-d7f1516ede35-cert\") pod \"lws-controller-manager-864798458c-glhn5\" (UID: \"f51604b0-65c0-44e7-a8ee-d7f1516ede35\") " pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.453283 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.453159    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f51604b0-65c0-44e7-a8ee-d7f1516ede35-metrics-cert\") pod \"lws-controller-manager-864798458c-glhn5\" (UID: \"f51604b0-65c0-44e7-a8ee-d7f1516ede35\") " pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.463591 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.463560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twfjv\" (UniqueName: \"kubernetes.io/projected/f51604b0-65c0-44e7-a8ee-d7f1516ede35-kube-api-access-twfjv\") pod \"lws-controller-manager-864798458c-glhn5\" (UID: \"f51604b0-65c0-44e7-a8ee-d7f1516ede35\") " pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.540041 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.539954    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:06.818054 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.817374    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-864798458c-glhn5"]
Sep 16 00:39:06.825618 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:39:06.825580    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51604b0_65c0_44e7_a8ee_d7f1516ede35.slice/crio-5ed8fe9fe67b86d6671d4e45db3f9636d90d27cb4bd897b126e8202bf6a463e3 WatchSource:0}: Error finding container 5ed8fe9fe67b86d6671d4e45db3f9636d90d27cb4bd897b126e8202bf6a463e3: Status 404 returned error can't find the container with id 5ed8fe9fe67b86d6671d4e45db3f9636d90d27cb4bd897b126e8202bf6a463e3
Sep 16 00:39:06.958140 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:06.958103    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5" event={"ID":"f51604b0-65c0-44e7-a8ee-d7f1516ede35","Type":"ContainerStarted","Data":"5ed8fe9fe67b86d6671d4e45db3f9636d90d27cb4bd897b126e8202bf6a463e3"}
Sep 16 00:39:08.603274 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.603236    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"]
Sep 16 00:39:08.610861 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.610819    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"
Sep 16 00:39:08.614101 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.613846    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 00:39:08.614101 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.613867    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6djkb\""
Sep 16 00:39:08.614101 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.613891    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 16 00:39:08.614101 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.613919    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 16 00:39:08.614101 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.613846    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 00:39:08.618746 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.618718    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"]
Sep 16 00:39:08.669973 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.669927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5clrg\" (UniqueName: \"kubernetes.io/projected/7005cfcb-1670-4693-be3a-c46b6ccffba3-kube-api-access-5clrg\") pod \"kube-auth-proxy-6bb4c8f6-5zfgr\" (UID: \"7005cfcb-1670-4693-be3a-c46b6ccffba3\") " pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"
Sep 16 00:39:08.670201 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.670079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7005cfcb-1670-4693-be3a-c46b6ccffba3-tls-certs\") pod \"kube-auth-proxy-6bb4c8f6-5zfgr\" (UID: \"7005cfcb-1670-4693-be3a-c46b6ccffba3\") " pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"
Sep 16 00:39:08.670201 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.670123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7005cfcb-1670-4693-be3a-c46b6ccffba3-tmp\") pod \"kube-auth-proxy-6bb4c8f6-5zfgr\" (UID: \"7005cfcb-1670-4693-be3a-c46b6ccffba3\") " pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"
Sep 16 00:39:08.771041 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.770999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7005cfcb-1670-4693-be3a-c46b6ccffba3-tls-certs\") pod \"kube-auth-proxy-6bb4c8f6-5zfgr\" (UID: \"7005cfcb-1670-4693-be3a-c46b6ccffba3\") " pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"
Sep 16 00:39:08.771041 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.771049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7005cfcb-1670-4693-be3a-c46b6ccffba3-tmp\") pod \"kube-auth-proxy-6bb4c8f6-5zfgr\" (UID: \"7005cfcb-1670-4693-be3a-c46b6ccffba3\") " pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"
Sep 16 00:39:08.771294 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.771126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5clrg\" (UniqueName: \"kubernetes.io/projected/7005cfcb-1670-4693-be3a-c46b6ccffba3-kube-api-access-5clrg\") pod \"kube-auth-proxy-6bb4c8f6-5zfgr\" (UID: \"7005cfcb-1670-4693-be3a-c46b6ccffba3\") " pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"
Sep 16 00:39:08.773783 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.773757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7005cfcb-1670-4693-be3a-c46b6ccffba3-tmp\") pod \"kube-auth-proxy-6bb4c8f6-5zfgr\" (UID: \"7005cfcb-1670-4693-be3a-c46b6ccffba3\") " pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"
Sep 16 00:39:08.774023 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.774003    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7005cfcb-1670-4693-be3a-c46b6ccffba3-tls-certs\") pod \"kube-auth-proxy-6bb4c8f6-5zfgr\" (UID: \"7005cfcb-1670-4693-be3a-c46b6ccffba3\") " pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"
Sep 16 00:39:08.778749 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.778720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5clrg\" (UniqueName: \"kubernetes.io/projected/7005cfcb-1670-4693-be3a-c46b6ccffba3-kube-api-access-5clrg\") pod \"kube-auth-proxy-6bb4c8f6-5zfgr\" (UID: \"7005cfcb-1670-4693-be3a-c46b6ccffba3\") " pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"
Sep 16 00:39:08.927321 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:08.927236    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"
Sep 16 00:39:09.576452 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:09.576287    2563 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 00:39:09.751584 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:09.751525    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr"]
Sep 16 00:39:09.753570 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:39:09.753545    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7005cfcb_1670_4693_be3a_c46b6ccffba3.slice/crio-c99f5835787e7a3e734eac513894c99f76412f5200c9f8a2b3995d13a973a86d WatchSource:0}: Error finding container c99f5835787e7a3e734eac513894c99f76412f5200c9f8a2b3995d13a973a86d: Status 404 returned error can't find the container with id c99f5835787e7a3e734eac513894c99f76412f5200c9f8a2b3995d13a973a86d
Sep 16 00:39:09.974989 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:09.974949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr" event={"ID":"7005cfcb-1670-4693-be3a-c46b6ccffba3","Type":"ContainerStarted","Data":"c99f5835787e7a3e734eac513894c99f76412f5200c9f8a2b3995d13a973a86d"}
Sep 16 00:39:09.976509 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:09.976482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5" event={"ID":"f51604b0-65c0-44e7-a8ee-d7f1516ede35","Type":"ContainerStarted","Data":"52d2d1a71fb78dc7267a23c6706985acbfc935dff6358a2e044453424fa188d3"}
Sep 16 00:39:09.976632 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:09.976616    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:39:10.002248 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:10.002143    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5" podStartSLOduration=1.279134976 podStartE2EDuration="4.002123748s" totalImagesPullingTime="2.722988772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:39:10.000864071 +0000 UTC m=+300.803687143" watchObservedRunningTime="2026-09-16 00:39:10.002123748 +0000 UTC m=+300.804946811"
Sep 16 00:39:12.323693 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:12.323656    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 16 00:39:12.993510 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:12.993470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr" event={"ID":"7005cfcb-1670-4693-be3a-c46b6ccffba3","Type":"ContainerStarted","Data":"232ae5f6a54e8b2a075f79db661b12e5bece858a67a076be487a50e8b3e915f2"}
Sep 16 00:39:13.018696 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:13.018629    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6bb4c8f6-5zfgr" podStartSLOduration=2.452269962 podStartE2EDuration="5.018610168s" totalImagesPullingTime="2.566340206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:39:13.007510635 +0000 UTC m=+303.810333698" watchObservedRunningTime="2026-09-16 00:39:13.018610168 +0000 UTC m=+303.821433231"
Sep 16 00:39:20.984716 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:39:20.984653    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-864798458c-glhn5"
Sep 16 00:40:07.221964 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.221885    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75b54c7b5f-46z8r"]
Sep 16 00:40:07.224985 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.224967    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.228636 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.228614    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 00:40:07.229536 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.229515    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 00:40:07.229688 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.229543    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 00:40:07.229833 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.229815    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 00:40:07.230359 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.230336    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 00:40:07.230468 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.230406    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 00:40:07.230539 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.230408    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 00:40:07.230860 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.230836    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fwwz4\""
Sep 16 00:40:07.233368 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.233347    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 00:40:07.239433 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.239406    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b54c7b5f-46z8r"]
Sep 16 00:40:07.282520 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.282481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52aaff72-069a-4d13-a761-6963180670d2-console-config\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.282520 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.282527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52aaff72-069a-4d13-a761-6963180670d2-service-ca\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.282767 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.282548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52aaff72-069a-4d13-a761-6963180670d2-console-oauth-config\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.282767 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.282601    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52aaff72-069a-4d13-a761-6963180670d2-trusted-ca-bundle\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.282767 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.282660    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhcbq\" (UniqueName: \"kubernetes.io/projected/52aaff72-069a-4d13-a761-6963180670d2-kube-api-access-bhcbq\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.282863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.282787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52aaff72-069a-4d13-a761-6963180670d2-console-serving-cert\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.282863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.282821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52aaff72-069a-4d13-a761-6963180670d2-oauth-serving-cert\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.383899 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.383862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52aaff72-069a-4d13-a761-6963180670d2-console-serving-cert\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.383899 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.383900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52aaff72-069a-4d13-a761-6963180670d2-oauth-serving-cert\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.384142 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.383921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52aaff72-069a-4d13-a761-6963180670d2-console-config\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.384142 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.383947    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52aaff72-069a-4d13-a761-6963180670d2-service-ca\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.384142 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.383970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52aaff72-069a-4d13-a761-6963180670d2-console-oauth-config\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.384142 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.384000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52aaff72-069a-4d13-a761-6963180670d2-trusted-ca-bundle\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.384142 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.384036    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhcbq\" (UniqueName: \"kubernetes.io/projected/52aaff72-069a-4d13-a761-6963180670d2-kube-api-access-bhcbq\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.384790 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.384700    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52aaff72-069a-4d13-a761-6963180670d2-console-config\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.384790 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.384799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52aaff72-069a-4d13-a761-6963180670d2-oauth-serving-cert\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.385093 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.384942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52aaff72-069a-4d13-a761-6963180670d2-trusted-ca-bundle\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.385093 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.385045    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52aaff72-069a-4d13-a761-6963180670d2-service-ca\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.386796 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.386774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52aaff72-069a-4d13-a761-6963180670d2-console-oauth-config\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.386898 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.386847    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52aaff72-069a-4d13-a761-6963180670d2-console-serving-cert\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.392304 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.392282    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhcbq\" (UniqueName: \"kubernetes.io/projected/52aaff72-069a-4d13-a761-6963180670d2-kube-api-access-bhcbq\") pod \"console-75b54c7b5f-46z8r\" (UID: \"52aaff72-069a-4d13-a761-6963180670d2\") " pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.535087 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.534996    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:07.807738 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:07.807539    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b54c7b5f-46z8r"]
Sep 16 00:40:07.810365 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:40:07.810332    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52aaff72_069a_4d13_a761_6963180670d2.slice/crio-7660602bfddb8433ddfac8886cfd1b83e2da016e4703f1cca14cf569b42ba5f3 WatchSource:0}: Error finding container 7660602bfddb8433ddfac8886cfd1b83e2da016e4703f1cca14cf569b42ba5f3: Status 404 returned error can't find the container with id 7660602bfddb8433ddfac8886cfd1b83e2da016e4703f1cca14cf569b42ba5f3
Sep 16 00:40:08.223250 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:08.223212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b54c7b5f-46z8r" event={"ID":"52aaff72-069a-4d13-a761-6963180670d2","Type":"ContainerStarted","Data":"8475f88d421000b8b10e9797440fac523556aa150317a99811b00c55ed7fd754"}
Sep 16 00:40:08.223629 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:08.223264    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b54c7b5f-46z8r" event={"ID":"52aaff72-069a-4d13-a761-6963180670d2","Type":"ContainerStarted","Data":"7660602bfddb8433ddfac8886cfd1b83e2da016e4703f1cca14cf569b42ba5f3"}
Sep 16 00:40:08.244686 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:08.242178    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75b54c7b5f-46z8r" podStartSLOduration=1.24215813 podStartE2EDuration="1.24215813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:40:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:40:08.238591893 +0000 UTC m=+359.041414957" watchObservedRunningTime="2026-09-16 00:40:08.24215813 +0000 UTC m=+359.044981194"
Sep 16 00:40:17.536061 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:17.536006    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:17.536438 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:17.536098    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:17.540908 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:17.540890    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:18.271637 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:18.271609    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75b54c7b5f-46z8r"
Sep 16 00:40:55.098231 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.098195    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"]
Sep 16 00:40:55.101806 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.101790    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"
Sep 16 00:40:55.104074 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.104041    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 00:40:55.104204 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.104062    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 16 00:40:55.104204 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.104100    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 16 00:40:55.104204 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.104123    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 00:40:55.104658 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.104645    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6z2cb\""
Sep 16 00:40:55.108181 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.108154    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"]
Sep 16 00:40:55.202129 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.202094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ca0a5c9-bf64-499f-88dd-0d8462228e9f-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-ltsw4\" (UID: \"6ca0a5c9-bf64-499f-88dd-0d8462228e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"
Sep 16 00:40:55.202303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.202141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98mq8\" (UniqueName: \"kubernetes.io/projected/6ca0a5c9-bf64-499f-88dd-0d8462228e9f-kube-api-access-98mq8\") pod \"kuadrant-console-plugin-fbdd4f445-ltsw4\" (UID: \"6ca0a5c9-bf64-499f-88dd-0d8462228e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"
Sep 16 00:40:55.202303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.202227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6ca0a5c9-bf64-499f-88dd-0d8462228e9f-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-ltsw4\" (UID: \"6ca0a5c9-bf64-499f-88dd-0d8462228e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"
Sep 16 00:40:55.303560 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.303521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6ca0a5c9-bf64-499f-88dd-0d8462228e9f-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-ltsw4\" (UID: \"6ca0a5c9-bf64-499f-88dd-0d8462228e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"
Sep 16 00:40:55.303752 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.303592    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ca0a5c9-bf64-499f-88dd-0d8462228e9f-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-ltsw4\" (UID: \"6ca0a5c9-bf64-499f-88dd-0d8462228e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"
Sep 16 00:40:55.303752 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.303623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98mq8\" (UniqueName: \"kubernetes.io/projected/6ca0a5c9-bf64-499f-88dd-0d8462228e9f-kube-api-access-98mq8\") pod \"kuadrant-console-plugin-fbdd4f445-ltsw4\" (UID: \"6ca0a5c9-bf64-499f-88dd-0d8462228e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"
Sep 16 00:40:55.304173 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.304152    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6ca0a5c9-bf64-499f-88dd-0d8462228e9f-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-ltsw4\" (UID: \"6ca0a5c9-bf64-499f-88dd-0d8462228e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"
Sep 16 00:40:55.306293 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.306271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ca0a5c9-bf64-499f-88dd-0d8462228e9f-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-ltsw4\" (UID: \"6ca0a5c9-bf64-499f-88dd-0d8462228e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"
Sep 16 00:40:55.311062 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.311031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98mq8\" (UniqueName: \"kubernetes.io/projected/6ca0a5c9-bf64-499f-88dd-0d8462228e9f-kube-api-access-98mq8\") pod \"kuadrant-console-plugin-fbdd4f445-ltsw4\" (UID: \"6ca0a5c9-bf64-499f-88dd-0d8462228e9f\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"
Sep 16 00:40:55.411835 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.411744    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"
Sep 16 00:40:55.682997 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.682795    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4"]
Sep 16 00:40:55.685643 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:40:55.685613    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ca0a5c9_bf64_499f_88dd_0d8462228e9f.slice/crio-d67f1d8912357f220aa52fa310d3402a1381facfc6ebec5d17d97e414697a6e0 WatchSource:0}: Error finding container d67f1d8912357f220aa52fa310d3402a1381facfc6ebec5d17d97e414697a6e0: Status 404 returned error can't find the container with id d67f1d8912357f220aa52fa310d3402a1381facfc6ebec5d17d97e414697a6e0
Sep 16 00:40:55.687004 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:55.686986    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 00:40:56.434862 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:40:56.434827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4" event={"ID":"6ca0a5c9-bf64-499f-88dd-0d8462228e9f","Type":"ContainerStarted","Data":"d67f1d8912357f220aa52fa310d3402a1381facfc6ebec5d17d97e414697a6e0"}
Sep 16 00:41:01.461427 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:01.461384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4" event={"ID":"6ca0a5c9-bf64-499f-88dd-0d8462228e9f","Type":"ContainerStarted","Data":"ea61455ae288bd0f9efcc4b17843a0d10cacaa137f7ea1f41a6e06050112953a"}
Sep 16 00:41:01.476448 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:01.476390    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ltsw4" podStartSLOduration=1.77309393 podStartE2EDuration="6.476374478s" totalImagesPullingTime="4.703280548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:41:01.475268912 +0000 UTC m=+412.278091966" watchObservedRunningTime="2026-09-16 00:41:01.476374478 +0000 UTC m=+412.279197540"
Sep 16 00:41:04.416834 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:04.416799    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"]
Sep 16 00:41:04.420320 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:04.420302    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:04.423580 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:04.423554    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8hbc7\""
Sep 16 00:41:04.433637 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:04.433612    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"]
Sep 16 00:41:04.483583 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:04.483552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/567a3156-727a-43fe-9850-30e2f89b1642-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-zcbjh\" (UID: \"567a3156-727a-43fe-9850-30e2f89b1642\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:04.483793 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:04.483687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hlxn\" (UniqueName: \"kubernetes.io/projected/567a3156-727a-43fe-9850-30e2f89b1642-kube-api-access-7hlxn\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-zcbjh\" (UID: \"567a3156-727a-43fe-9850-30e2f89b1642\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:04.585043 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:04.584996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/567a3156-727a-43fe-9850-30e2f89b1642-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-zcbjh\" (UID: \"567a3156-727a-43fe-9850-30e2f89b1642\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:04.585207 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:04.585119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hlxn\" (UniqueName: \"kubernetes.io/projected/567a3156-727a-43fe-9850-30e2f89b1642-kube-api-access-7hlxn\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-zcbjh\" (UID: \"567a3156-727a-43fe-9850-30e2f89b1642\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:04.585406 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:04.585387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/567a3156-727a-43fe-9850-30e2f89b1642-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-zcbjh\" (UID: \"567a3156-727a-43fe-9850-30e2f89b1642\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:04.593246 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:04.593218    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hlxn\" (UniqueName: \"kubernetes.io/projected/567a3156-727a-43fe-9850-30e2f89b1642-kube-api-access-7hlxn\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-zcbjh\" (UID: \"567a3156-727a-43fe-9850-30e2f89b1642\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:04.730008 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:04.729962    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:05.017093 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.017068    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"]
Sep 16 00:41:05.019432 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:41:05.019404    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567a3156_727a_43fe_9850_30e2f89b1642.slice/crio-4cecc50af602686412891c0666db3500e2f57fe1a2ba827540e182e0bc62464e WatchSource:0}: Error finding container 4cecc50af602686412891c0666db3500e2f57fe1a2ba827540e182e0bc62464e: Status 404 returned error can't find the container with id 4cecc50af602686412891c0666db3500e2f57fe1a2ba827540e182e0bc62464e
Sep 16 00:41:05.481156 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.481120    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh" event={"ID":"567a3156-727a-43fe-9850-30e2f89b1642","Type":"ContainerStarted","Data":"4cecc50af602686412891c0666db3500e2f57fe1a2ba827540e182e0bc62464e"}
Sep 16 00:41:05.595793 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.595754    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"]
Sep 16 00:41:05.601331 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.601261    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"]
Sep 16 00:41:05.633246 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.633208    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"]
Sep 16 00:41:05.636867 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.636846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"
Sep 16 00:41:05.654812 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.654740    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"]
Sep 16 00:41:05.796605 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.796469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68489ba-1fe2-4387-bed3-c604a7a0b37f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8ddwf\" (UID: \"d68489ba-1fe2-4387-bed3-c604a7a0b37f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"
Sep 16 00:41:05.796807 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.796604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc9gr\" (UniqueName: \"kubernetes.io/projected/d68489ba-1fe2-4387-bed3-c604a7a0b37f-kube-api-access-xc9gr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8ddwf\" (UID: \"d68489ba-1fe2-4387-bed3-c604a7a0b37f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"
Sep 16 00:41:05.898188 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.898143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc9gr\" (UniqueName: \"kubernetes.io/projected/d68489ba-1fe2-4387-bed3-c604a7a0b37f-kube-api-access-xc9gr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8ddwf\" (UID: \"d68489ba-1fe2-4387-bed3-c604a7a0b37f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"
Sep 16 00:41:05.898380 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.898304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68489ba-1fe2-4387-bed3-c604a7a0b37f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8ddwf\" (UID: \"d68489ba-1fe2-4387-bed3-c604a7a0b37f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"
Sep 16 00:41:05.899163 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.899111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68489ba-1fe2-4387-bed3-c604a7a0b37f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8ddwf\" (UID: \"d68489ba-1fe2-4387-bed3-c604a7a0b37f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"
Sep 16 00:41:05.907357 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.907299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc9gr\" (UniqueName: \"kubernetes.io/projected/d68489ba-1fe2-4387-bed3-c604a7a0b37f-kube-api-access-xc9gr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8ddwf\" (UID: \"d68489ba-1fe2-4387-bed3-c604a7a0b37f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"
Sep 16 00:41:05.952954 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:05.952883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"
Sep 16 00:41:06.243453 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:06.243415    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"]
Sep 16 00:41:06.891064 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:41:06.891024    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68489ba_1fe2_4387_bed3_c604a7a0b37f.slice/crio-891622bc1b5b487f8ccf5a93972500b618a4323fc35a2f45ba6447eb4c003e7c WatchSource:0}: Error finding container 891622bc1b5b487f8ccf5a93972500b618a4323fc35a2f45ba6447eb4c003e7c: Status 404 returned error can't find the container with id 891622bc1b5b487f8ccf5a93972500b618a4323fc35a2f45ba6447eb4c003e7c
Sep 16 00:41:07.502632 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:07.502584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf" event={"ID":"d68489ba-1fe2-4387-bed3-c604a7a0b37f","Type":"ContainerStarted","Data":"891622bc1b5b487f8ccf5a93972500b618a4323fc35a2f45ba6447eb4c003e7c"}
Sep 16 00:41:10.520749 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:10.520713    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf" event={"ID":"d68489ba-1fe2-4387-bed3-c604a7a0b37f","Type":"ContainerStarted","Data":"7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9"}
Sep 16 00:41:10.521209 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:10.520817    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"
Sep 16 00:41:10.522535 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:10.522507    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh" podUID="567a3156-727a-43fe-9850-30e2f89b1642" containerName="manager" containerID="cri-o://c168ab7427b6290979231671821912040d23d6c20eef3fc1116b6c3707e43481" gracePeriod=2
Sep 16 00:41:10.539098 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:10.539044    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf" podStartSLOduration=2.861313067 podStartE2EDuration="5.539027236s" totalImagesPullingTime="2.677714169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:41:10.5375718 +0000 UTC m=+421.340394865" watchObservedRunningTime="2026-09-16 00:41:10.539027236 +0000 UTC m=+421.341850300"
Sep 16 00:41:10.539482 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:41:10.539454    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-zcbjh\" is forbidden: User \"system:node:ip-10-0-136-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-16.ec2.internal' and this object" podUID="567a3156-727a-43fe-9850-30e2f89b1642" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:10.767784 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:10.767755    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:10.784552 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:41:10.784483    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-zcbjh\" is forbidden: User \"system:node:ip-10-0-136-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-16.ec2.internal' and this object" podUID="567a3156-727a-43fe-9850-30e2f89b1642" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:10.845785 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:10.845750    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hlxn\" (UniqueName: \"kubernetes.io/projected/567a3156-727a-43fe-9850-30e2f89b1642-kube-api-access-7hlxn\") pod \"567a3156-727a-43fe-9850-30e2f89b1642\" (UID: \"567a3156-727a-43fe-9850-30e2f89b1642\") "
Sep 16 00:41:10.845961 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:10.845811    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/567a3156-727a-43fe-9850-30e2f89b1642-extensions-socket-volume\") pod \"567a3156-727a-43fe-9850-30e2f89b1642\" (UID: \"567a3156-727a-43fe-9850-30e2f89b1642\") "
Sep 16 00:41:10.846091 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:10.846068    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567a3156-727a-43fe-9850-30e2f89b1642-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "567a3156-727a-43fe-9850-30e2f89b1642" (UID: "567a3156-727a-43fe-9850-30e2f89b1642"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:41:10.848021 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:10.847989    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/567a3156-727a-43fe-9850-30e2f89b1642-kube-api-access-7hlxn" (OuterVolumeSpecName: "kube-api-access-7hlxn") pod "567a3156-727a-43fe-9850-30e2f89b1642" (UID: "567a3156-727a-43fe-9850-30e2f89b1642"). InnerVolumeSpecName "kube-api-access-7hlxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:41:10.947114 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:10.947077    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hlxn\" (UniqueName: \"kubernetes.io/projected/567a3156-727a-43fe-9850-30e2f89b1642-kube-api-access-7hlxn\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:41:10.947114 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:10.947108    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/567a3156-727a-43fe-9850-30e2f89b1642-extensions-socket-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:41:11.528829 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:11.528792    2563 generic.go:356] "Generic (PLEG): container finished" podID="567a3156-727a-43fe-9850-30e2f89b1642" containerID="c168ab7427b6290979231671821912040d23d6c20eef3fc1116b6c3707e43481" exitCode=2
Sep 16 00:41:11.529263 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:11.528846    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:11.529263 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:11.528906    2563 scope.go:117] "RemoveContainer" containerID="c168ab7427b6290979231671821912040d23d6c20eef3fc1116b6c3707e43481"
Sep 16 00:41:11.531001 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:41:11.530971    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-zcbjh\" is forbidden: User \"system:node:ip-10-0-136-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-16.ec2.internal' and this object" podUID="567a3156-727a-43fe-9850-30e2f89b1642" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:11.537926 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:11.537896    2563 scope.go:117] "RemoveContainer" containerID="c168ab7427b6290979231671821912040d23d6c20eef3fc1116b6c3707e43481"
Sep 16 00:41:11.538240 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:41:11.538220    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c168ab7427b6290979231671821912040d23d6c20eef3fc1116b6c3707e43481\": container with ID starting with c168ab7427b6290979231671821912040d23d6c20eef3fc1116b6c3707e43481 not found: ID does not exist" containerID="c168ab7427b6290979231671821912040d23d6c20eef3fc1116b6c3707e43481"
Sep 16 00:41:11.538316 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:11.538247    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c168ab7427b6290979231671821912040d23d6c20eef3fc1116b6c3707e43481"} err="failed to get container status \"c168ab7427b6290979231671821912040d23d6c20eef3fc1116b6c3707e43481\": rpc error: code = NotFound desc = could not find container \"c168ab7427b6290979231671821912040d23d6c20eef3fc1116b6c3707e43481\": container with ID starting with c168ab7427b6290979231671821912040d23d6c20eef3fc1116b6c3707e43481 not found: ID does not exist"
Sep 16 00:41:11.538952 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:41:11.538927    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-zcbjh\" is forbidden: User \"system:node:ip-10-0-136-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-16.ec2.internal' and this object" podUID="567a3156-727a-43fe-9850-30e2f89b1642" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-zcbjh"
Sep 16 00:41:11.667777 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:11.667748    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="567a3156-727a-43fe-9850-30e2f89b1642" path="/var/lib/kubelet/pods/567a3156-727a-43fe-9850-30e2f89b1642/volumes"
Sep 16 00:41:18.634701 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:18.634644    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"]
Sep 16 00:41:18.635216 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:18.634945    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf" podUID="d68489ba-1fe2-4387-bed3-c604a7a0b37f" containerName="manager" containerID="cri-o://7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9" gracePeriod=10
Sep 16 00:41:18.637079 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:18.637056    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"
Sep 16 00:41:18.837039 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:18.837008    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"]
Sep 16 00:41:18.837453 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:18.837438    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="567a3156-727a-43fe-9850-30e2f89b1642" containerName="manager"
Sep 16 00:41:18.837507 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:18.837455    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="567a3156-727a-43fe-9850-30e2f89b1642" containerName="manager"
Sep 16 00:41:18.837540 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:18.837519    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="567a3156-727a-43fe-9850-30e2f89b1642" containerName="manager"
Sep 16 00:41:18.840516 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:18.840499    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"
Sep 16 00:41:18.851829 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:18.851804    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"]
Sep 16 00:41:18.895014 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:18.894949    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"
Sep 16 00:41:19.017159 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.017121    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc9gr\" (UniqueName: \"kubernetes.io/projected/d68489ba-1fe2-4387-bed3-c604a7a0b37f-kube-api-access-xc9gr\") pod \"d68489ba-1fe2-4387-bed3-c604a7a0b37f\" (UID: \"d68489ba-1fe2-4387-bed3-c604a7a0b37f\") "
Sep 16 00:41:19.017352 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.017215    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68489ba-1fe2-4387-bed3-c604a7a0b37f-extensions-socket-volume\") pod \"d68489ba-1fe2-4387-bed3-c604a7a0b37f\" (UID: \"d68489ba-1fe2-4387-bed3-c604a7a0b37f\") "
Sep 16 00:41:19.017352 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.017310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29d88d27-904c-49e8-b284-26a5d2ad9974-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w4djq\" (UID: \"29d88d27-904c-49e8-b284-26a5d2ad9974\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"
Sep 16 00:41:19.017485 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.017356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjv5k\" (UniqueName: \"kubernetes.io/projected/29d88d27-904c-49e8-b284-26a5d2ad9974-kube-api-access-jjv5k\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w4djq\" (UID: \"29d88d27-904c-49e8-b284-26a5d2ad9974\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"
Sep 16 00:41:19.017779 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.017752    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68489ba-1fe2-4387-bed3-c604a7a0b37f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d68489ba-1fe2-4387-bed3-c604a7a0b37f" (UID: "d68489ba-1fe2-4387-bed3-c604a7a0b37f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:41:19.019386 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.019363    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68489ba-1fe2-4387-bed3-c604a7a0b37f-kube-api-access-xc9gr" (OuterVolumeSpecName: "kube-api-access-xc9gr") pod "d68489ba-1fe2-4387-bed3-c604a7a0b37f" (UID: "d68489ba-1fe2-4387-bed3-c604a7a0b37f"). InnerVolumeSpecName "kube-api-access-xc9gr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:41:19.118458 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.118419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29d88d27-904c-49e8-b284-26a5d2ad9974-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w4djq\" (UID: \"29d88d27-904c-49e8-b284-26a5d2ad9974\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"
Sep 16 00:41:19.118632 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.118482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjv5k\" (UniqueName: \"kubernetes.io/projected/29d88d27-904c-49e8-b284-26a5d2ad9974-kube-api-access-jjv5k\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w4djq\" (UID: \"29d88d27-904c-49e8-b284-26a5d2ad9974\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"
Sep 16 00:41:19.118632 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.118527    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68489ba-1fe2-4387-bed3-c604a7a0b37f-extensions-socket-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:41:19.118632 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.118537    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc9gr\" (UniqueName: \"kubernetes.io/projected/d68489ba-1fe2-4387-bed3-c604a7a0b37f-kube-api-access-xc9gr\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:41:19.118860 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.118837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29d88d27-904c-49e8-b284-26a5d2ad9974-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w4djq\" (UID: \"29d88d27-904c-49e8-b284-26a5d2ad9974\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"
Sep 16 00:41:19.127011 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.126978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjv5k\" (UniqueName: \"kubernetes.io/projected/29d88d27-904c-49e8-b284-26a5d2ad9974-kube-api-access-jjv5k\") pod \"kuadrant-operator-controller-manager-5769f99d9f-w4djq\" (UID: \"29d88d27-904c-49e8-b284-26a5d2ad9974\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"
Sep 16 00:41:19.151825 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.151760    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"
Sep 16 00:41:19.429623 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.429600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"]
Sep 16 00:41:19.431725 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:41:19.431686    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d88d27_904c_49e8_b284_26a5d2ad9974.slice/crio-737c3be8765deb387e2141d75c3ee0da009a3bcb069160508d4a91ff82d118b9 WatchSource:0}: Error finding container 737c3be8765deb387e2141d75c3ee0da009a3bcb069160508d4a91ff82d118b9: Status 404 returned error can't find the container with id 737c3be8765deb387e2141d75c3ee0da009a3bcb069160508d4a91ff82d118b9
Sep 16 00:41:19.566826 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.566787    2563 generic.go:356] "Generic (PLEG): container finished" podID="d68489ba-1fe2-4387-bed3-c604a7a0b37f" containerID="7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9" exitCode=0
Sep 16 00:41:19.567004 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.566842    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"
Sep 16 00:41:19.567004 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.566878    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf" event={"ID":"d68489ba-1fe2-4387-bed3-c604a7a0b37f","Type":"ContainerDied","Data":"7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9"}
Sep 16 00:41:19.567004 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.566933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf" event={"ID":"d68489ba-1fe2-4387-bed3-c604a7a0b37f","Type":"ContainerDied","Data":"891622bc1b5b487f8ccf5a93972500b618a4323fc35a2f45ba6447eb4c003e7c"}
Sep 16 00:41:19.567004 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.566960    2563 scope.go:117] "RemoveContainer" containerID="7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9"
Sep 16 00:41:19.569082 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.569060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq" event={"ID":"29d88d27-904c-49e8-b284-26a5d2ad9974","Type":"ContainerStarted","Data":"19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333"}
Sep 16 00:41:19.569167 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.569103    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq" event={"ID":"29d88d27-904c-49e8-b284-26a5d2ad9974","Type":"ContainerStarted","Data":"737c3be8765deb387e2141d75c3ee0da009a3bcb069160508d4a91ff82d118b9"}
Sep 16 00:41:19.569211 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.569198    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"
Sep 16 00:41:19.576689 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.576643    2563 scope.go:117] "RemoveContainer" containerID="7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9"
Sep 16 00:41:19.577000 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:41:19.576980    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9\": container with ID starting with 7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9 not found: ID does not exist" containerID="7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9"
Sep 16 00:41:19.577055 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.577010    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9"} err="failed to get container status \"7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9\": rpc error: code = NotFound desc = could not find container \"7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9\": container with ID starting with 7bd1346c8f8d8d579ab08fc4c09a2743e7922b3059f068f482b8d5329ec706a9 not found: ID does not exist"
Sep 16 00:41:19.592395 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.592348    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq" podStartSLOduration=1.5923333039999998 podStartE2EDuration="1.592333304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:41:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:41:19.590317824 +0000 UTC m=+430.393140886" watchObservedRunningTime="2026-09-16 00:41:19.592333304 +0000 UTC m=+430.395156367"
Sep 16 00:41:19.604571 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.604542    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"]
Sep 16 00:41:19.609840 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.609814    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8ddwf"]
Sep 16 00:41:19.666848 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:19.666819    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68489ba-1fe2-4387-bed3-c604a7a0b37f" path="/var/lib/kubelet/pods/d68489ba-1fe2-4387-bed3-c604a7a0b37f/volumes"
Sep 16 00:41:30.576404 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:30.576326    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"
Sep 16 00:41:49.388219 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.388184    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-z24rw"]
Sep 16 00:41:49.388694 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.388542    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68489ba-1fe2-4387-bed3-c604a7a0b37f" containerName="manager"
Sep 16 00:41:49.388694 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.388554    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68489ba-1fe2-4387-bed3-c604a7a0b37f" containerName="manager"
Sep 16 00:41:49.388694 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.388616    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68489ba-1fe2-4387-bed3-c604a7a0b37f" containerName="manager"
Sep 16 00:41:49.404518 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.404487    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-z24rw"]
Sep 16 00:41:49.404692 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.404587    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw"
Sep 16 00:41:49.406721 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.406700    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mc4dw\""
Sep 16 00:41:49.470491 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.470458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pwg8\" (UniqueName: \"kubernetes.io/projected/0851d545-a7ac-40c1-81fa-807cb7297a4d-kube-api-access-9pwg8\") pod \"authorino-7bcfd8f9cd-z24rw\" (UID: \"0851d545-a7ac-40c1-81fa-807cb7297a4d\") " pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw"
Sep 16 00:41:49.521577 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.521542    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-z7xbr"]
Sep 16 00:41:49.524092 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.524070    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-z7xbr"
Sep 16 00:41:49.533171 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.533141    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-z7xbr"]
Sep 16 00:41:49.571660 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.571615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pwg8\" (UniqueName: \"kubernetes.io/projected/0851d545-a7ac-40c1-81fa-807cb7297a4d-kube-api-access-9pwg8\") pod \"authorino-7bcfd8f9cd-z24rw\" (UID: \"0851d545-a7ac-40c1-81fa-807cb7297a4d\") " pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw"
Sep 16 00:41:49.571872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.571751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spn2q\" (UniqueName: \"kubernetes.io/projected/4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b-kube-api-access-spn2q\") pod \"authorino-59c974bd48-z7xbr\" (UID: \"4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b\") " pod="kuadrant-system/authorino-59c974bd48-z7xbr"
Sep 16 00:41:49.579104 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.579074    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pwg8\" (UniqueName: \"kubernetes.io/projected/0851d545-a7ac-40c1-81fa-807cb7297a4d-kube-api-access-9pwg8\") pod \"authorino-7bcfd8f9cd-z24rw\" (UID: \"0851d545-a7ac-40c1-81fa-807cb7297a4d\") " pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw"
Sep 16 00:41:49.672780 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.672689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spn2q\" (UniqueName: \"kubernetes.io/projected/4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b-kube-api-access-spn2q\") pod \"authorino-59c974bd48-z7xbr\" (UID: \"4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b\") " pod="kuadrant-system/authorino-59c974bd48-z7xbr"
Sep 16 00:41:49.680345 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.680314    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spn2q\" (UniqueName: \"kubernetes.io/projected/4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b-kube-api-access-spn2q\") pod \"authorino-59c974bd48-z7xbr\" (UID: \"4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b\") " pod="kuadrant-system/authorino-59c974bd48-z7xbr"
Sep 16 00:41:49.714209 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.714180    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw"
Sep 16 00:41:49.834047 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.834007    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-z7xbr"
Sep 16 00:41:49.980157 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:49.979986    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-z24rw"]
Sep 16 00:41:49.982418 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:41:49.982390    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0851d545_a7ac_40c1_81fa_807cb7297a4d.slice/crio-1c46e746665ec93034c5c464739e10e53e38c33d464795d647f0a6a9d868674a WatchSource:0}: Error finding container 1c46e746665ec93034c5c464739e10e53e38c33d464795d647f0a6a9d868674a: Status 404 returned error can't find the container with id 1c46e746665ec93034c5c464739e10e53e38c33d464795d647f0a6a9d868674a
Sep 16 00:41:50.101867 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:50.101836    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-z7xbr"]
Sep 16 00:41:50.104791 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:41:50.104752    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fcb8ce5_74e3_467e_a10a_b970fa7a1f8b.slice/crio-c591523248231f6987267a14f6eb959aa5dca2ac128123809870351d62a0e130 WatchSource:0}: Error finding container c591523248231f6987267a14f6eb959aa5dca2ac128123809870351d62a0e130: Status 404 returned error can't find the container with id c591523248231f6987267a14f6eb959aa5dca2ac128123809870351d62a0e130
Sep 16 00:41:50.719906 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:50.719870    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw" event={"ID":"0851d545-a7ac-40c1-81fa-807cb7297a4d","Type":"ContainerStarted","Data":"1c46e746665ec93034c5c464739e10e53e38c33d464795d647f0a6a9d868674a"}
Sep 16 00:41:50.721127 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:50.721099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-z7xbr" event={"ID":"4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b","Type":"ContainerStarted","Data":"c591523248231f6987267a14f6eb959aa5dca2ac128123809870351d62a0e130"}
Sep 16 00:41:52.735229 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:52.735195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw" event={"ID":"0851d545-a7ac-40c1-81fa-807cb7297a4d","Type":"ContainerStarted","Data":"dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d"}
Sep 16 00:41:52.736833 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:52.736801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-z7xbr" event={"ID":"4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b","Type":"ContainerStarted","Data":"55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48"}
Sep 16 00:41:52.749518 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:52.749470    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw" podStartSLOduration=1.913418101 podStartE2EDuration="3.749453723s" totalImagesPullingTime="1.836035622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:41:52.748157657 +0000 UTC m=+463.550980720" watchObservedRunningTime="2026-09-16 00:41:52.749453723 +0000 UTC m=+463.552276786"
Sep 16 00:41:52.764272 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:52.764212    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-z7xbr" podStartSLOduration=2.045748613 podStartE2EDuration="3.76418987s" totalImagesPullingTime="1.718441257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:41:52.763158882 +0000 UTC m=+463.565981946" watchObservedRunningTime="2026-09-16 00:41:52.76418987 +0000 UTC m=+463.567012935"
Sep 16 00:41:52.786382 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:52.786344    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-z24rw"]
Sep 16 00:41:54.746343 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:54.746296    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw" podUID="0851d545-a7ac-40c1-81fa-807cb7297a4d" containerName="authorino" containerID="cri-o://dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d" gracePeriod=30
Sep 16 00:41:54.983639 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:54.983616    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw"
Sep 16 00:41:55.124156 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:55.124066    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pwg8\" (UniqueName: \"kubernetes.io/projected/0851d545-a7ac-40c1-81fa-807cb7297a4d-kube-api-access-9pwg8\") pod \"0851d545-a7ac-40c1-81fa-807cb7297a4d\" (UID: \"0851d545-a7ac-40c1-81fa-807cb7297a4d\") "
Sep 16 00:41:55.126248 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:55.126221    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0851d545-a7ac-40c1-81fa-807cb7297a4d-kube-api-access-9pwg8" (OuterVolumeSpecName: "kube-api-access-9pwg8") pod "0851d545-a7ac-40c1-81fa-807cb7297a4d" (UID: "0851d545-a7ac-40c1-81fa-807cb7297a4d"). InnerVolumeSpecName "kube-api-access-9pwg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:41:55.224801 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:55.224762    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pwg8\" (UniqueName: \"kubernetes.io/projected/0851d545-a7ac-40c1-81fa-807cb7297a4d-kube-api-access-9pwg8\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:41:55.752104 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:55.752071    2563 generic.go:356] "Generic (PLEG): container finished" podID="0851d545-a7ac-40c1-81fa-807cb7297a4d" containerID="dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d" exitCode=0
Sep 16 00:41:55.752544 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:55.752118    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw"
Sep 16 00:41:55.752544 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:55.752137    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw" event={"ID":"0851d545-a7ac-40c1-81fa-807cb7297a4d","Type":"ContainerDied","Data":"dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d"}
Sep 16 00:41:55.752544 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:55.752168    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-z24rw" event={"ID":"0851d545-a7ac-40c1-81fa-807cb7297a4d","Type":"ContainerDied","Data":"1c46e746665ec93034c5c464739e10e53e38c33d464795d647f0a6a9d868674a"}
Sep 16 00:41:55.752544 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:55.752186    2563 scope.go:117] "RemoveContainer" containerID="dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d"
Sep 16 00:41:55.761066 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:55.761044    2563 scope.go:117] "RemoveContainer" containerID="dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d"
Sep 16 00:41:55.761376 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:41:55.761357    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d\": container with ID starting with dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d not found: ID does not exist" containerID="dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d"
Sep 16 00:41:55.761434 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:55.761386    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d"} err="failed to get container status \"dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d\": rpc error: code = NotFound desc = could not find container \"dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d\": container with ID starting with dc9493ad056caa5b8a1f58137e391c929dea1a8849dcaa36a3f6f796252e851d not found: ID does not exist"
Sep 16 00:41:55.766515 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:55.766492    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-z24rw"]
Sep 16 00:41:55.768264 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:55.768245    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-z24rw"]
Sep 16 00:41:57.668396 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:41:57.668364    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0851d545-a7ac-40c1-81fa-807cb7297a4d" path="/var/lib/kubelet/pods/0851d545-a7ac-40c1-81fa-807cb7297a4d/volumes"
Sep 16 00:42:19.773806 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.773777    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-854b45cf68-vm6ds"]
Sep 16 00:42:19.774224 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.774105    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0851d545-a7ac-40c1-81fa-807cb7297a4d" containerName="authorino"
Sep 16 00:42:19.774224 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.774117    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0851d545-a7ac-40c1-81fa-807cb7297a4d" containerName="authorino"
Sep 16 00:42:19.774224 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.774171    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0851d545-a7ac-40c1-81fa-807cb7297a4d" containerName="authorino"
Sep 16 00:42:19.776521 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.776504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854b45cf68-vm6ds"
Sep 16 00:42:19.778747 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.778729    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 16 00:42:19.782829 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.782806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-854b45cf68-vm6ds"]
Sep 16 00:42:19.849262 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.849229    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9287f24f-2789-4be0-a628-a89361c87733-tls-cert\") pod \"authorino-854b45cf68-vm6ds\" (UID: \"9287f24f-2789-4be0-a628-a89361c87733\") " pod="kuadrant-system/authorino-854b45cf68-vm6ds"
Sep 16 00:42:19.849262 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.849265    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6dpt\" (UniqueName: \"kubernetes.io/projected/9287f24f-2789-4be0-a628-a89361c87733-kube-api-access-v6dpt\") pod \"authorino-854b45cf68-vm6ds\" (UID: \"9287f24f-2789-4be0-a628-a89361c87733\") " pod="kuadrant-system/authorino-854b45cf68-vm6ds"
Sep 16 00:42:19.949951 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.949908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9287f24f-2789-4be0-a628-a89361c87733-tls-cert\") pod \"authorino-854b45cf68-vm6ds\" (UID: \"9287f24f-2789-4be0-a628-a89361c87733\") " pod="kuadrant-system/authorino-854b45cf68-vm6ds"
Sep 16 00:42:19.949951 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.949954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6dpt\" (UniqueName: \"kubernetes.io/projected/9287f24f-2789-4be0-a628-a89361c87733-kube-api-access-v6dpt\") pod \"authorino-854b45cf68-vm6ds\" (UID: \"9287f24f-2789-4be0-a628-a89361c87733\") " pod="kuadrant-system/authorino-854b45cf68-vm6ds"
Sep 16 00:42:19.952498 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.952474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9287f24f-2789-4be0-a628-a89361c87733-tls-cert\") pod \"authorino-854b45cf68-vm6ds\" (UID: \"9287f24f-2789-4be0-a628-a89361c87733\") " pod="kuadrant-system/authorino-854b45cf68-vm6ds"
Sep 16 00:42:19.960332 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:19.960301    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6dpt\" (UniqueName: \"kubernetes.io/projected/9287f24f-2789-4be0-a628-a89361c87733-kube-api-access-v6dpt\") pod \"authorino-854b45cf68-vm6ds\" (UID: \"9287f24f-2789-4be0-a628-a89361c87733\") " pod="kuadrant-system/authorino-854b45cf68-vm6ds"
Sep 16 00:42:20.086417 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:20.086327    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854b45cf68-vm6ds"
Sep 16 00:42:20.358413 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:20.358276    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-854b45cf68-vm6ds"]
Sep 16 00:42:20.361044 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:42:20.361013    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9287f24f_2789_4be0_a628_a89361c87733.slice/crio-a41dcfe18c9ef95b19c9e676242bf768c93b1bb54dec2478a36ca03690ec0f54 WatchSource:0}: Error finding container a41dcfe18c9ef95b19c9e676242bf768c93b1bb54dec2478a36ca03690ec0f54: Status 404 returned error can't find the container with id a41dcfe18c9ef95b19c9e676242bf768c93b1bb54dec2478a36ca03690ec0f54
Sep 16 00:42:20.872520 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:20.872481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-854b45cf68-vm6ds" event={"ID":"9287f24f-2789-4be0-a628-a89361c87733","Type":"ContainerStarted","Data":"a41dcfe18c9ef95b19c9e676242bf768c93b1bb54dec2478a36ca03690ec0f54"}
Sep 16 00:42:21.878954 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:21.878921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-854b45cf68-vm6ds" event={"ID":"9287f24f-2789-4be0-a628-a89361c87733","Type":"ContainerStarted","Data":"8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27"}
Sep 16 00:42:21.892625 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:21.892576    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-854b45cf68-vm6ds" podStartSLOduration=2.3704395959999998 podStartE2EDuration="2.892561107s" totalImagesPullingTime="522.121511ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:42:21.891607617 +0000 UTC m=+492.694430679" watchObservedRunningTime="2026-09-16 00:42:21.892561107 +0000 UTC m=+492.695384170"
Sep 16 00:42:21.915570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:21.915527    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-z7xbr"]
Sep 16 00:42:21.915805 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:21.915777    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-z7xbr" podUID="4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b" containerName="authorino" containerID="cri-o://55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48" gracePeriod=30
Sep 16 00:42:22.160222 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.160198    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-z7xbr"
Sep 16 00:42:22.164916 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.164899    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spn2q\" (UniqueName: \"kubernetes.io/projected/4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b-kube-api-access-spn2q\") pod \"4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b\" (UID: \"4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b\") "
Sep 16 00:42:22.167171 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.167141    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b-kube-api-access-spn2q" (OuterVolumeSpecName: "kube-api-access-spn2q") pod "4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b" (UID: "4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b"). InnerVolumeSpecName "kube-api-access-spn2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:42:22.266199 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.266162    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spn2q\" (UniqueName: \"kubernetes.io/projected/4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b-kube-api-access-spn2q\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:42:22.884862 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.884825    2563 generic.go:356] "Generic (PLEG): container finished" podID="4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b" containerID="55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48" exitCode=0
Sep 16 00:42:22.885303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.884878    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-z7xbr"
Sep 16 00:42:22.885303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.884901    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-z7xbr" event={"ID":"4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b","Type":"ContainerDied","Data":"55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48"}
Sep 16 00:42:22.885303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.884942    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-z7xbr" event={"ID":"4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b","Type":"ContainerDied","Data":"c591523248231f6987267a14f6eb959aa5dca2ac128123809870351d62a0e130"}
Sep 16 00:42:22.885303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.884958    2563 scope.go:117] "RemoveContainer" containerID="55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48"
Sep 16 00:42:22.898697 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.898651    2563 scope.go:117] "RemoveContainer" containerID="55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48"
Sep 16 00:42:22.899005 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:42:22.898984    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48\": container with ID starting with 55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48 not found: ID does not exist" containerID="55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48"
Sep 16 00:42:22.899099 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.899014    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48"} err="failed to get container status \"55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48\": rpc error: code = NotFound desc = could not find container \"55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48\": container with ID starting with 55ffd71b356cb44cac3c7f308adb74655b6bac54e450b807263cd59e1c242e48 not found: ID does not exist"
Sep 16 00:42:22.910984 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.910955    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-z7xbr"]
Sep 16 00:42:22.913929 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:22.913904    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-z7xbr"]
Sep 16 00:42:23.668405 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:42:23.668370    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b" path="/var/lib/kubelet/pods/4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b/volumes"
Sep 16 00:43:55.992247 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:55.992214    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"]
Sep 16 00:43:55.992704 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:55.992549    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b" containerName="authorino"
Sep 16 00:43:55.992704 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:55.992560    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b" containerName="authorino"
Sep 16 00:43:55.992704 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:55.992634    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fcb8ce5-74e3-467e-a10a-b970fa7a1f8b" containerName="authorino"
Sep 16 00:43:55.995460 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:55.995442    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:55.997635 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:55.997618    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 00:43:55.997635 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:55.997624    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 16 00:43:55.998250 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:55.998229    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 00:43:55.998369 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:55.998284    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lbjkk\""
Sep 16 00:43:56.002738 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.002714    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"]
Sep 16 00:43:56.092436 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.092405    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.092614 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.092481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.092614 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.092524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.092614 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.092546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg6cz\" (UniqueName: \"kubernetes.io/projected/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-kube-api-access-kg6cz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.092799 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.092637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.092799 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.092699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.193477 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.193424    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.193789 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.193492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.193789 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.193524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.193789 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.193585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.193789 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.193607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.193789 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.193625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg6cz\" (UniqueName: \"kubernetes.io/projected/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-kube-api-access-kg6cz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.194071 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.193920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.194071 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.193958    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.194071 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.194011    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.196044 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.196017    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.196311 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.196289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.200888 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.200865    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg6cz\" (UniqueName: \"kubernetes.io/projected/d4fd71a3-3c8c-4ec4-a814-d769051c4a90-kube-api-access-kg6cz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-c8hzv\" (UID: \"d4fd71a3-3c8c-4ec4-a814-d769051c4a90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.305714 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.305607    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:43:56.575879 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:56.575853    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"]
Sep 16 00:43:56.578808 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:43:56.578783    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4fd71a3_3c8c_4ec4_a814_d769051c4a90.slice/crio-aad86d5b83680666e2b5195d005f299a32c229cee582c9449e6165cff4949532 WatchSource:0}: Error finding container aad86d5b83680666e2b5195d005f299a32c229cee582c9449e6165cff4949532: Status 404 returned error can't find the container with id aad86d5b83680666e2b5195d005f299a32c229cee582c9449e6165cff4949532
Sep 16 00:43:57.320521 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:57.320479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv" event={"ID":"d4fd71a3-3c8c-4ec4-a814-d769051c4a90","Type":"ContainerStarted","Data":"aad86d5b83680666e2b5195d005f299a32c229cee582c9449e6165cff4949532"}
Sep 16 00:43:58.326318 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:58.326278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv" event={"ID":"d4fd71a3-3c8c-4ec4-a814-d769051c4a90","Type":"ContainerStarted","Data":"b4954164cea58e1cdb7a4c865fa65d5d47824ca46d7720a2176e0b809e682044"}
Sep 16 00:43:58.345122 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:43:58.345072    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv" podStartSLOduration=2.240295177 podStartE2EDuration="3.345056276s" totalImagesPullingTime="1.104761099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:43:58.343115644 +0000 UTC m=+589.145938706" watchObservedRunningTime="2026-09-16 00:43:58.345056276 +0000 UTC m=+589.147879339"
Sep 16 00:44:06.305751 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:06.305701    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:44:06.306147 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:06.305778    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:44:06.318706 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:06.318658    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:44:06.374784 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:06.374756    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-c8hzv"
Sep 16 00:44:33.698584 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.698505    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"]
Sep 16 00:44:33.701743 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.701724    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.703805 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.703784    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 16 00:44:33.712569 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.712546    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"]
Sep 16 00:44:33.822515 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.822482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.822740 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.822553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.822740 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.822587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.822740 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.822634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.822923 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.822740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.822923 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.822771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fsm5\" (UniqueName: \"kubernetes.io/projected/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-kube-api-access-9fsm5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.924285 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.924251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.924285 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.924288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.924536 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.924313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.924536 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.924359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.924536 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.924377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fsm5\" (UniqueName: \"kubernetes.io/projected/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-kube-api-access-9fsm5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.924536 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.924415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.924742 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.924714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.924804 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.924785    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.924872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.924851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.926862 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.926842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.927100 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.927082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:33.933549 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:33.933527    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fsm5\" (UniqueName: \"kubernetes.io/projected/bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1-kube-api-access-9fsm5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkh2m\" (UID: \"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:34.013136 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:34.013032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:34.286369 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:34.286207    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"]
Sep 16 00:44:34.289164 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:44:34.289134    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3bbf51_80cc_4b3a_959e_830e6bb6f4a1.slice/crio-56a08859a32d18dd3fe4574e4ece36e240f1601a6ea6748b79935b87321b2e1e WatchSource:0}: Error finding container 56a08859a32d18dd3fe4574e4ece36e240f1601a6ea6748b79935b87321b2e1e: Status 404 returned error can't find the container with id 56a08859a32d18dd3fe4574e4ece36e240f1601a6ea6748b79935b87321b2e1e
Sep 16 00:44:34.489864 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:34.489842    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m" event={"ID":"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1","Type":"ContainerStarted","Data":"56a08859a32d18dd3fe4574e4ece36e240f1601a6ea6748b79935b87321b2e1e"}
Sep 16 00:44:35.497069 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:35.497025    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m" event={"ID":"bc3bbf51-80cc-4b3a-959e-830e6bb6f4a1","Type":"ContainerStarted","Data":"0c3c6c47dbf52cc78b1ebce477922bb08013da8495d07c1e5a6db241ca89ce34"}
Sep 16 00:44:35.515690 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:35.515589    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m" podStartSLOduration=2.327234168 podStartE2EDuration="2.515567376s" totalImagesPullingTime="188.333208ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:44:35.514840709 +0000 UTC m=+626.317663771" watchObservedRunningTime="2026-09-16 00:44:35.515567376 +0000 UTC m=+626.318390440"
Sep 16 00:44:44.013347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:44.013303    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:44.013891 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:44.013656    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:44.025952 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:44.025931    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:44:44.552227 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:44:44.552199    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkh2m"
Sep 16 00:45:20.598016 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.597973    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"]
Sep 16 00:45:20.601707 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.601684    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.603723 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.603702    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 16 00:45:20.609590 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.609567    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"]
Sep 16 00:45:20.742394 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.742361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fdee083-343e-4f9f-8de4-df5b7e6ce131-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.742606 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.742433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fdee083-343e-4f9f-8de4-df5b7e6ce131-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.742606 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.742465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fdee083-343e-4f9f-8de4-df5b7e6ce131-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.742606 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.742495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fdee083-343e-4f9f-8de4-df5b7e6ce131-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.742606 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.742516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fdee083-343e-4f9f-8de4-df5b7e6ce131-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.742606 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.742601    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6rw8\" (UniqueName: \"kubernetes.io/projected/0fdee083-343e-4f9f-8de4-df5b7e6ce131-kube-api-access-l6rw8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.843373 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.843340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fdee083-343e-4f9f-8de4-df5b7e6ce131-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.843570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.843382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fdee083-343e-4f9f-8de4-df5b7e6ce131-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.843570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.843401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fdee083-343e-4f9f-8de4-df5b7e6ce131-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.843570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.843536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6rw8\" (UniqueName: \"kubernetes.io/projected/0fdee083-343e-4f9f-8de4-df5b7e6ce131-kube-api-access-l6rw8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.843757 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.843618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fdee083-343e-4f9f-8de4-df5b7e6ce131-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.843757 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.843693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fdee083-343e-4f9f-8de4-df5b7e6ce131-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.843918 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.843897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fdee083-343e-4f9f-8de4-df5b7e6ce131-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.843976 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.843953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fdee083-343e-4f9f-8de4-df5b7e6ce131-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.844037 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.844018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fdee083-343e-4f9f-8de4-df5b7e6ce131-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.845921 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.845895    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fdee083-343e-4f9f-8de4-df5b7e6ce131-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.846162 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.846144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fdee083-343e-4f9f-8de4-df5b7e6ce131-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.850318 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.850268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6rw8\" (UniqueName: \"kubernetes.io/projected/0fdee083-343e-4f9f-8de4-df5b7e6ce131-kube-api-access-l6rw8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz748\" (UID: \"0fdee083-343e-4f9f-8de4-df5b7e6ce131\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:20.912102 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:20.912065    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:21.185960 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:21.185933    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"]
Sep 16 00:45:21.187735 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:45:21.187709    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fdee083_343e_4f9f_8de4_df5b7e6ce131.slice/crio-828778447b4686ef1ed3735b5df882f2a8b6d8998450a425648c9dc66cadc04c WatchSource:0}: Error finding container 828778447b4686ef1ed3735b5df882f2a8b6d8998450a425648c9dc66cadc04c: Status 404 returned error can't find the container with id 828778447b4686ef1ed3735b5df882f2a8b6d8998450a425648c9dc66cadc04c
Sep 16 00:45:21.718427 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:21.718386    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748" event={"ID":"0fdee083-343e-4f9f-8de4-df5b7e6ce131","Type":"ContainerStarted","Data":"e8c2f5798b95f05bf4e654488388871ae8943dd6f84dfc6732e138f03bd4c311"}
Sep 16 00:45:21.718831 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:21.718435    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748" event={"ID":"0fdee083-343e-4f9f-8de4-df5b7e6ce131","Type":"ContainerStarted","Data":"828778447b4686ef1ed3735b5df882f2a8b6d8998450a425648c9dc66cadc04c"}
Sep 16 00:45:21.734684 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:21.734625    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748" podStartSLOduration=1.5266842569999999 podStartE2EDuration="1.734609788s" totalImagesPullingTime="207.925531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:45:21.73343488 +0000 UTC m=+672.536257942" watchObservedRunningTime="2026-09-16 00:45:21.734609788 +0000 UTC m=+672.537432851"
Sep 16 00:45:30.912638 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:30.912598    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:30.913193 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:30.912657    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:30.925289 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:30.925263    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:45:31.780050 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:45:31.780011    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz748"
Sep 16 00:46:30.999341 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:30.999262    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-595f4fbd5-6r826"]
Sep 16 00:46:31.002782 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:31.002765    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-595f4fbd5-6r826"
Sep 16 00:46:31.009131 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:31.009106    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-595f4fbd5-6r826"]
Sep 16 00:46:31.082398 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:31.082353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r4ms\" (UniqueName: \"kubernetes.io/projected/ae6b72ec-a9cf-499d-8b13-727a051da569-kube-api-access-9r4ms\") pod \"authorino-595f4fbd5-6r826\" (UID: \"ae6b72ec-a9cf-499d-8b13-727a051da569\") " pod="kuadrant-system/authorino-595f4fbd5-6r826"
Sep 16 00:46:31.082591 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:31.082424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ae6b72ec-a9cf-499d-8b13-727a051da569-tls-cert\") pod \"authorino-595f4fbd5-6r826\" (UID: \"ae6b72ec-a9cf-499d-8b13-727a051da569\") " pod="kuadrant-system/authorino-595f4fbd5-6r826"
Sep 16 00:46:31.183753 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:31.183708    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r4ms\" (UniqueName: \"kubernetes.io/projected/ae6b72ec-a9cf-499d-8b13-727a051da569-kube-api-access-9r4ms\") pod \"authorino-595f4fbd5-6r826\" (UID: \"ae6b72ec-a9cf-499d-8b13-727a051da569\") " pod="kuadrant-system/authorino-595f4fbd5-6r826"
Sep 16 00:46:31.183923 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:31.183781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ae6b72ec-a9cf-499d-8b13-727a051da569-tls-cert\") pod \"authorino-595f4fbd5-6r826\" (UID: \"ae6b72ec-a9cf-499d-8b13-727a051da569\") " pod="kuadrant-system/authorino-595f4fbd5-6r826"
Sep 16 00:46:31.186504 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:31.186480    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ae6b72ec-a9cf-499d-8b13-727a051da569-tls-cert\") pod \"authorino-595f4fbd5-6r826\" (UID: \"ae6b72ec-a9cf-499d-8b13-727a051da569\") " pod="kuadrant-system/authorino-595f4fbd5-6r826"
Sep 16 00:46:31.190564 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:31.190541    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r4ms\" (UniqueName: \"kubernetes.io/projected/ae6b72ec-a9cf-499d-8b13-727a051da569-kube-api-access-9r4ms\") pod \"authorino-595f4fbd5-6r826\" (UID: \"ae6b72ec-a9cf-499d-8b13-727a051da569\") " pod="kuadrant-system/authorino-595f4fbd5-6r826"
Sep 16 00:46:31.313203 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:31.313115    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-595f4fbd5-6r826"
Sep 16 00:46:31.590240 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:31.590215    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-595f4fbd5-6r826"]
Sep 16 00:46:31.592980 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:46:31.592946    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae6b72ec_a9cf_499d_8b13_727a051da569.slice/crio-3559e064a2f9877b32fd28a3aeb1b2497b8e1d5d2896befe8f2c9ffb829e4d4c WatchSource:0}: Error finding container 3559e064a2f9877b32fd28a3aeb1b2497b8e1d5d2896befe8f2c9ffb829e4d4c: Status 404 returned error can't find the container with id 3559e064a2f9877b32fd28a3aeb1b2497b8e1d5d2896befe8f2c9ffb829e4d4c
Sep 16 00:46:31.594364 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:31.594341    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 00:46:32.054024 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:32.053988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-595f4fbd5-6r826" event={"ID":"ae6b72ec-a9cf-499d-8b13-727a051da569","Type":"ContainerStarted","Data":"3559e064a2f9877b32fd28a3aeb1b2497b8e1d5d2896befe8f2c9ffb829e4d4c"}
Sep 16 00:46:33.060553 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:33.060511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-595f4fbd5-6r826" event={"ID":"ae6b72ec-a9cf-499d-8b13-727a051da569","Type":"ContainerStarted","Data":"7361ef0b59775fa430af433d62bb3b53c1661f666e0bfdf78ff2c927b9755eeb"}
Sep 16 00:46:33.092634 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:33.092576    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-595f4fbd5-6r826" podStartSLOduration=2.217311542 podStartE2EDuration="3.092558018s" totalImagesPullingTime="875.246476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:46:33.09113388 +0000 UTC m=+743.893956943" watchObservedRunningTime="2026-09-16 00:46:33.092558018 +0000 UTC m=+743.895381143"
Sep 16 00:46:33.151369 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:33.151325    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-854b45cf68-vm6ds"]
Sep 16 00:46:33.151607 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:33.151572    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-854b45cf68-vm6ds" podUID="9287f24f-2789-4be0-a628-a89361c87733" containerName="authorino" containerID="cri-o://8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27" gracePeriod=30
Sep 16 00:46:33.405541 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:33.405508    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854b45cf68-vm6ds"
Sep 16 00:46:33.507110 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:33.507074    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9287f24f-2789-4be0-a628-a89361c87733-tls-cert\") pod \"9287f24f-2789-4be0-a628-a89361c87733\" (UID: \"9287f24f-2789-4be0-a628-a89361c87733\") "
Sep 16 00:46:33.507297 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:33.507170    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6dpt\" (UniqueName: \"kubernetes.io/projected/9287f24f-2789-4be0-a628-a89361c87733-kube-api-access-v6dpt\") pod \"9287f24f-2789-4be0-a628-a89361c87733\" (UID: \"9287f24f-2789-4be0-a628-a89361c87733\") "
Sep 16 00:46:33.509297 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:33.509267    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9287f24f-2789-4be0-a628-a89361c87733-kube-api-access-v6dpt" (OuterVolumeSpecName: "kube-api-access-v6dpt") pod "9287f24f-2789-4be0-a628-a89361c87733" (UID: "9287f24f-2789-4be0-a628-a89361c87733"). InnerVolumeSpecName "kube-api-access-v6dpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:46:33.518400 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:33.518373    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9287f24f-2789-4be0-a628-a89361c87733-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9287f24f-2789-4be0-a628-a89361c87733" (UID: "9287f24f-2789-4be0-a628-a89361c87733"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:46:33.608775 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:33.608627    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9287f24f-2789-4be0-a628-a89361c87733-tls-cert\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:46:33.608775 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:33.608691    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6dpt\" (UniqueName: \"kubernetes.io/projected/9287f24f-2789-4be0-a628-a89361c87733-kube-api-access-v6dpt\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:46:34.067247 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:34.067212    2563 generic.go:356] "Generic (PLEG): container finished" podID="9287f24f-2789-4be0-a628-a89361c87733" containerID="8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27" exitCode=0
Sep 16 00:46:34.067752 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:34.067261    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854b45cf68-vm6ds"
Sep 16 00:46:34.067752 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:34.067300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-854b45cf68-vm6ds" event={"ID":"9287f24f-2789-4be0-a628-a89361c87733","Type":"ContainerDied","Data":"8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27"}
Sep 16 00:46:34.067752 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:34.067339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-854b45cf68-vm6ds" event={"ID":"9287f24f-2789-4be0-a628-a89361c87733","Type":"ContainerDied","Data":"a41dcfe18c9ef95b19c9e676242bf768c93b1bb54dec2478a36ca03690ec0f54"}
Sep 16 00:46:34.067752 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:34.067357    2563 scope.go:117] "RemoveContainer" containerID="8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27"
Sep 16 00:46:34.078719 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:34.078691    2563 scope.go:117] "RemoveContainer" containerID="8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27"
Sep 16 00:46:34.079188 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:46:34.079149    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27\": container with ID starting with 8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27 not found: ID does not exist" containerID="8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27"
Sep 16 00:46:34.079311 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:34.079192    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27"} err="failed to get container status \"8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27\": rpc error: code = NotFound desc = could not find container \"8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27\": container with ID starting with 8dda761c490995b600322d8c203fee2e65d9bc8f742a11bfc8b301005dc5ab27 not found: ID does not exist"
Sep 16 00:46:34.083649 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:34.082965    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-854b45cf68-vm6ds"]
Sep 16 00:46:34.088379 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:34.088349    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-854b45cf68-vm6ds"]
Sep 16 00:46:35.668172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:46:35.668139    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9287f24f-2789-4be0-a628-a89361c87733" path="/var/lib/kubelet/pods/9287f24f-2789-4be0-a628-a89361c87733/volumes"
Sep 16 00:47:39.971134 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:39.971053    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"]
Sep 16 00:47:39.971579 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:39.971478    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9287f24f-2789-4be0-a628-a89361c87733" containerName="authorino"
Sep 16 00:47:39.971579 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:39.971491    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9287f24f-2789-4be0-a628-a89361c87733" containerName="authorino"
Sep 16 00:47:39.971579 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:39.971549    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9287f24f-2789-4be0-a628-a89361c87733" containerName="authorino"
Sep 16 00:47:39.974660 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:39.974644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"
Sep 16 00:47:39.976589 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:39.976567    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-66ecb7\""
Sep 16 00:47:39.984206 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:39.984168    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"]
Sep 16 00:47:40.131267 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:40.131231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jljsz\" (UniqueName: \"kubernetes.io/projected/e341d8bc-f181-4df5-a8de-928cb6876457-kube-api-access-jljsz\") pod \"payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt\" (UID: \"e341d8bc-f181-4df5-a8de-928cb6876457\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"
Sep 16 00:47:40.131468 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:40.131316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e341d8bc-f181-4df5-a8de-928cb6876457-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt\" (UID: \"e341d8bc-f181-4df5-a8de-928cb6876457\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"
Sep 16 00:47:40.232646 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:40.232551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e341d8bc-f181-4df5-a8de-928cb6876457-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt\" (UID: \"e341d8bc-f181-4df5-a8de-928cb6876457\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"
Sep 16 00:47:40.232646 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:40.232642    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jljsz\" (UniqueName: \"kubernetes.io/projected/e341d8bc-f181-4df5-a8de-928cb6876457-kube-api-access-jljsz\") pod \"payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt\" (UID: \"e341d8bc-f181-4df5-a8de-928cb6876457\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"
Sep 16 00:47:40.233340 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:40.233313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e341d8bc-f181-4df5-a8de-928cb6876457-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt\" (UID: \"e341d8bc-f181-4df5-a8de-928cb6876457\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"
Sep 16 00:47:40.240238 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:40.240211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljsz\" (UniqueName: \"kubernetes.io/projected/e341d8bc-f181-4df5-a8de-928cb6876457-kube-api-access-jljsz\") pod \"payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt\" (UID: \"e341d8bc-f181-4df5-a8de-928cb6876457\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"
Sep 16 00:47:40.287795 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:40.287751    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"
Sep 16 00:47:40.558022 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:40.557994    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"]
Sep 16 00:47:40.560694 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:47:40.560638    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode341d8bc_f181_4df5_a8de_928cb6876457.slice/crio-83ff94d6cf7a15a460d7345234f2d24c5ec9b95f83ae98a46885d9865266de59 WatchSource:0}: Error finding container 83ff94d6cf7a15a460d7345234f2d24c5ec9b95f83ae98a46885d9865266de59: Status 404 returned error can't find the container with id 83ff94d6cf7a15a460d7345234f2d24c5ec9b95f83ae98a46885d9865266de59
Sep 16 00:47:41.107790 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.107757    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"]
Sep 16 00:47:41.112398 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.112375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"
Sep 16 00:47:41.114386 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.114362    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-5270e2\""
Sep 16 00:47:41.114518 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.114362    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-5270e2-dockercfg-8zkwb\""
Sep 16 00:47:41.120728 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.120706    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"]
Sep 16 00:47:41.145968 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.145937    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"]
Sep 16 00:47:41.149526 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.149501    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"
Sep 16 00:47:41.160054 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.160024    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"]
Sep 16 00:47:41.241112 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.241079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9867a056-16ab-44a5-9053-ac69ef60bbae-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf\" (UID: \"9867a056-16ab-44a5-9053-ac69ef60bbae\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"
Sep 16 00:47:41.241301 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.241131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb\" (UID: \"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"
Sep 16 00:47:41.241301 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.241240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fq6v\" (UniqueName: \"kubernetes.io/projected/9867a056-16ab-44a5-9053-ac69ef60bbae-kube-api-access-6fq6v\") pod \"payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf\" (UID: \"9867a056-16ab-44a5-9053-ac69ef60bbae\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"
Sep 16 00:47:41.241301 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.241292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbtp7\" (UniqueName: \"kubernetes.io/projected/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c-kube-api-access-vbtp7\") pod \"payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb\" (UID: \"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"
Sep 16 00:47:41.342103 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.342062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9867a056-16ab-44a5-9053-ac69ef60bbae-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf\" (UID: \"9867a056-16ab-44a5-9053-ac69ef60bbae\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"
Sep 16 00:47:41.342293 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.342111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb\" (UID: \"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"
Sep 16 00:47:41.342293 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.342157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fq6v\" (UniqueName: \"kubernetes.io/projected/9867a056-16ab-44a5-9053-ac69ef60bbae-kube-api-access-6fq6v\") pod \"payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf\" (UID: \"9867a056-16ab-44a5-9053-ac69ef60bbae\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"
Sep 16 00:47:41.342293 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.342183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbtp7\" (UniqueName: \"kubernetes.io/projected/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c-kube-api-access-vbtp7\") pod \"payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb\" (UID: \"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"
Sep 16 00:47:41.342984 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.342948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9867a056-16ab-44a5-9053-ac69ef60bbae-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf\" (UID: \"9867a056-16ab-44a5-9053-ac69ef60bbae\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"
Sep 16 00:47:41.342984 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.342972    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb\" (UID: \"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"
Sep 16 00:47:41.351972 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.351946    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbtp7\" (UniqueName: \"kubernetes.io/projected/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c-kube-api-access-vbtp7\") pod \"payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb\" (UID: \"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"
Sep 16 00:47:41.352125 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.352088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fq6v\" (UniqueName: \"kubernetes.io/projected/9867a056-16ab-44a5-9053-ac69ef60bbae-kube-api-access-6fq6v\") pod \"payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf\" (UID: \"9867a056-16ab-44a5-9053-ac69ef60bbae\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"
Sep 16 00:47:41.399084 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.398987    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt" event={"ID":"e341d8bc-f181-4df5-a8de-928cb6876457","Type":"ContainerStarted","Data":"83ff94d6cf7a15a460d7345234f2d24c5ec9b95f83ae98a46885d9865266de59"}
Sep 16 00:47:41.424609 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.424572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"
Sep 16 00:47:41.463494 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.463452    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"
Sep 16 00:47:41.708644 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.708609    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"]
Sep 16 00:47:41.762094 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:41.762062    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"]
Sep 16 00:47:41.826771 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:47:41.826728    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9867a056_16ab_44a5_9053_ac69ef60bbae.slice/crio-39f1cd7f715725d3fef81f8789db489d90ebe0958e561caabb2e1193c51b7cad WatchSource:0}: Error finding container 39f1cd7f715725d3fef81f8789db489d90ebe0958e561caabb2e1193c51b7cad: Status 404 returned error can't find the container with id 39f1cd7f715725d3fef81f8789db489d90ebe0958e561caabb2e1193c51b7cad
Sep 16 00:47:41.827340 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:47:41.827219    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c02ceb1_1a70_4921_82c1_7ddb1b3dbc1c.slice/crio-fb65cc573a06ee8aad541ad64916f2932cf15256ac5ca6039406345119a6e914 WatchSource:0}: Error finding container fb65cc573a06ee8aad541ad64916f2932cf15256ac5ca6039406345119a6e914: Status 404 returned error can't find the container with id fb65cc573a06ee8aad541ad64916f2932cf15256ac5ca6039406345119a6e914
Sep 16 00:47:42.042262 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.042173    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"]
Sep 16 00:47:42.045739 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.045720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"
Sep 16 00:47:42.047900 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.047879    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-0f7c3b\""
Sep 16 00:47:42.048014 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.047887    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-0f7c3b-dockercfg-vnv8d\""
Sep 16 00:47:42.056643 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.056614    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"]
Sep 16 00:47:42.149835 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.149804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw\" (UID: \"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"
Sep 16 00:47:42.150173 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.149866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grr29\" (UniqueName: \"kubernetes.io/projected/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9-kube-api-access-grr29\") pod \"payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw\" (UID: \"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"
Sep 16 00:47:42.251128 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.251082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw\" (UID: \"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"
Sep 16 00:47:42.251128 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.251132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grr29\" (UniqueName: \"kubernetes.io/projected/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9-kube-api-access-grr29\") pod \"payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw\" (UID: \"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"
Sep 16 00:47:42.251812 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.251790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw\" (UID: \"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"
Sep 16 00:47:42.258145 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.258118    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grr29\" (UniqueName: \"kubernetes.io/projected/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9-kube-api-access-grr29\") pod \"payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw\" (UID: \"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"
Sep 16 00:47:42.356934 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.356847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"
Sep 16 00:47:42.406918 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.406877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt" event={"ID":"e341d8bc-f181-4df5-a8de-928cb6876457","Type":"ContainerStarted","Data":"31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9"}
Sep 16 00:47:42.407560 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.407504    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"
Sep 16 00:47:42.410205 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.409378    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb" event={"ID":"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c","Type":"ContainerStarted","Data":"68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11"}
Sep 16 00:47:42.410205 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.409423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb" event={"ID":"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c","Type":"ContainerStarted","Data":"fb65cc573a06ee8aad541ad64916f2932cf15256ac5ca6039406345119a6e914"}
Sep 16 00:47:42.410205 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.410156    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"
Sep 16 00:47:42.415005 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.414473    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf" event={"ID":"9867a056-16ab-44a5-9053-ac69ef60bbae","Type":"ContainerStarted","Data":"7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6"}
Sep 16 00:47:42.415005 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.414521    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf" event={"ID":"9867a056-16ab-44a5-9053-ac69ef60bbae","Type":"ContainerStarted","Data":"39f1cd7f715725d3fef81f8789db489d90ebe0958e561caabb2e1193c51b7cad"}
Sep 16 00:47:42.415213 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.415023    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"
Sep 16 00:47:42.427279 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.426534    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt" podStartSLOduration=2.115982528 podStartE2EDuration="3.426513118s" totalImagesPullingTime="1.31053059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:47:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:47:42.423593133 +0000 UTC m=+813.226416196" watchObservedRunningTime="2026-09-16 00:47:42.426513118 +0000 UTC m=+813.229336182"
Sep 16 00:47:42.442898 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.442844    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb" podStartSLOduration=1.116931886 podStartE2EDuration="1.442826484s" totalImagesPullingTime="325.894598ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:47:42.441154124 +0000 UTC m=+813.243977188" watchObservedRunningTime="2026-09-16 00:47:42.442826484 +0000 UTC m=+813.245649571"
Sep 16 00:47:42.457893 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.457845    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf" podStartSLOduration=1.130796414 podStartE2EDuration="1.457820073s" totalImagesPullingTime="327.023659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:47:42.456829869 +0000 UTC m=+813.259652932" watchObservedRunningTime="2026-09-16 00:47:42.457820073 +0000 UTC m=+813.260643136"
Sep 16 00:47:42.653758 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:42.653626    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"]
Sep 16 00:47:42.657512 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:47:42.657474    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7bcd5d_2ec7_4e9d_9535_a82d8df2fbb9.slice/crio-8dc9d8d6d3ed44e67c5d84469e0f86ac41abf04ba936ed0793f54676345052ab WatchSource:0}: Error finding container 8dc9d8d6d3ed44e67c5d84469e0f86ac41abf04ba936ed0793f54676345052ab: Status 404 returned error can't find the container with id 8dc9d8d6d3ed44e67c5d84469e0f86ac41abf04ba936ed0793f54676345052ab
Sep 16 00:47:43.422014 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:43.421973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw" event={"ID":"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9","Type":"ContainerStarted","Data":"c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368"}
Sep 16 00:47:43.422504 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:43.422154    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"
Sep 16 00:47:43.422504 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:43.422201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw" event={"ID":"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9","Type":"ContainerStarted","Data":"8dc9d8d6d3ed44e67c5d84469e0f86ac41abf04ba936ed0793f54676345052ab"}
Sep 16 00:47:43.440511 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:43.440458    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw" podStartSLOduration=1.440440706 podStartE2EDuration="1.440440706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:47:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:47:43.439112418 +0000 UTC m=+814.241935492" watchObservedRunningTime="2026-09-16 00:47:43.440440706 +0000 UTC m=+814.243263770"
Sep 16 00:47:54.436500 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:54.436463    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"
Sep 16 00:47:54.437059 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:54.436558    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"
Sep 16 00:47:54.437059 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:54.436743    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"
Sep 16 00:47:54.437059 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:47:54.436818    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"
Sep 16 00:48:08.171392 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.171350    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"]
Sep 16 00:48:08.176209 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.176184    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"
Sep 16 00:48:08.178188 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.178162    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-4d413f-dockercfg-p4mbn\""
Sep 16 00:48:08.178188 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.178186    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-4d413f\""
Sep 16 00:48:08.184183 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.184153    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"]
Sep 16 00:48:08.307413 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.307370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cjt7\" (UniqueName: \"kubernetes.io/projected/6d241252-b4da-4863-a457-071069f8d778-kube-api-access-2cjt7\") pod \"payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5\" (UID: \"6d241252-b4da-4863-a457-071069f8d778\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"
Sep 16 00:48:08.307413 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.307422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d241252-b4da-4863-a457-071069f8d778-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5\" (UID: \"6d241252-b4da-4863-a457-071069f8d778\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"
Sep 16 00:48:08.408482 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.408438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cjt7\" (UniqueName: \"kubernetes.io/projected/6d241252-b4da-4863-a457-071069f8d778-kube-api-access-2cjt7\") pod \"payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5\" (UID: \"6d241252-b4da-4863-a457-071069f8d778\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"
Sep 16 00:48:08.408718 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.408499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d241252-b4da-4863-a457-071069f8d778-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5\" (UID: \"6d241252-b4da-4863-a457-071069f8d778\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"
Sep 16 00:48:08.409267 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.409241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d241252-b4da-4863-a457-071069f8d778-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5\" (UID: \"6d241252-b4da-4863-a457-071069f8d778\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"
Sep 16 00:48:08.416586 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.416566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cjt7\" (UniqueName: \"kubernetes.io/projected/6d241252-b4da-4863-a457-071069f8d778-kube-api-access-2cjt7\") pod \"payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5\" (UID: \"6d241252-b4da-4863-a457-071069f8d778\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"
Sep 16 00:48:08.489043 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.489011    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"
Sep 16 00:48:08.765167 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:08.765139    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"]
Sep 16 00:48:08.767749 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:48:08.767721    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d241252_b4da_4863_a457_071069f8d778.slice/crio-5c89250a09e27d42fa186e5f7af5afeac9a19d1b54b5505a84dda60af1d1b866 WatchSource:0}: Error finding container 5c89250a09e27d42fa186e5f7af5afeac9a19d1b54b5505a84dda60af1d1b866: Status 404 returned error can't find the container with id 5c89250a09e27d42fa186e5f7af5afeac9a19d1b54b5505a84dda60af1d1b866
Sep 16 00:48:09.574303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:09.574263    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5" event={"ID":"6d241252-b4da-4863-a457-071069f8d778","Type":"ContainerStarted","Data":"b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612"}
Sep 16 00:48:09.574697 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:09.574345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5" event={"ID":"6d241252-b4da-4863-a457-071069f8d778","Type":"ContainerStarted","Data":"5c89250a09e27d42fa186e5f7af5afeac9a19d1b54b5505a84dda60af1d1b866"}
Sep 16 00:48:09.574697 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:09.574381    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"
Sep 16 00:48:09.596407 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:09.596354    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5" podStartSLOduration=1.596335675 podStartE2EDuration="1.596335675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:48:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:48:09.593852987 +0000 UTC m=+840.396676057" watchObservedRunningTime="2026-09-16 00:48:09.596335675 +0000 UTC m=+840.399158737"
Sep 16 00:48:12.694345 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.694311    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"]
Sep 16 00:48:12.699502 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.699476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.701585 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.701564    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-5270e2\"/\"kube-root-ca.crt\""
Sep 16 00:48:12.702521 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.702502    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-5270e2\"/\"openshift-service-ca.crt\""
Sep 16 00:48:12.702642 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.702545    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-5270e2\"/\"simulator-w0-5270e2-kserve-self-signed-certs\""
Sep 16 00:48:12.702642 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.702563    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-5270e2\"/\"default-dockercfg-fmb5k\""
Sep 16 00:48:12.706322 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.706298    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"]
Sep 16 00:48:12.849618 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.849580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-tmp-dir\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.849840 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.849630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hxs2\" (UniqueName: \"kubernetes.io/projected/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-kube-api-access-5hxs2\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.849840 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.849651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-tls-certs\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.849840 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.849700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-dshm\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.849840 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.849753    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-home\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.849840 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.849791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-model-cache\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.951051 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.950971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-model-cache\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.951211 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.951069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-tmp-dir\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.951211 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.951116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxs2\" (UniqueName: \"kubernetes.io/projected/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-kube-api-access-5hxs2\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.951211 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.951144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-tls-certs\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.951211 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.951169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-dshm\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.951530 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.951222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-home\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.951530 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.951459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-model-cache\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.951620 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.951536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-tmp-dir\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.951620 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.951544    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-home\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.953577 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.953556    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-dshm\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.953892 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.953874    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-tls-certs\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:12.958084 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:12.958060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hxs2\" (UniqueName: \"kubernetes.io/projected/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-kube-api-access-5hxs2\") pod \"simulator-w0-5270e2-kserve-75d7b657dd-nbc55\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") " pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:13.010610 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:13.010575    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:13.325869 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:13.325846    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"]
Sep 16 00:48:13.336849 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:48:13.329193    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e1f6394_45dc_4f87_bc6a_df936c5f02cf.slice/crio-2c9481c0e5a48406d0d63c3729beb70da4a784da0f5546e602819c2486b9ab55 WatchSource:0}: Error finding container 2c9481c0e5a48406d0d63c3729beb70da4a784da0f5546e602819c2486b9ab55: Status 404 returned error can't find the container with id 2c9481c0e5a48406d0d63c3729beb70da4a784da0f5546e602819c2486b9ab55
Sep 16 00:48:13.597393 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:13.597301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55" event={"ID":"8e1f6394-45dc-4f87-bc6a-df936c5f02cf","Type":"ContainerStarted","Data":"2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646"}
Sep 16 00:48:13.597393 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:13.597343    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55" event={"ID":"8e1f6394-45dc-4f87-bc6a-df936c5f02cf","Type":"ContainerStarted","Data":"2c9481c0e5a48406d0d63c3729beb70da4a784da0f5546e602819c2486b9ab55"}
Sep 16 00:48:13.614716 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:13.614649    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55" podStartSLOduration=1.614633014 podStartE2EDuration="1.614633014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:48:13.612177036 +0000 UTC m=+844.415000100" watchObservedRunningTime="2026-09-16 00:48:13.614633014 +0000 UTC m=+844.417456076"
Sep 16 00:48:20.582336 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:20.582303    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"
Sep 16 00:48:23.011082 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:23.011046    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:23.011478 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:23.011097    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:23.023813 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:23.023787    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:23.656967 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:23.656936    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:48:47.495156 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.495118    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"]
Sep 16 00:48:47.499057 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.499030    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.501713 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.501689    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-66ecb7\"/\"test-model-66ecb7-kserve-self-signed-certs\""
Sep 16 00:48:47.501866 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.501798    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-66ecb7\"/\"openshift-service-ca.crt\""
Sep 16 00:48:47.502109 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.502085    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-66ecb7\"/\"default-dockercfg-qhkdm\""
Sep 16 00:48:47.502215 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.502119    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-66ecb7\"/\"kube-root-ca.crt\""
Sep 16 00:48:47.505900 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.505876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"]
Sep 16 00:48:47.586341 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.586301    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-home\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.586528 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.586447    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmbhb\" (UniqueName: \"kubernetes.io/projected/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-kube-api-access-vmbhb\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.586528 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.586489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-tls-certs\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.586528 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.586510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-model-cache\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.586528 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.586527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-tmp-dir\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.586727 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.586559    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-dshm\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.688122 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.688086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmbhb\" (UniqueName: \"kubernetes.io/projected/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-kube-api-access-vmbhb\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.688122 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.688129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-tls-certs\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.688382 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.688148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-model-cache\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.688382 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.688166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-tmp-dir\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.688382 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.688182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-dshm\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.688382 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.688235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-home\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.688583 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.688554    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-model-cache\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.688643 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.688589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-home\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.688733 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.688704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-tmp-dir\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.690678 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.690639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-dshm\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.691056 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.691034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-tls-certs\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.696194 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.696170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmbhb\" (UniqueName: \"kubernetes.io/projected/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-kube-api-access-vmbhb\") pod \"test-model-66ecb7-kserve-54dfc8d755-vvl82\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") " pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:47.812243 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:47.812159    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:48.092453 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:48.092426    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"]
Sep 16 00:48:48.095042 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:48:48.095008    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3b8969b_ac3e_4d4c_837f_1ecf2faa78ea.slice/crio-645363d64fc971b43d40daea8d279282f06f00d9dec466e31ca69a29982c793b WatchSource:0}: Error finding container 645363d64fc971b43d40daea8d279282f06f00d9dec466e31ca69a29982c793b: Status 404 returned error can't find the container with id 645363d64fc971b43d40daea8d279282f06f00d9dec466e31ca69a29982c793b
Sep 16 00:48:48.776436 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:48.776395    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82" event={"ID":"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea","Type":"ContainerStarted","Data":"64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f"}
Sep 16 00:48:48.776837 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:48.776447    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82" event={"ID":"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea","Type":"ContainerStarted","Data":"645363d64fc971b43d40daea8d279282f06f00d9dec466e31ca69a29982c793b"}
Sep 16 00:48:48.793167 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:48.793115    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82" podStartSLOduration=1.793098823 podStartE2EDuration="1.793098823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:48:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:48:48.791150167 +0000 UTC m=+879.593973243" watchObservedRunningTime="2026-09-16 00:48:48.793098823 +0000 UTC m=+879.595921886"
Sep 16 00:48:57.813321 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:57.813282    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:57.813848 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:57.813340    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:57.826428 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:57.826399    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:57.837680 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:57.837644    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:48:58.801005 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:58.800967    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"]
Sep 16 00:48:58.804645 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:58.804621    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:58.806832 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:58.806811    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-5270e2\"/\"premium-w0-5270e2-kserve-self-signed-certs\""
Sep 16 00:48:58.811459 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:58.811436    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"]
Sep 16 00:48:58.902007 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:58.901972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-tls-certs\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:58.902352 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:58.902045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-dshm\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:58.902352 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:58.902062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmhw9\" (UniqueName: \"kubernetes.io/projected/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-kube-api-access-vmhw9\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:58.902352 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:58.902129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-home\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:58.902352 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:58.902150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-model-cache\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:58.902352 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:58.902175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-tmp-dir\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.003457 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.003419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-dshm\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.003457 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.003454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhw9\" (UniqueName: \"kubernetes.io/projected/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-kube-api-access-vmhw9\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.003850 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.003483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-home\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.003850 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.003502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-model-cache\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.003850 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.003528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-tmp-dir\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.003850 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.003602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-tls-certs\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.004094 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.003924    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-home\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.004094 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.003982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-model-cache\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.004234 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.004209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-tmp-dir\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.006091 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.006068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-dshm\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.006410 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.006389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-tls-certs\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.010801 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.010780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmhw9\" (UniqueName: \"kubernetes.io/projected/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-kube-api-access-vmhw9\") pod \"premium-w0-5270e2-kserve-644f98f7bf-khlkp\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") " pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.135186 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.135089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:48:59.408203 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.408102    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"]
Sep 16 00:48:59.410639 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:48:59.410607    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5371810_ed56_47f0_a3ea_b1ee8d46a89f.slice/crio-da26e38128743e9544803468dad121b0316facc72df2c294a90d5f105d9768cb WatchSource:0}: Error finding container da26e38128743e9544803468dad121b0316facc72df2c294a90d5f105d9768cb: Status 404 returned error can't find the container with id da26e38128743e9544803468dad121b0316facc72df2c294a90d5f105d9768cb
Sep 16 00:48:59.834934 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.834899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp" event={"ID":"e5371810-ed56-47f0-a3ea-b1ee8d46a89f","Type":"ContainerStarted","Data":"fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7"}
Sep 16 00:48:59.835130 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.834950    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp" event={"ID":"e5371810-ed56-47f0-a3ea-b1ee8d46a89f","Type":"ContainerStarted","Data":"da26e38128743e9544803468dad121b0316facc72df2c294a90d5f105d9768cb"}
Sep 16 00:48:59.852215 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:48:59.852155    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp" podStartSLOduration=1.852137541 podStartE2EDuration="1.852137541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:48:59.850813866 +0000 UTC m=+890.653636942" watchObservedRunningTime="2026-09-16 00:48:59.852137541 +0000 UTC m=+890.654960604"
Sep 16 00:49:09.136071 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:49:09.135983    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:49:09.136071 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:49:09.136051    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:49:09.148943 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:49:09.148906    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:49:09.899591 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:49:09.899556    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:50:06.397840 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.397800    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"]
Sep 16 00:50:06.401424 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.401402    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.404243 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.404213    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-0f7c3b\"/\"kube-root-ca.crt\""
Sep 16 00:50:06.404414 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.404239    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-0f7c3b\"/\"distinct-w3-0f7c3b-kserve-self-signed-certs\""
Sep 16 00:50:06.404414 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.404215    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-0f7c3b\"/\"default-dockercfg-trr95\""
Sep 16 00:50:06.404414 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.404213    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-0f7c3b\"/\"openshift-service-ca.crt\""
Sep 16 00:50:06.409153 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.409123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"]
Sep 16 00:50:06.591279 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.591237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2m46\" (UniqueName: \"kubernetes.io/projected/54c3764f-0bf3-4426-9f4b-8ba2106adff4-kube-api-access-p2m46\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.591451 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.591306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54c3764f-0bf3-4426-9f4b-8ba2106adff4-tls-certs\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.591451 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.591371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-dshm\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.591451 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.591414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-tmp-dir\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.591552 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.591484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-home\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.591552 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.591524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-model-cache\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.693026 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.692990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2m46\" (UniqueName: \"kubernetes.io/projected/54c3764f-0bf3-4426-9f4b-8ba2106adff4-kube-api-access-p2m46\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.693235 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.693059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54c3764f-0bf3-4426-9f4b-8ba2106adff4-tls-certs\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.693235 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.693086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-dshm\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.693235 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.693111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-tmp-dir\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.693235 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.693154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-home\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.693455 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.693297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-model-cache\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.693533 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.693506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-home\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.693640 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.693609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-tmp-dir\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.693717 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.693649    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-model-cache\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.695647 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.695624    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-dshm\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.695800 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.695784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54c3764f-0bf3-4426-9f4b-8ba2106adff4-tls-certs\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.702949 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.702925    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2m46\" (UniqueName: \"kubernetes.io/projected/54c3764f-0bf3-4426-9f4b-8ba2106adff4-kube-api-access-p2m46\") pod \"distinct-w3-0f7c3b-kserve-6557954b9-rw6b6\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.712823 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.712797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:06.986810 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:06.986782    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"]
Sep 16 00:50:06.989790 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:50:06.989747    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54c3764f_0bf3_4426_9f4b_8ba2106adff4.slice/crio-e06b5ca7383387884517d453e848fea249e027966d7f0412047c70ae5ea4d3c8 WatchSource:0}: Error finding container e06b5ca7383387884517d453e848fea249e027966d7f0412047c70ae5ea4d3c8: Status 404 returned error can't find the container with id e06b5ca7383387884517d453e848fea249e027966d7f0412047c70ae5ea4d3c8
Sep 16 00:50:07.182598 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:07.182553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6" event={"ID":"54c3764f-0bf3-4426-9f4b-8ba2106adff4","Type":"ContainerStarted","Data":"502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115"}
Sep 16 00:50:07.182598 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:07.182598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6" event={"ID":"54c3764f-0bf3-4426-9f4b-8ba2106adff4","Type":"ContainerStarted","Data":"e06b5ca7383387884517d453e848fea249e027966d7f0412047c70ae5ea4d3c8"}
Sep 16 00:50:07.199428 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:07.199364    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6" podStartSLOduration=1.199341792 podStartE2EDuration="1.199341792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:50:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:50:07.199019693 +0000 UTC m=+958.001842756" watchObservedRunningTime="2026-09-16 00:50:07.199341792 +0000 UTC m=+958.002164858"
Sep 16 00:50:16.713338 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:16.713297    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:16.713864 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:16.713361    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:16.727200 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:16.727175    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:17.249266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:17.249233    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:50:42.499980 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.499895    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"]
Sep 16 00:50:42.503341 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.503318    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.506152 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.506129    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-0f7c3b\"/\"distinct-2-w3-0f7c3b-kserve-self-signed-certs\""
Sep 16 00:50:42.511296 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.511213    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"]
Sep 16 00:50:42.622375 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.622333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-home\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.622569 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.622382    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-tls-certs\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.622569 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.622446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-tmp-dir\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.622569 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.622502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9ks\" (UniqueName: \"kubernetes.io/projected/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-kube-api-access-jz9ks\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.622569 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.622534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-model-cache\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.622783 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.622579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-dshm\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.723621 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.723580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9ks\" (UniqueName: \"kubernetes.io/projected/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-kube-api-access-jz9ks\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.723849 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.723631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-model-cache\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.723849 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.723656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-dshm\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.723849 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.723843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-home\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.724025 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.723877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-tls-certs\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.724025 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.723910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-tmp-dir\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.724136 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.724082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-model-cache\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.724194 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.724163    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-home\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.724265 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.724243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-tmp-dir\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.726201 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.726176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-dshm\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.726387 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.726367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-tls-certs\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.730864 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.730840    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9ks\" (UniqueName: \"kubernetes.io/projected/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-kube-api-access-jz9ks\") pod \"distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") " pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:42.813964 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:42.813879    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:43.086024 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:43.085999    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"]
Sep 16 00:50:43.087762 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:50:43.087732    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod635d5e6f_6071_4178_9b3b_6f7e5fa4dc6a.slice/crio-4157837d8b619d96ef36c82126602e3eb99339228084ca199122722fbdd51e33 WatchSource:0}: Error finding container 4157837d8b619d96ef36c82126602e3eb99339228084ca199122722fbdd51e33: Status 404 returned error can't find the container with id 4157837d8b619d96ef36c82126602e3eb99339228084ca199122722fbdd51e33
Sep 16 00:50:43.378093 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:43.377995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76" event={"ID":"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a","Type":"ContainerStarted","Data":"c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76"}
Sep 16 00:50:43.378093 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:43.378046    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76" event={"ID":"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a","Type":"ContainerStarted","Data":"4157837d8b619d96ef36c82126602e3eb99339228084ca199122722fbdd51e33"}
Sep 16 00:50:43.394967 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:43.394913    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76" podStartSLOduration=1.394895228 podStartE2EDuration="1.394895228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:50:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:50:43.39287305 +0000 UTC m=+994.195696114" watchObservedRunningTime="2026-09-16 00:50:43.394895228 +0000 UTC m=+994.197718292"
Sep 16 00:50:52.814417 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:52.814374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:52.814962 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:52.814453    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:52.827893 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:52.827861    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:53.443229 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:53.443196    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:50:59.576210 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:50:59.576175    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"]
Sep 16 00:51:14.598011 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.597950    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82" podUID="f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea" containerName="main" containerID="cri-o://64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f" gracePeriod=45
Sep 16 00:51:14.863003 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.862933    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:51:14.963748 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.963713    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-home\") pod \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") "
Sep 16 00:51:14.963748 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.963751    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-model-cache\") pod \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") "
Sep 16 00:51:14.963985 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.963771    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-dshm\") pod \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") "
Sep 16 00:51:14.963985 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.963842    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-tmp-dir\") pod \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") "
Sep 16 00:51:14.963985 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.963911    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmbhb\" (UniqueName: \"kubernetes.io/projected/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-kube-api-access-vmbhb\") pod \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") "
Sep 16 00:51:14.963985 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.963932    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-tls-certs\") pod \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\" (UID: \"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea\") "
Sep 16 00:51:14.964187 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.963983    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea" (UID: "f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:51:14.964187 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.964023    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-home" (OuterVolumeSpecName: "home") pod "f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea" (UID: "f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:51:14.964187 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.964152    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea" (UID: "f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:51:14.964336 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.964270    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-tmp-dir\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:51:14.964336 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.964282    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-home\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:51:14.964336 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.964290    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-model-cache\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:51:14.966257 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.966235    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-dshm" (OuterVolumeSpecName: "dshm") pod "f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea" (UID: "f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:51:14.966346 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.966272    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea" (UID: "f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:51:14.966391 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:14.966373    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-kube-api-access-vmbhb" (OuterVolumeSpecName: "kube-api-access-vmbhb") pod "f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea" (UID: "f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea"). InnerVolumeSpecName "kube-api-access-vmbhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:51:15.065033 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.064993    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmbhb\" (UniqueName: \"kubernetes.io/projected/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-kube-api-access-vmbhb\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:51:15.065033 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.065034    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-tls-certs\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:51:15.065033 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.065046    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea-dshm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:51:15.548931 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.548888    2563 generic.go:356] "Generic (PLEG): container finished" podID="f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea" containerID="64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f" exitCode=0
Sep 16 00:51:15.549113 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.548940    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"
Sep 16 00:51:15.549113 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.548974    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82" event={"ID":"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea","Type":"ContainerDied","Data":"64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f"}
Sep 16 00:51:15.549113 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.549017    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82" event={"ID":"f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea","Type":"ContainerDied","Data":"645363d64fc971b43d40daea8d279282f06f00d9dec466e31ca69a29982c793b"}
Sep 16 00:51:15.549113 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.549035    2563 scope.go:117] "RemoveContainer" containerID="64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f"
Sep 16 00:51:15.559099 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.559080    2563 scope.go:117] "RemoveContainer" containerID="64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f"
Sep 16 00:51:15.559409 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:51:15.559387    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f\": container with ID starting with 64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f not found: ID does not exist" containerID="64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f"
Sep 16 00:51:15.559489 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.559417    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f"} err="failed to get container status \"64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f\": rpc error: code = NotFound desc = could not find container \"64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f\": container with ID starting with 64ba48a225898da6ce22522b72be20a98d7dae6d1f9ee3b3123af4fad563171f not found: ID does not exist"
Sep 16 00:51:15.568948 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.568910    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"]
Sep 16 00:51:15.572468 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.572445    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-66ecb7/test-model-66ecb7-kserve-54dfc8d755-vvl82"]
Sep 16 00:51:15.667692 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:15.667625    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea" path="/var/lib/kubelet/pods/f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea/volumes"
Sep 16 00:51:18.910237 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:18.910189    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"]
Sep 16 00:51:18.910707 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:18.910444    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt" podUID="e341d8bc-f181-4df5-a8de-928cb6876457" containerName="payload-pre-processing" containerID="cri-o://31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9" gracePeriod=30
Sep 16 00:51:19.159528 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.159501    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"
Sep 16 00:51:19.307634 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.307601    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e341d8bc-f181-4df5-a8de-928cb6876457-plugins-config-volume\") pod \"e341d8bc-f181-4df5-a8de-928cb6876457\" (UID: \"e341d8bc-f181-4df5-a8de-928cb6876457\") "
Sep 16 00:51:19.307872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.307724    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jljsz\" (UniqueName: \"kubernetes.io/projected/e341d8bc-f181-4df5-a8de-928cb6876457-kube-api-access-jljsz\") pod \"e341d8bc-f181-4df5-a8de-928cb6876457\" (UID: \"e341d8bc-f181-4df5-a8de-928cb6876457\") "
Sep 16 00:51:19.308069 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.308041    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e341d8bc-f181-4df5-a8de-928cb6876457-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e341d8bc-f181-4df5-a8de-928cb6876457" (UID: "e341d8bc-f181-4df5-a8de-928cb6876457"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:51:19.310076 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.310053    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e341d8bc-f181-4df5-a8de-928cb6876457-kube-api-access-jljsz" (OuterVolumeSpecName: "kube-api-access-jljsz") pod "e341d8bc-f181-4df5-a8de-928cb6876457" (UID: "e341d8bc-f181-4df5-a8de-928cb6876457"). InnerVolumeSpecName "kube-api-access-jljsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:51:19.409237 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.409204    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e341d8bc-f181-4df5-a8de-928cb6876457-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:51:19.409237 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.409235    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jljsz\" (UniqueName: \"kubernetes.io/projected/e341d8bc-f181-4df5-a8de-928cb6876457-kube-api-access-jljsz\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:51:19.573433 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.573337    2563 generic.go:356] "Generic (PLEG): container finished" podID="e341d8bc-f181-4df5-a8de-928cb6876457" containerID="31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9" exitCode=0
Sep 16 00:51:19.573433 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.573397    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"
Sep 16 00:51:19.573658 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.573428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt" event={"ID":"e341d8bc-f181-4df5-a8de-928cb6876457","Type":"ContainerDied","Data":"31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9"}
Sep 16 00:51:19.573658 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.573526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt" event={"ID":"e341d8bc-f181-4df5-a8de-928cb6876457","Type":"ContainerDied","Data":"83ff94d6cf7a15a460d7345234f2d24c5ec9b95f83ae98a46885d9865266de59"}
Sep 16 00:51:19.573658 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.573561    2563 scope.go:117] "RemoveContainer" containerID="31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9"
Sep 16 00:51:19.582913 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.582895    2563 scope.go:117] "RemoveContainer" containerID="31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9"
Sep 16 00:51:19.583300 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:51:19.583280    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9\": container with ID starting with 31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9 not found: ID does not exist" containerID="31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9"
Sep 16 00:51:19.583356 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.583311    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9"} err="failed to get container status \"31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9\": rpc error: code = NotFound desc = could not find container \"31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9\": container with ID starting with 31ccb16ecbd3d6480f118cd41819ebc492ce29455a01792e0a08e31575f026b9 not found: ID does not exist"
Sep 16 00:51:19.595860 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.595826    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"]
Sep 16 00:51:19.599279 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.599255    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-66ecb7-6c9746444b-5dcdt"]
Sep 16 00:51:19.669280 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:19.669245    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e341d8bc-f181-4df5-a8de-928cb6876457" path="/var/lib/kubelet/pods/e341d8bc-f181-4df5-a8de-928cb6876457/volumes"
Sep 16 00:51:36.892815 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:36.892779    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"]
Sep 16 00:51:36.893375 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:36.892995    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5" podUID="6d241252-b4da-4863-a457-071069f8d778" containerName="payload-processing" containerID="cri-o://b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612" gracePeriod=30
Sep 16 00:51:37.148067 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.148008    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"
Sep 16 00:51:37.189142 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.189113    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cjt7\" (UniqueName: \"kubernetes.io/projected/6d241252-b4da-4863-a457-071069f8d778-kube-api-access-2cjt7\") pod \"6d241252-b4da-4863-a457-071069f8d778\" (UID: \"6d241252-b4da-4863-a457-071069f8d778\") "
Sep 16 00:51:37.189322 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.189159    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d241252-b4da-4863-a457-071069f8d778-plugins-config-volume\") pod \"6d241252-b4da-4863-a457-071069f8d778\" (UID: \"6d241252-b4da-4863-a457-071069f8d778\") "
Sep 16 00:51:37.189572 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.189549    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d241252-b4da-4863-a457-071069f8d778-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6d241252-b4da-4863-a457-071069f8d778" (UID: "6d241252-b4da-4863-a457-071069f8d778"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:51:37.191355 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.191330    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d241252-b4da-4863-a457-071069f8d778-kube-api-access-2cjt7" (OuterVolumeSpecName: "kube-api-access-2cjt7") pod "6d241252-b4da-4863-a457-071069f8d778" (UID: "6d241252-b4da-4863-a457-071069f8d778"). InnerVolumeSpecName "kube-api-access-2cjt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:51:37.290331 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.290290    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cjt7\" (UniqueName: \"kubernetes.io/projected/6d241252-b4da-4863-a457-071069f8d778-kube-api-access-2cjt7\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:51:37.290331 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.290325    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d241252-b4da-4863-a457-071069f8d778-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:51:37.670850 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.670815    2563 generic.go:356] "Generic (PLEG): container finished" podID="6d241252-b4da-4863-a457-071069f8d778" containerID="b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612" exitCode=0
Sep 16 00:51:37.671063 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.670856    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"
Sep 16 00:51:37.671063 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.670897    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5" event={"ID":"6d241252-b4da-4863-a457-071069f8d778","Type":"ContainerDied","Data":"b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612"}
Sep 16 00:51:37.671063 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.670954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5" event={"ID":"6d241252-b4da-4863-a457-071069f8d778","Type":"ContainerDied","Data":"5c89250a09e27d42fa186e5f7af5afeac9a19d1b54b5505a84dda60af1d1b866"}
Sep 16 00:51:37.671063 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.670984    2563 scope.go:117] "RemoveContainer" containerID="b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612"
Sep 16 00:51:37.681408 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.681381    2563 scope.go:117] "RemoveContainer" containerID="b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612"
Sep 16 00:51:37.681791 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:51:37.681770    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612\": container with ID starting with b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612 not found: ID does not exist" containerID="b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612"
Sep 16 00:51:37.681876 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.681801    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612"} err="failed to get container status \"b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612\": rpc error: code = NotFound desc = could not find container \"b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612\": container with ID starting with b3e1fdbeeac6c059defdc6bffaa13addeaf435fb478a526fe81061573b431612 not found: ID does not exist"
Sep 16 00:51:37.695423 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.695387    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"]
Sep 16 00:51:37.697620 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:37.697596    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4d413f-787454cbdc-rmgb5"]
Sep 16 00:51:39.667807 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:39.667775    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d241252-b4da-4863-a457-071069f8d778" path="/var/lib/kubelet/pods/6d241252-b4da-4863-a457-071069f8d778/volumes"
Sep 16 00:51:51.899260 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.899214    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"]
Sep 16 00:51:51.899842 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.899824    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d241252-b4da-4863-a457-071069f8d778" containerName="payload-processing"
Sep 16 00:51:51.899897 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.899845    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d241252-b4da-4863-a457-071069f8d778" containerName="payload-processing"
Sep 16 00:51:51.899897 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.899857    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea" containerName="main"
Sep 16 00:51:51.899897 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.899866    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea" containerName="main"
Sep 16 00:51:51.899897 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.899891    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e341d8bc-f181-4df5-a8de-928cb6876457" containerName="payload-pre-processing"
Sep 16 00:51:51.900031 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.899899    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e341d8bc-f181-4df5-a8de-928cb6876457" containerName="payload-pre-processing"
Sep 16 00:51:51.900031 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.899987    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e341d8bc-f181-4df5-a8de-928cb6876457" containerName="payload-pre-processing"
Sep 16 00:51:51.900031 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.899999    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d241252-b4da-4863-a457-071069f8d778" containerName="payload-processing"
Sep 16 00:51:51.900031 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.900012    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b8969b-ac3e-4d4c-837f-1ecf2faa78ea" containerName="main"
Sep 16 00:51:51.905055 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.905037    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"
Sep 16 00:51:51.908152 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.908130    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-108960-dockercfg-qxkxd\""
Sep 16 00:51:51.908337 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.908314    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-108960\""
Sep 16 00:51:51.915370 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:51.915345    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"]
Sep 16 00:51:52.040875 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:52.040839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbccr\" (UniqueName: \"kubernetes.io/projected/20110a96-69a1-468b-b8fc-bdfbc613584c-kube-api-access-mbccr\") pod \"payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt\" (UID: \"20110a96-69a1-468b-b8fc-bdfbc613584c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"
Sep 16 00:51:52.041082 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:52.040921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20110a96-69a1-468b-b8fc-bdfbc613584c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt\" (UID: \"20110a96-69a1-468b-b8fc-bdfbc613584c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"
Sep 16 00:51:52.141479 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:52.141433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20110a96-69a1-468b-b8fc-bdfbc613584c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt\" (UID: \"20110a96-69a1-468b-b8fc-bdfbc613584c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"
Sep 16 00:51:52.141729 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:52.141562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbccr\" (UniqueName: \"kubernetes.io/projected/20110a96-69a1-468b-b8fc-bdfbc613584c-kube-api-access-mbccr\") pod \"payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt\" (UID: \"20110a96-69a1-468b-b8fc-bdfbc613584c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"
Sep 16 00:51:52.142164 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:52.142144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20110a96-69a1-468b-b8fc-bdfbc613584c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt\" (UID: \"20110a96-69a1-468b-b8fc-bdfbc613584c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"
Sep 16 00:51:52.149042 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:52.149015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbccr\" (UniqueName: \"kubernetes.io/projected/20110a96-69a1-468b-b8fc-bdfbc613584c-kube-api-access-mbccr\") pod \"payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt\" (UID: \"20110a96-69a1-468b-b8fc-bdfbc613584c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"
Sep 16 00:51:52.216839 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:52.216799    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"
Sep 16 00:51:52.491824 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:52.491301    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"]
Sep 16 00:51:52.493936 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:51:52.493901    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20110a96_69a1_468b_b8fc_bdfbc613584c.slice/crio-d02d71be6186c331e0a11ae93f9aa3d8c3b3856a2b8f1383835dcf330288800f WatchSource:0}: Error finding container d02d71be6186c331e0a11ae93f9aa3d8c3b3856a2b8f1383835dcf330288800f: Status 404 returned error can't find the container with id d02d71be6186c331e0a11ae93f9aa3d8c3b3856a2b8f1383835dcf330288800f
Sep 16 00:51:52.753688 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:52.753568    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt" event={"ID":"20110a96-69a1-468b-b8fc-bdfbc613584c","Type":"ContainerStarted","Data":"5b543ca69b7101e857a294b3bbe7a89c21dce42eed53f9d107e1b3435520e263"}
Sep 16 00:51:52.753688 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:52.753618    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt" event={"ID":"20110a96-69a1-468b-b8fc-bdfbc613584c","Type":"ContainerStarted","Data":"d02d71be6186c331e0a11ae93f9aa3d8c3b3856a2b8f1383835dcf330288800f"}
Sep 16 00:51:52.753688 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:52.753649    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"
Sep 16 00:51:52.771262 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:51:52.771192    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt" podStartSLOduration=1.771175194 podStartE2EDuration="1.771175194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:51:52.769123588 +0000 UTC m=+1063.571946653" watchObservedRunningTime="2026-09-16 00:51:52.771175194 +0000 UTC m=+1063.573998257"
Sep 16 00:52:03.761863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:03.761782    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"
Sep 16 00:52:22.376560 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.376524    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"]
Sep 16 00:52:22.381681 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.381650    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"
Sep 16 00:52:22.384230 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.384200    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-2fa86d-dockercfg-kd4lp\""
Sep 16 00:52:22.384357 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.384207    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-2fa86d\""
Sep 16 00:52:22.389802 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.389777    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"]
Sep 16 00:52:22.425634 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.425597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b39872-73df-4f7e-bafb-07fb68f88b43-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds\" (UID: \"10b39872-73df-4f7e-bafb-07fb68f88b43\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"
Sep 16 00:52:22.425850 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.425661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frmp9\" (UniqueName: \"kubernetes.io/projected/10b39872-73df-4f7e-bafb-07fb68f88b43-kube-api-access-frmp9\") pod \"payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds\" (UID: \"10b39872-73df-4f7e-bafb-07fb68f88b43\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"
Sep 16 00:52:22.526515 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.526473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b39872-73df-4f7e-bafb-07fb68f88b43-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds\" (UID: \"10b39872-73df-4f7e-bafb-07fb68f88b43\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"
Sep 16 00:52:22.526711 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.526542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frmp9\" (UniqueName: \"kubernetes.io/projected/10b39872-73df-4f7e-bafb-07fb68f88b43-kube-api-access-frmp9\") pod \"payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds\" (UID: \"10b39872-73df-4f7e-bafb-07fb68f88b43\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"
Sep 16 00:52:22.527195 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.527173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b39872-73df-4f7e-bafb-07fb68f88b43-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds\" (UID: \"10b39872-73df-4f7e-bafb-07fb68f88b43\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"
Sep 16 00:52:22.534494 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.534461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frmp9\" (UniqueName: \"kubernetes.io/projected/10b39872-73df-4f7e-bafb-07fb68f88b43-kube-api-access-frmp9\") pod \"payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds\" (UID: \"10b39872-73df-4f7e-bafb-07fb68f88b43\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"
Sep 16 00:52:22.694700 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.694649    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"
Sep 16 00:52:22.970424 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:22.970304    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"]
Sep 16 00:52:22.973375 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:52:22.973341    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b39872_73df_4f7e_bafb_07fb68f88b43.slice/crio-f27779bf8e4c15bae8ea3519c8df43733034fc5943c5560f45c807e867618897 WatchSource:0}: Error finding container f27779bf8e4c15bae8ea3519c8df43733034fc5943c5560f45c807e867618897: Status 404 returned error can't find the container with id f27779bf8e4c15bae8ea3519c8df43733034fc5943c5560f45c807e867618897
Sep 16 00:52:23.916497 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:23.916451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds" event={"ID":"10b39872-73df-4f7e-bafb-07fb68f88b43","Type":"ContainerStarted","Data":"4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e"}
Sep 16 00:52:23.916925 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:23.916513    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds" event={"ID":"10b39872-73df-4f7e-bafb-07fb68f88b43","Type":"ContainerStarted","Data":"f27779bf8e4c15bae8ea3519c8df43733034fc5943c5560f45c807e867618897"}
Sep 16 00:52:23.916925 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:23.916553    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"
Sep 16 00:52:23.934638 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:23.934579    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds" podStartSLOduration=1.9345635730000001 podStartE2EDuration="1.934563573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:52:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:52:23.932121872 +0000 UTC m=+1094.734944935" watchObservedRunningTime="2026-09-16 00:52:23.934563573 +0000 UTC m=+1094.737386677"
Sep 16 00:52:25.122844 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.122809    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"]
Sep 16 00:52:25.126514 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.126496    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"
Sep 16 00:52:25.128432 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.128408    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-69886ef2\""
Sep 16 00:52:25.135690 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.135643    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"]
Sep 16 00:52:25.254620 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.254582    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1affa112-f511-4482-8efc-e665ee5a7d59-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg\" (UID: \"1affa112-f511-4482-8efc-e665ee5a7d59\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"
Sep 16 00:52:25.254830 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.254634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szvzg\" (UniqueName: \"kubernetes.io/projected/1affa112-f511-4482-8efc-e665ee5a7d59-kube-api-access-szvzg\") pod \"payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg\" (UID: \"1affa112-f511-4482-8efc-e665ee5a7d59\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"
Sep 16 00:52:25.355909 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.355862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1affa112-f511-4482-8efc-e665ee5a7d59-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg\" (UID: \"1affa112-f511-4482-8efc-e665ee5a7d59\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"
Sep 16 00:52:25.355909 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.355910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szvzg\" (UniqueName: \"kubernetes.io/projected/1affa112-f511-4482-8efc-e665ee5a7d59-kube-api-access-szvzg\") pod \"payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg\" (UID: \"1affa112-f511-4482-8efc-e665ee5a7d59\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"
Sep 16 00:52:25.356564 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.356538    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1affa112-f511-4482-8efc-e665ee5a7d59-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg\" (UID: \"1affa112-f511-4482-8efc-e665ee5a7d59\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"
Sep 16 00:52:25.366041 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.366014    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szvzg\" (UniqueName: \"kubernetes.io/projected/1affa112-f511-4482-8efc-e665ee5a7d59-kube-api-access-szvzg\") pod \"payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg\" (UID: \"1affa112-f511-4482-8efc-e665ee5a7d59\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"
Sep 16 00:52:25.438935 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.438830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"
Sep 16 00:52:25.712545 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.712522    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"]
Sep 16 00:52:25.715208 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:52:25.715177    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1affa112_f511_4482_8efc_e665ee5a7d59.slice/crio-567cb863e98ae602e4ca965f6a82667ab441dcd14b79342de945aa2a52b66d3b WatchSource:0}: Error finding container 567cb863e98ae602e4ca965f6a82667ab441dcd14b79342de945aa2a52b66d3b: Status 404 returned error can't find the container with id 567cb863e98ae602e4ca965f6a82667ab441dcd14b79342de945aa2a52b66d3b
Sep 16 00:52:25.928713 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.928682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg" event={"ID":"1affa112-f511-4482-8efc-e665ee5a7d59","Type":"ContainerStarted","Data":"518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed"}
Sep 16 00:52:25.928879 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.928742    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg" event={"ID":"1affa112-f511-4482-8efc-e665ee5a7d59","Type":"ContainerStarted","Data":"567cb863e98ae602e4ca965f6a82667ab441dcd14b79342de945aa2a52b66d3b"}
Sep 16 00:52:25.928879 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.928853    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"
Sep 16 00:52:25.945879 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:25.945825    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg" podStartSLOduration=0.945810468 podStartE2EDuration="945.810468ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:52:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:52:25.943618709 +0000 UTC m=+1096.746441785" watchObservedRunningTime="2026-09-16 00:52:25.945810468 +0000 UTC m=+1096.748633531"
Sep 16 00:52:34.924994 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:34.924964    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"
Sep 16 00:52:36.937303 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:36.937271    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"
Sep 16 00:52:52.425095 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:52.425059    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc"]
Sep 16 00:52:52.428884 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:52.428867    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc"
Sep 16 00:52:52.430801 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:52.430779    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 00:52:52.430909 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:52.430824    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-npltg\""
Sep 16 00:52:52.435007 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:52.434987    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc"]
Sep 16 00:52:52.515989 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:52.515950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/485b578f-5428-4568-9acf-5092c1ffa6de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc\" (UID: \"485b578f-5428-4568-9acf-5092c1ffa6de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc"
Sep 16 00:52:52.616597 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:52.616556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/485b578f-5428-4568-9acf-5092c1ffa6de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc\" (UID: \"485b578f-5428-4568-9acf-5092c1ffa6de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc"
Sep 16 00:52:52.617269 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:52.617242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/485b578f-5428-4568-9acf-5092c1ffa6de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc\" (UID: \"485b578f-5428-4568-9acf-5092c1ffa6de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc"
Sep 16 00:52:52.742314 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:52.742279    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc"
Sep 16 00:52:53.016874 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:53.016832    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc"]
Sep 16 00:52:53.019919 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:52:53.019887    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485b578f_5428_4568_9acf_5092c1ffa6de.slice/crio-9aa0821b9d263e8c9936665d0e823ba71996ced51ac15e87c00be3d2fbd7169b WatchSource:0}: Error finding container 9aa0821b9d263e8c9936665d0e823ba71996ced51ac15e87c00be3d2fbd7169b: Status 404 returned error can't find the container with id 9aa0821b9d263e8c9936665d0e823ba71996ced51ac15e87c00be3d2fbd7169b
Sep 16 00:52:53.022109 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:53.022092    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 00:52:53.073854 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:53.073818    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc" event={"ID":"485b578f-5428-4568-9acf-5092c1ffa6de","Type":"ContainerStarted","Data":"9aa0821b9d263e8c9936665d0e823ba71996ced51ac15e87c00be3d2fbd7169b"}
Sep 16 00:52:56.093679 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:56.093640    2563 generic.go:356] "Generic (PLEG): container finished" podID="485b578f-5428-4568-9acf-5092c1ffa6de" containerID="9090d8c2a50c36a03f328033eb9c739c27a86de79dce0a615916506a6af4ac31" exitCode=0
Sep 16 00:52:56.094106 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:56.093741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc" event={"ID":"485b578f-5428-4568-9acf-5092c1ffa6de","Type":"ContainerDied","Data":"9090d8c2a50c36a03f328033eb9c739c27a86de79dce0a615916506a6af4ac31"}
Sep 16 00:52:57.241456 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:57.241424    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc"
Sep 16 00:52:57.267788 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:57.267761    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/485b578f-5428-4568-9acf-5092c1ffa6de-maas-api-service-ca\") pod \"485b578f-5428-4568-9acf-5092c1ffa6de\" (UID: \"485b578f-5428-4568-9acf-5092c1ffa6de\") "
Sep 16 00:52:57.268095 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:57.268075    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485b578f-5428-4568-9acf-5092c1ffa6de-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "485b578f-5428-4568-9acf-5092c1ffa6de" (UID: "485b578f-5428-4568-9acf-5092c1ffa6de"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:52:57.369306 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:57.369215    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/485b578f-5428-4568-9acf-5092c1ffa6de-maas-api-service-ca\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:52:58.105251 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:58.105218    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc"
Sep 16 00:52:58.105251 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:58.105227    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc" event={"ID":"485b578f-5428-4568-9acf-5092c1ffa6de","Type":"ContainerDied","Data":"9aa0821b9d263e8c9936665d0e823ba71996ced51ac15e87c00be3d2fbd7169b"}
Sep 16 00:52:58.105466 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:52:58.105280    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9aa0821b9d263e8c9936665d0e823ba71996ced51ac15e87c00be3d2fbd7169b"
Sep 16 00:53:01.996003 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:01.995958    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"]
Sep 16 00:53:01.996649 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:01.996628    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485b578f-5428-4568-9acf-5092c1ffa6de" containerName="revoke-keys"
Sep 16 00:53:01.996739 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:01.996654    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="485b578f-5428-4568-9acf-5092c1ffa6de" containerName="revoke-keys"
Sep 16 00:53:01.996920 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:01.996903    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="485b578f-5428-4568-9acf-5092c1ffa6de" containerName="revoke-keys"
Sep 16 00:53:02.000708 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.000689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.003276 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.003227    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-108960\"/\"auth-test-model-108960-kserve-self-signed-certs\""
Sep 16 00:53:02.003276 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.003243    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-108960\"/\"openshift-service-ca.crt\""
Sep 16 00:53:02.003773 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.003750    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-108960\"/\"kube-root-ca.crt\""
Sep 16 00:53:02.003954 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.003939    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-108960\"/\"default-dockercfg-9wl2p\""
Sep 16 00:53:02.005547 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.005522    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"]
Sep 16 00:53:02.116808 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.116769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cc70827-a427-4153-b542-3c17efbd7ce1-tls-certs\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.116992 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.116892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-model-cache\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.116992 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.116929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-dshm\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.117075 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.116986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fktfl\" (UniqueName: \"kubernetes.io/projected/1cc70827-a427-4153-b542-3c17efbd7ce1-kube-api-access-fktfl\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.117075 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.117043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-tmp-dir\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.117140 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.117085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-home\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.218338 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.218302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-model-cache\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.218338 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.218347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-dshm\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.218579 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.218382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fktfl\" (UniqueName: \"kubernetes.io/projected/1cc70827-a427-4153-b542-3c17efbd7ce1-kube-api-access-fktfl\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.218579 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.218402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-tmp-dir\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.218700 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.218574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-home\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.218759 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.218706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cc70827-a427-4153-b542-3c17efbd7ce1-tls-certs\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.218805 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.218777    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-model-cache\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.218973 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.218950    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-home\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.219085 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.219061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-tmp-dir\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.220882 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.220858    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-dshm\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.221355 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.221337    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cc70827-a427-4153-b542-3c17efbd7ce1-tls-certs\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.226456 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.226433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fktfl\" (UniqueName: \"kubernetes.io/projected/1cc70827-a427-4153-b542-3c17efbd7ce1-kube-api-access-fktfl\") pod \"auth-test-model-108960-kserve-5795494f99-lh5jw\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") " pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.313145 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.313059    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:02.585878 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:02.585694    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"]
Sep 16 00:53:02.588709 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:53:02.588656    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cc70827_a427_4153_b542_3c17efbd7ce1.slice/crio-154962ab49f239789c5dfe754bb49dfd2c456898a1985fcaba4679e96a0d6cc1 WatchSource:0}: Error finding container 154962ab49f239789c5dfe754bb49dfd2c456898a1985fcaba4679e96a0d6cc1: Status 404 returned error can't find the container with id 154962ab49f239789c5dfe754bb49dfd2c456898a1985fcaba4679e96a0d6cc1
Sep 16 00:53:03.132904 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.132871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw" event={"ID":"1cc70827-a427-4153-b542-3c17efbd7ce1","Type":"ContainerStarted","Data":"9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453"}
Sep 16 00:53:03.132904 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.132909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw" event={"ID":"1cc70827-a427-4153-b542-3c17efbd7ce1","Type":"ContainerStarted","Data":"154962ab49f239789c5dfe754bb49dfd2c456898a1985fcaba4679e96a0d6cc1"}
Sep 16 00:53:03.150216 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.150162    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw" podStartSLOduration=2.15014105 podStartE2EDuration="2.15014105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:53:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:53:03.14803501 +0000 UTC m=+1133.950858075" watchObservedRunningTime="2026-09-16 00:53:03.15014105 +0000 UTC m=+1133.952964113"
Sep 16 00:53:03.427296 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.427208    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"]
Sep 16 00:53:03.427503 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.427470    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg" podUID="1affa112-f511-4482-8efc-e665ee5a7d59" containerName="payload-pre-processing" containerID="cri-o://518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed" gracePeriod=30
Sep 16 00:53:03.590217 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.590179    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc"]
Sep 16 00:53:03.593456 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.593426    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-69886ef2-zfhgc"]
Sep 16 00:53:03.670127 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.670071    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="485b578f-5428-4568-9acf-5092c1ffa6de" path="/var/lib/kubelet/pods/485b578f-5428-4568-9acf-5092c1ffa6de/volumes"
Sep 16 00:53:03.700100 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.700070    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"
Sep 16 00:53:03.833151 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.833111    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1affa112-f511-4482-8efc-e665ee5a7d59-plugins-config-volume\") pod \"1affa112-f511-4482-8efc-e665ee5a7d59\" (UID: \"1affa112-f511-4482-8efc-e665ee5a7d59\") "
Sep 16 00:53:03.833327 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.833225    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szvzg\" (UniqueName: \"kubernetes.io/projected/1affa112-f511-4482-8efc-e665ee5a7d59-kube-api-access-szvzg\") pod \"1affa112-f511-4482-8efc-e665ee5a7d59\" (UID: \"1affa112-f511-4482-8efc-e665ee5a7d59\") "
Sep 16 00:53:03.833526 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.833499    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1affa112-f511-4482-8efc-e665ee5a7d59-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1affa112-f511-4482-8efc-e665ee5a7d59" (UID: "1affa112-f511-4482-8efc-e665ee5a7d59"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:53:03.835474 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.835445    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1affa112-f511-4482-8efc-e665ee5a7d59-kube-api-access-szvzg" (OuterVolumeSpecName: "kube-api-access-szvzg") pod "1affa112-f511-4482-8efc-e665ee5a7d59" (UID: "1affa112-f511-4482-8efc-e665ee5a7d59"). InnerVolumeSpecName "kube-api-access-szvzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:53:03.934566 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.934477    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1affa112-f511-4482-8efc-e665ee5a7d59-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:03.934566 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:03.934508    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szvzg\" (UniqueName: \"kubernetes.io/projected/1affa112-f511-4482-8efc-e665ee5a7d59-kube-api-access-szvzg\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:04.148225 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:04.148185    2563 generic.go:356] "Generic (PLEG): container finished" podID="1affa112-f511-4482-8efc-e665ee5a7d59" containerID="518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed" exitCode=0
Sep 16 00:53:04.148715 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:04.148250    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"
Sep 16 00:53:04.148715 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:04.148279    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg" event={"ID":"1affa112-f511-4482-8efc-e665ee5a7d59","Type":"ContainerDied","Data":"518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed"}
Sep 16 00:53:04.148715 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:04.148365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg" event={"ID":"1affa112-f511-4482-8efc-e665ee5a7d59","Type":"ContainerDied","Data":"567cb863e98ae602e4ca965f6a82667ab441dcd14b79342de945aa2a52b66d3b"}
Sep 16 00:53:04.148715 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:04.148395    2563 scope.go:117] "RemoveContainer" containerID="518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed"
Sep 16 00:53:04.158133 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:04.158114    2563 scope.go:117] "RemoveContainer" containerID="518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed"
Sep 16 00:53:04.158462 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:53:04.158441    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed\": container with ID starting with 518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed not found: ID does not exist" containerID="518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed"
Sep 16 00:53:04.158528 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:04.158471    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed"} err="failed to get container status \"518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed\": rpc error: code = NotFound desc = could not find container \"518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed\": container with ID starting with 518a6ab0b6d84ec07bdbfda58c1dff7986634b8855dbf123ff004f1038c1b4ed not found: ID does not exist"
Sep 16 00:53:04.171594 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:04.171568    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"]
Sep 16 00:53:04.178011 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:04.177986    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-69886ef2-76c4d964b-k9wjg"]
Sep 16 00:53:05.669223 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:05.669186    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1affa112-f511-4482-8efc-e665ee5a7d59" path="/var/lib/kubelet/pods/1affa112-f511-4482-8efc-e665ee5a7d59/volumes"
Sep 16 00:53:10.564004 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.563972    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"]
Sep 16 00:53:10.564418 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.564379    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1affa112-f511-4482-8efc-e665ee5a7d59" containerName="payload-pre-processing"
Sep 16 00:53:10.564418 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.564391    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1affa112-f511-4482-8efc-e665ee5a7d59" containerName="payload-pre-processing"
Sep 16 00:53:10.564506 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.564467    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1affa112-f511-4482-8efc-e665ee5a7d59" containerName="payload-pre-processing"
Sep 16 00:53:10.568746 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.568726    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"
Sep 16 00:53:10.570842 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.570813    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9f35fa48\""
Sep 16 00:53:10.570842 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.570813    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9f35fa48-dockercfg-fl6n9\""
Sep 16 00:53:10.577679 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.577638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"]
Sep 16 00:53:10.702973 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.702940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29a9f78f-4d0c-4057-bf10-6fb31f488e7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w\" (UID: \"29a9f78f-4d0c-4057-bf10-6fb31f488e7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"
Sep 16 00:53:10.703174 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.703059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v9k2\" (UniqueName: \"kubernetes.io/projected/29a9f78f-4d0c-4057-bf10-6fb31f488e7c-kube-api-access-2v9k2\") pod \"payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w\" (UID: \"29a9f78f-4d0c-4057-bf10-6fb31f488e7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"
Sep 16 00:53:10.804529 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.804481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v9k2\" (UniqueName: \"kubernetes.io/projected/29a9f78f-4d0c-4057-bf10-6fb31f488e7c-kube-api-access-2v9k2\") pod \"payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w\" (UID: \"29a9f78f-4d0c-4057-bf10-6fb31f488e7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"
Sep 16 00:53:10.804767 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.804600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29a9f78f-4d0c-4057-bf10-6fb31f488e7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w\" (UID: \"29a9f78f-4d0c-4057-bf10-6fb31f488e7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"
Sep 16 00:53:10.805302 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.805277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29a9f78f-4d0c-4057-bf10-6fb31f488e7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w\" (UID: \"29a9f78f-4d0c-4057-bf10-6fb31f488e7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"
Sep 16 00:53:10.813363 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.813340    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v9k2\" (UniqueName: \"kubernetes.io/projected/29a9f78f-4d0c-4057-bf10-6fb31f488e7c-kube-api-access-2v9k2\") pod \"payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w\" (UID: \"29a9f78f-4d0c-4057-bf10-6fb31f488e7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"
Sep 16 00:53:10.880727 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:10.880610    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"
Sep 16 00:53:11.154622 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:11.154597    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"]
Sep 16 00:53:11.156543 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:53:11.156516    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a9f78f_4d0c_4057_bf10_6fb31f488e7c.slice/crio-f3546eb163ff00e2f86597eb5baad0c6d08af528b5f7a60eac8c752022f6d649 WatchSource:0}: Error finding container f3546eb163ff00e2f86597eb5baad0c6d08af528b5f7a60eac8c752022f6d649: Status 404 returned error can't find the container with id f3546eb163ff00e2f86597eb5baad0c6d08af528b5f7a60eac8c752022f6d649
Sep 16 00:53:11.188985 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:11.188949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w" event={"ID":"29a9f78f-4d0c-4057-bf10-6fb31f488e7c","Type":"ContainerStarted","Data":"f3546eb163ff00e2f86597eb5baad0c6d08af528b5f7a60eac8c752022f6d649"}
Sep 16 00:53:12.196948 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:12.196906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w" event={"ID":"29a9f78f-4d0c-4057-bf10-6fb31f488e7c","Type":"ContainerStarted","Data":"cf9cac5ceff9626ba7019cfef825d38c6e7d555ca7405b758119069c5c7cdb16"}
Sep 16 00:53:12.197350 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:12.197007    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"
Sep 16 00:53:12.213787 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:12.213734    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w" podStartSLOduration=2.2137187369999998 podStartE2EDuration="2.213718737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:53:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:53:12.212463978 +0000 UTC m=+1143.015287064" watchObservedRunningTime="2026-09-16 00:53:12.213718737 +0000 UTC m=+1143.016541800"
Sep 16 00:53:12.313550 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:12.313504    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:12.313550 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:12.313557    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:12.326444 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:12.326411    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:13.220441 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:13.220405    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:53:16.859843 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:16.859807    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"]
Sep 16 00:53:16.865905 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:16.865864    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"]
Sep 16 00:53:23.205302 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:23.205269    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"
Sep 16 00:53:27.651525 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:27.651481    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"]
Sep 16 00:53:27.652137 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:27.651716    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw" podUID="3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9" containerName="payload-processing" containerID="cri-o://c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368" gracePeriod=30
Sep 16 00:53:27.913248 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:27.913187    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"
Sep 16 00:53:27.976933 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:27.976872    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grr29\" (UniqueName: \"kubernetes.io/projected/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9-kube-api-access-grr29\") pod \"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9\" (UID: \"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9\") "
Sep 16 00:53:27.977112 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:27.976952    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9-plugins-config-volume\") pod \"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9\" (UID: \"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9\") "
Sep 16 00:53:27.977257 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:27.977226    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9" (UID: "3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:53:27.979272 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:27.979245    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9-kube-api-access-grr29" (OuterVolumeSpecName: "kube-api-access-grr29") pod "3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9" (UID: "3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9"). InnerVolumeSpecName "kube-api-access-grr29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:53:28.077859 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:28.077818    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grr29\" (UniqueName: \"kubernetes.io/projected/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9-kube-api-access-grr29\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:28.077859 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:28.077851    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:28.287045 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:28.287006    2563 generic.go:356] "Generic (PLEG): container finished" podID="3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9" containerID="c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368" exitCode=0
Sep 16 00:53:28.287224 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:28.287055    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"
Sep 16 00:53:28.287224 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:28.287093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw" event={"ID":"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9","Type":"ContainerDied","Data":"c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368"}
Sep 16 00:53:28.287224 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:28.287149    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw" event={"ID":"3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9","Type":"ContainerDied","Data":"8dc9d8d6d3ed44e67c5d84469e0f86ac41abf04ba936ed0793f54676345052ab"}
Sep 16 00:53:28.287224 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:28.287172    2563 scope.go:117] "RemoveContainer" containerID="c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368"
Sep 16 00:53:28.297046 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:28.297024    2563 scope.go:117] "RemoveContainer" containerID="c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368"
Sep 16 00:53:28.297335 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:53:28.297316    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368\": container with ID starting with c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368 not found: ID does not exist" containerID="c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368"
Sep 16 00:53:28.297386 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:28.297346    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368"} err="failed to get container status \"c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368\": rpc error: code = NotFound desc = could not find container \"c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368\": container with ID starting with c6df3975ba1ed6b40abbd8abea71bba7789115bd699331e7c14ece4037f72368 not found: ID does not exist"
Sep 16 00:53:28.307394 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:28.307368    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"]
Sep 16 00:53:28.312930 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:28.312906    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-0f7c3b-6c8c786c-hdvpw"]
Sep 16 00:53:29.668837 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:29.668806    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9" path="/var/lib/kubelet/pods/3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9/volumes"
Sep 16 00:53:31.880727 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:31.880602    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76" podUID="635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a" containerName="main" containerID="cri-o://c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76" gracePeriod=45
Sep 16 00:53:31.887194 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:31.887151    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6" podUID="54c3764f-0bf3-4426-9f4b-8ba2106adff4" containerName="main" containerID="cri-o://502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115" gracePeriod=45
Sep 16 00:53:32.167366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.167341    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:53:32.170294 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.170276    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:53:32.214732 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.214701    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54c3764f-0bf3-4426-9f4b-8ba2106adff4-tls-certs\") pod \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") "
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.214753    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-home\") pod \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") "
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.214779    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-model-cache\") pod \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") "
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.214839    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-home\") pod \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") "
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.214882    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-dshm\") pod \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") "
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.214918    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-model-cache\") pod \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") "
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.214981    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-tmp-dir\") pod \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") "
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215006    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-dshm\") pod \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") "
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215053    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-tls-certs\") pod \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") "
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215090    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-tmp-dir\") pod \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") "
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215085    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-home" (OuterVolumeSpecName: "home") pod "54c3764f-0bf3-4426-9f4b-8ba2106adff4" (UID: "54c3764f-0bf3-4426-9f4b-8ba2106adff4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215090    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-model-cache" (OuterVolumeSpecName: "model-cache") pod "54c3764f-0bf3-4426-9f4b-8ba2106adff4" (UID: "54c3764f-0bf3-4426-9f4b-8ba2106adff4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215123    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2m46\" (UniqueName: \"kubernetes.io/projected/54c3764f-0bf3-4426-9f4b-8ba2106adff4-kube-api-access-p2m46\") pod \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\" (UID: \"54c3764f-0bf3-4426-9f4b-8ba2106adff4\") "
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215131    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-home" (OuterVolumeSpecName: "home") pod "635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a" (UID: "635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215155    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz9ks\" (UniqueName: \"kubernetes.io/projected/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-kube-api-access-jz9ks\") pod \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\" (UID: \"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a\") "
Sep 16 00:53:32.215347 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215310    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "54c3764f-0bf3-4426-9f4b-8ba2106adff4" (UID: "54c3764f-0bf3-4426-9f4b-8ba2106adff4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:53:32.217785 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215604    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-tmp-dir\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:32.217785 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215625    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-home\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:32.217785 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215638    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-model-cache\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:32.217785 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215652    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-home\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:32.217785 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215604    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-model-cache" (OuterVolumeSpecName: "model-cache") pod "635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a" (UID: "635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:53:32.217785 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.215634    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a" (UID: "635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:53:32.218471 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.218432    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-kube-api-access-jz9ks" (OuterVolumeSpecName: "kube-api-access-jz9ks") pod "635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a" (UID: "635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a"). InnerVolumeSpecName "kube-api-access-jz9ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:53:32.219382 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.219350    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-dshm" (OuterVolumeSpecName: "dshm") pod "54c3764f-0bf3-4426-9f4b-8ba2106adff4" (UID: "54c3764f-0bf3-4426-9f4b-8ba2106adff4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:53:32.219771 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.219738    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a" (UID: "635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:53:32.220213 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.220182    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c3764f-0bf3-4426-9f4b-8ba2106adff4-kube-api-access-p2m46" (OuterVolumeSpecName: "kube-api-access-p2m46") pod "54c3764f-0bf3-4426-9f4b-8ba2106adff4" (UID: "54c3764f-0bf3-4426-9f4b-8ba2106adff4"). InnerVolumeSpecName "kube-api-access-p2m46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:53:32.220507 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.220476    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-dshm" (OuterVolumeSpecName: "dshm") pod "635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a" (UID: "635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:53:32.220591 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.220501    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c3764f-0bf3-4426-9f4b-8ba2106adff4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "54c3764f-0bf3-4426-9f4b-8ba2106adff4" (UID: "54c3764f-0bf3-4426-9f4b-8ba2106adff4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:53:32.310308 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.310274    2563 generic.go:356] "Generic (PLEG): container finished" podID="54c3764f-0bf3-4426-9f4b-8ba2106adff4" containerID="502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115" exitCode=0
Sep 16 00:53:32.310499 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.310322    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"
Sep 16 00:53:32.310499 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.310360    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6" event={"ID":"54c3764f-0bf3-4426-9f4b-8ba2106adff4","Type":"ContainerDied","Data":"502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115"}
Sep 16 00:53:32.310499 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.310410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6" event={"ID":"54c3764f-0bf3-4426-9f4b-8ba2106adff4","Type":"ContainerDied","Data":"e06b5ca7383387884517d453e848fea249e027966d7f0412047c70ae5ea4d3c8"}
Sep 16 00:53:32.310499 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.310432    2563 scope.go:117] "RemoveContainer" containerID="502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115"
Sep 16 00:53:32.311885 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.311859    2563 generic.go:356] "Generic (PLEG): container finished" podID="635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a" containerID="c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76" exitCode=0
Sep 16 00:53:32.312010 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.311894    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"
Sep 16 00:53:32.312010 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.311915    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76" event={"ID":"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a","Type":"ContainerDied","Data":"c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76"}
Sep 16 00:53:32.312010 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.311944    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76" event={"ID":"635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a","Type":"ContainerDied","Data":"4157837d8b619d96ef36c82126602e3eb99339228084ca199122722fbdd51e33"}
Sep 16 00:53:32.316350 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.316325    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54c3764f-0bf3-4426-9f4b-8ba2106adff4-tls-certs\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:32.316455 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.316353    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54c3764f-0bf3-4426-9f4b-8ba2106adff4-dshm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:32.316455 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.316366    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-model-cache\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:32.316455 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.316378    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-tmp-dir\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:32.316455 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.316390    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-dshm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:32.316455 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.316402    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-tls-certs\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:32.316455 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.316414    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2m46\" (UniqueName: \"kubernetes.io/projected/54c3764f-0bf3-4426-9f4b-8ba2106adff4-kube-api-access-p2m46\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:32.316455 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.316428    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz9ks\" (UniqueName: \"kubernetes.io/projected/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a-kube-api-access-jz9ks\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:32.321987 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.321967    2563 scope.go:117] "RemoveContainer" containerID="502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115"
Sep 16 00:53:32.322419 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:53:32.322369    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115\": container with ID starting with 502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115 not found: ID does not exist" containerID="502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115"
Sep 16 00:53:32.322419 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.322408    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115"} err="failed to get container status \"502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115\": rpc error: code = NotFound desc = could not find container \"502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115\": container with ID starting with 502411a523df2ecb9b50768a13f05171f3d870e9047ec338d9cdd5f85b944115 not found: ID does not exist"
Sep 16 00:53:32.322588 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.322432    2563 scope.go:117] "RemoveContainer" containerID="c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76"
Sep 16 00:53:32.332348 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.332317    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"]
Sep 16 00:53:32.333700 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.333658    2563 scope.go:117] "RemoveContainer" containerID="c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76"
Sep 16 00:53:32.334083 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:53:32.334062    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76\": container with ID starting with c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76 not found: ID does not exist" containerID="c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76"
Sep 16 00:53:32.334159 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.334094    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76"} err="failed to get container status \"c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76\": rpc error: code = NotFound desc = could not find container \"c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76\": container with ID starting with c3b63d01201ec9603403dcd5674cd7f778db14962447a6eaccdd7e0555a4ee76 not found: ID does not exist"
Sep 16 00:53:32.336216 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.336196    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-0f7c3b/distinct-w3-0f7c3b-kserve-6557954b9-rw6b6"]
Sep 16 00:53:32.344612 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.344591    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"]
Sep 16 00:53:32.350524 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:32.350504    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-0f7c3b/distinct-2-w3-0f7c3b-kserve-5fbbffb586-8fv76"]
Sep 16 00:53:33.668111 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:33.668080    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c3764f-0bf3-4426-9f4b-8ba2106adff4" path="/var/lib/kubelet/pods/54c3764f-0bf3-4426-9f4b-8ba2106adff4/volumes"
Sep 16 00:53:33.668486 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:33.668456    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a" path="/var/lib/kubelet/pods/635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a/volumes"
Sep 16 00:53:39.168035 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:39.167999    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"]
Sep 16 00:53:39.168538 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:39.168245    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w" podUID="29a9f78f-4d0c-4057-bf10-6fb31f488e7c" containerName="payload-pre-processing" containerID="cri-o://cf9cac5ceff9626ba7019cfef825d38c6e7d555ca7405b758119069c5c7cdb16" gracePeriod=30
Sep 16 00:53:39.354195 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:39.354160    2563 generic.go:356] "Generic (PLEG): container finished" podID="29a9f78f-4d0c-4057-bf10-6fb31f488e7c" containerID="cf9cac5ceff9626ba7019cfef825d38c6e7d555ca7405b758119069c5c7cdb16" exitCode=0
Sep 16 00:53:39.354359 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:39.354225    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w" event={"ID":"29a9f78f-4d0c-4057-bf10-6fb31f488e7c","Type":"ContainerDied","Data":"cf9cac5ceff9626ba7019cfef825d38c6e7d555ca7405b758119069c5c7cdb16"}
Sep 16 00:53:39.423391 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:39.423313    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"
Sep 16 00:53:39.484887 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:39.484851    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29a9f78f-4d0c-4057-bf10-6fb31f488e7c-plugins-config-volume\") pod \"29a9f78f-4d0c-4057-bf10-6fb31f488e7c\" (UID: \"29a9f78f-4d0c-4057-bf10-6fb31f488e7c\") "
Sep 16 00:53:39.485085 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:39.484968    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v9k2\" (UniqueName: \"kubernetes.io/projected/29a9f78f-4d0c-4057-bf10-6fb31f488e7c-kube-api-access-2v9k2\") pod \"29a9f78f-4d0c-4057-bf10-6fb31f488e7c\" (UID: \"29a9f78f-4d0c-4057-bf10-6fb31f488e7c\") "
Sep 16 00:53:39.485335 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:39.485307    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29a9f78f-4d0c-4057-bf10-6fb31f488e7c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "29a9f78f-4d0c-4057-bf10-6fb31f488e7c" (UID: "29a9f78f-4d0c-4057-bf10-6fb31f488e7c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:53:39.487225 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:39.487202    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29a9f78f-4d0c-4057-bf10-6fb31f488e7c-kube-api-access-2v9k2" (OuterVolumeSpecName: "kube-api-access-2v9k2") pod "29a9f78f-4d0c-4057-bf10-6fb31f488e7c" (UID: "29a9f78f-4d0c-4057-bf10-6fb31f488e7c"). InnerVolumeSpecName "kube-api-access-2v9k2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:53:39.586251 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:39.586210    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29a9f78f-4d0c-4057-bf10-6fb31f488e7c-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:39.586251 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:39.586244    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v9k2\" (UniqueName: \"kubernetes.io/projected/29a9f78f-4d0c-4057-bf10-6fb31f488e7c-kube-api-access-2v9k2\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:53:40.360830 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:40.360803    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"
Sep 16 00:53:40.361267 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:40.360798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w" event={"ID":"29a9f78f-4d0c-4057-bf10-6fb31f488e7c","Type":"ContainerDied","Data":"f3546eb163ff00e2f86597eb5baad0c6d08af528b5f7a60eac8c752022f6d649"}
Sep 16 00:53:40.361267 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:40.360946    2563 scope.go:117] "RemoveContainer" containerID="cf9cac5ceff9626ba7019cfef825d38c6e7d555ca7405b758119069c5c7cdb16"
Sep 16 00:53:40.374932 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:40.374906    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"]
Sep 16 00:53:40.378754 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:40.378732    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9f35fa48-55c877cf6b-xvq5w"]
Sep 16 00:53:41.668436 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:41.668405    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29a9f78f-4d0c-4057-bf10-6fb31f488e7c" path="/var/lib/kubelet/pods/29a9f78f-4d0c-4057-bf10-6fb31f488e7c/volumes"
Sep 16 00:53:45.906293 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906258    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"]
Sep 16 00:53:45.906788 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906643    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9" containerName="payload-processing"
Sep 16 00:53:45.906788 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906654    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9" containerName="payload-processing"
Sep 16 00:53:45.906788 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906682    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c3764f-0bf3-4426-9f4b-8ba2106adff4" containerName="main"
Sep 16 00:53:45.906788 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906688    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c3764f-0bf3-4426-9f4b-8ba2106adff4" containerName="main"
Sep 16 00:53:45.906788 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906707    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29a9f78f-4d0c-4057-bf10-6fb31f488e7c" containerName="payload-pre-processing"
Sep 16 00:53:45.906788 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906713    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="29a9f78f-4d0c-4057-bf10-6fb31f488e7c" containerName="payload-pre-processing"
Sep 16 00:53:45.906788 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906722    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a" containerName="main"
Sep 16 00:53:45.906788 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906727    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a" containerName="main"
Sep 16 00:53:45.907077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906799    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="54c3764f-0bf3-4426-9f4b-8ba2106adff4" containerName="main"
Sep 16 00:53:45.907077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906805    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="635d5e6f-6071-4178-9b3b-6f7e5fa4dc6a" containerName="main"
Sep 16 00:53:45.907077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906813    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7bcd5d-2ec7-4e9d-9535-a82d8df2fbb9" containerName="payload-processing"
Sep 16 00:53:45.907077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.906819    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="29a9f78f-4d0c-4057-bf10-6fb31f488e7c" containerName="payload-pre-processing"
Sep 16 00:53:45.911314 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.911291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"
Sep 16 00:53:45.913528 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.913504    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-68e143c2-dockercfg-zvb9b\""
Sep 16 00:53:45.913620 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.913523    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-68e143c2\""
Sep 16 00:53:45.917135 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:45.917106    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"]
Sep 16 00:53:46.051695 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:46.051629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1653caa-fd64-4e27-9e96-4b3f189b4c9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf\" (UID: \"e1653caa-fd64-4e27-9e96-4b3f189b4c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"
Sep 16 00:53:46.051873 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:46.051754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhk2r\" (UniqueName: \"kubernetes.io/projected/e1653caa-fd64-4e27-9e96-4b3f189b4c9d-kube-api-access-jhk2r\") pod \"payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf\" (UID: \"e1653caa-fd64-4e27-9e96-4b3f189b4c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"
Sep 16 00:53:46.153019 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:46.152979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhk2r\" (UniqueName: \"kubernetes.io/projected/e1653caa-fd64-4e27-9e96-4b3f189b4c9d-kube-api-access-jhk2r\") pod \"payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf\" (UID: \"e1653caa-fd64-4e27-9e96-4b3f189b4c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"
Sep 16 00:53:46.153202 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:46.153088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1653caa-fd64-4e27-9e96-4b3f189b4c9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf\" (UID: \"e1653caa-fd64-4e27-9e96-4b3f189b4c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"
Sep 16 00:53:46.153784 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:46.153765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1653caa-fd64-4e27-9e96-4b3f189b4c9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf\" (UID: \"e1653caa-fd64-4e27-9e96-4b3f189b4c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"
Sep 16 00:53:46.161051 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:46.160988    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhk2r\" (UniqueName: \"kubernetes.io/projected/e1653caa-fd64-4e27-9e96-4b3f189b4c9d-kube-api-access-jhk2r\") pod \"payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf\" (UID: \"e1653caa-fd64-4e27-9e96-4b3f189b4c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"
Sep 16 00:53:46.223125 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:46.223087    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"
Sep 16 00:53:46.495761 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:46.495731    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"]
Sep 16 00:53:46.497875 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:53:46.497848    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1653caa_fd64_4e27_9e96_4b3f189b4c9d.slice/crio-9c2bf1233b9609ac2c33ad6ddb18db59d35b159dbe0ff22e9288be309293e9ec WatchSource:0}: Error finding container 9c2bf1233b9609ac2c33ad6ddb18db59d35b159dbe0ff22e9288be309293e9ec: Status 404 returned error can't find the container with id 9c2bf1233b9609ac2c33ad6ddb18db59d35b159dbe0ff22e9288be309293e9ec
Sep 16 00:53:47.401125 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:47.401085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf" event={"ID":"e1653caa-fd64-4e27-9e96-4b3f189b4c9d","Type":"ContainerStarted","Data":"391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364"}
Sep 16 00:53:47.401594 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:47.401154    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"
Sep 16 00:53:47.401594 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:47.401197    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf" event={"ID":"e1653caa-fd64-4e27-9e96-4b3f189b4c9d","Type":"ContainerStarted","Data":"9c2bf1233b9609ac2c33ad6ddb18db59d35b159dbe0ff22e9288be309293e9ec"}
Sep 16 00:53:47.418013 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:47.417954    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf" podStartSLOduration=2.417936509 podStartE2EDuration="2.417936509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:53:47.415170612 +0000 UTC m=+1178.217993675" watchObservedRunningTime="2026-09-16 00:53:47.417936509 +0000 UTC m=+1178.220759572"
Sep 16 00:53:58.409542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:53:58.409510    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"
Sep 16 00:54:09.978591 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:09.978509    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"]
Sep 16 00:54:09.983462 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:09.983436    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:09.985486 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:09.985465    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-5270e2\"/\"embedding-w0-5270e2-kserve-self-signed-certs\""
Sep 16 00:54:09.991533 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:09.991259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"]
Sep 16 00:54:10.101403 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.101372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-model-cache\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.101570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.101424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-tls-certs\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.101570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.101487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-home\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.101570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.101529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmkcc\" (UniqueName: \"kubernetes.io/projected/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-kube-api-access-qmkcc\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.101570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.101553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-dshm\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.101570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.101568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-tmp-dir\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.202075 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.202040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmkcc\" (UniqueName: \"kubernetes.io/projected/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-kube-api-access-qmkcc\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.202075 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.202085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-dshm\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.202315 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.202110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-tmp-dir\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.202315 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.202182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-model-cache\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.202315 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.202223    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-tls-certs\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.202315 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.202279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-home\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.202582 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.202554    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-tmp-dir\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.202582 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.202574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-model-cache\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.202717 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.202626    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-home\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.204438 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.204417    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-dshm\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.204727 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.204705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-tls-certs\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.209735 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.209711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmkcc\" (UniqueName: \"kubernetes.io/projected/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-kube-api-access-qmkcc\") pod \"embedding-w0-5270e2-kserve-7898cb67c7-h7pqs\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") " pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.294812 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.294712    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:10.571690 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:10.571614    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"]
Sep 16 00:54:10.574155 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:54:10.574122    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ef44fe1_1887_4ab6_aba6_f64a0aee05e1.slice/crio-a5a0a19f154cc9a62d36f84a0215f1db103e0f3db7e3c58d722672b559874926 WatchSource:0}: Error finding container a5a0a19f154cc9a62d36f84a0215f1db103e0f3db7e3c58d722672b559874926: Status 404 returned error can't find the container with id a5a0a19f154cc9a62d36f84a0215f1db103e0f3db7e3c58d722672b559874926
Sep 16 00:54:11.537007 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:11.536970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs" event={"ID":"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1","Type":"ContainerStarted","Data":"2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6"}
Sep 16 00:54:11.537007 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:11.537014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs" event={"ID":"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1","Type":"ContainerStarted","Data":"a5a0a19f154cc9a62d36f84a0215f1db103e0f3db7e3c58d722672b559874926"}
Sep 16 00:54:11.552842 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:11.552792    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs" podStartSLOduration=2.552774851 podStartE2EDuration="2.552774851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:54:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:54:11.551691065 +0000 UTC m=+1202.354514122" watchObservedRunningTime="2026-09-16 00:54:11.552774851 +0000 UTC m=+1202.355597917"
Sep 16 00:54:15.728052 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:15.728016    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"]
Sep 16 00:54:15.728539 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:15.728277    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf" podUID="e1653caa-fd64-4e27-9e96-4b3f189b4c9d" containerName="payload-pre-processing" containerID="cri-o://391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364" gracePeriod=30
Sep 16 00:54:15.989189 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:15.989119    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"
Sep 16 00:54:16.064330 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.064295    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhk2r\" (UniqueName: \"kubernetes.io/projected/e1653caa-fd64-4e27-9e96-4b3f189b4c9d-kube-api-access-jhk2r\") pod \"e1653caa-fd64-4e27-9e96-4b3f189b4c9d\" (UID: \"e1653caa-fd64-4e27-9e96-4b3f189b4c9d\") "
Sep 16 00:54:16.064523 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.064428    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1653caa-fd64-4e27-9e96-4b3f189b4c9d-plugins-config-volume\") pod \"e1653caa-fd64-4e27-9e96-4b3f189b4c9d\" (UID: \"e1653caa-fd64-4e27-9e96-4b3f189b4c9d\") "
Sep 16 00:54:16.064794 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.064769    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1653caa-fd64-4e27-9e96-4b3f189b4c9d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e1653caa-fd64-4e27-9e96-4b3f189b4c9d" (UID: "e1653caa-fd64-4e27-9e96-4b3f189b4c9d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:54:16.066652 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.066631    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1653caa-fd64-4e27-9e96-4b3f189b4c9d-kube-api-access-jhk2r" (OuterVolumeSpecName: "kube-api-access-jhk2r") pod "e1653caa-fd64-4e27-9e96-4b3f189b4c9d" (UID: "e1653caa-fd64-4e27-9e96-4b3f189b4c9d"). InnerVolumeSpecName "kube-api-access-jhk2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:54:16.166132 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.166086    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1653caa-fd64-4e27-9e96-4b3f189b4c9d-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:54:16.166132 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.166123    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhk2r\" (UniqueName: \"kubernetes.io/projected/e1653caa-fd64-4e27-9e96-4b3f189b4c9d-kube-api-access-jhk2r\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:54:16.567458 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.567419    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1653caa-fd64-4e27-9e96-4b3f189b4c9d" containerID="391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364" exitCode=0
Sep 16 00:54:16.567458 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.567462    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"
Sep 16 00:54:16.567777 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.567496    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf" event={"ID":"e1653caa-fd64-4e27-9e96-4b3f189b4c9d","Type":"ContainerDied","Data":"391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364"}
Sep 16 00:54:16.567777 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.567548    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf" event={"ID":"e1653caa-fd64-4e27-9e96-4b3f189b4c9d","Type":"ContainerDied","Data":"9c2bf1233b9609ac2c33ad6ddb18db59d35b159dbe0ff22e9288be309293e9ec"}
Sep 16 00:54:16.567777 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.567576    2563 scope.go:117] "RemoveContainer" containerID="391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364"
Sep 16 00:54:16.577768 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.577741    2563 scope.go:117] "RemoveContainer" containerID="391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364"
Sep 16 00:54:16.578096 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:54:16.578077    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364\": container with ID starting with 391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364 not found: ID does not exist" containerID="391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364"
Sep 16 00:54:16.578147 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.578107    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364"} err="failed to get container status \"391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364\": rpc error: code = NotFound desc = could not find container \"391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364\": container with ID starting with 391b3956898e487ebb7cf9e20cd11d246c342deb855fd3c7d24ad0f23ae57364 not found: ID does not exist"
Sep 16 00:54:16.588198 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.588164    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"]
Sep 16 00:54:16.592115 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:16.592090    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-68e143c2-8694958cf4-4nfxf"]
Sep 16 00:54:17.668710 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:17.668655    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1653caa-fd64-4e27-9e96-4b3f189b4c9d" path="/var/lib/kubelet/pods/e1653caa-fd64-4e27-9e96-4b3f189b4c9d/volumes"
Sep 16 00:54:20.295077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:20.295038    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:20.295077 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:20.295097    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:20.308383 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:20.308357    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:54:20.602830 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:54:20.602744    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:55:12.353382 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:12.353348    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"]
Sep 16 00:55:12.362794 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:12.362767    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"]
Sep 16 00:55:12.371827 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:12.371737    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"]
Sep 16 00:55:23.216576 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.216537    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"]
Sep 16 00:55:23.217188 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.216830    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb" podUID="6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c" containerName="payload-processing" containerID="cri-o://68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11" gracePeriod=30
Sep 16 00:55:23.221726 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.221637    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"]
Sep 16 00:55:23.222096 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.222068    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf" podUID="9867a056-16ab-44a5-9053-ac69ef60bbae" containerName="payload-pre-processing" containerID="cri-o://7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6" gracePeriod=30
Sep 16 00:55:23.475925 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.475860    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"
Sep 16 00:55:23.507968 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.507934    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"
Sep 16 00:55:23.546322 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.546292    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fq6v\" (UniqueName: \"kubernetes.io/projected/9867a056-16ab-44a5-9053-ac69ef60bbae-kube-api-access-6fq6v\") pod \"9867a056-16ab-44a5-9053-ac69ef60bbae\" (UID: \"9867a056-16ab-44a5-9053-ac69ef60bbae\") "
Sep 16 00:55:23.546508 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.546360    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9867a056-16ab-44a5-9053-ac69ef60bbae-plugins-config-volume\") pod \"9867a056-16ab-44a5-9053-ac69ef60bbae\" (UID: \"9867a056-16ab-44a5-9053-ac69ef60bbae\") "
Sep 16 00:55:23.546508 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.546440    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbtp7\" (UniqueName: \"kubernetes.io/projected/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c-kube-api-access-vbtp7\") pod \"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c\" (UID: \"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c\") "
Sep 16 00:55:23.546607 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.546516    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c-plugins-config-volume\") pod \"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c\" (UID: \"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c\") "
Sep 16 00:55:23.546897 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.546872    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9867a056-16ab-44a5-9053-ac69ef60bbae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9867a056-16ab-44a5-9053-ac69ef60bbae" (UID: "9867a056-16ab-44a5-9053-ac69ef60bbae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:55:23.546897 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.546885    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c" (UID: "6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:55:23.548596 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.548575    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9867a056-16ab-44a5-9053-ac69ef60bbae-kube-api-access-6fq6v" (OuterVolumeSpecName: "kube-api-access-6fq6v") pod "9867a056-16ab-44a5-9053-ac69ef60bbae" (UID: "9867a056-16ab-44a5-9053-ac69ef60bbae"). InnerVolumeSpecName "kube-api-access-6fq6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:55:23.548648 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.548615    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c-kube-api-access-vbtp7" (OuterVolumeSpecName: "kube-api-access-vbtp7") pod "6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c" (UID: "6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c"). InnerVolumeSpecName "kube-api-access-vbtp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:55:23.647318 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.647283    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbtp7\" (UniqueName: \"kubernetes.io/projected/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c-kube-api-access-vbtp7\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:23.647318 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.647315    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:23.647318 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.647324    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fq6v\" (UniqueName: \"kubernetes.io/projected/9867a056-16ab-44a5-9053-ac69ef60bbae-kube-api-access-6fq6v\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:23.647571 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.647333    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9867a056-16ab-44a5-9053-ac69ef60bbae-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:23.921071 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.920975    2563 generic.go:356] "Generic (PLEG): container finished" podID="6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c" containerID="68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11" exitCode=0
Sep 16 00:55:23.921071 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.921033    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"
Sep 16 00:55:23.921071 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.921055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb" event={"ID":"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c","Type":"ContainerDied","Data":"68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11"}
Sep 16 00:55:23.921343 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.921113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb" event={"ID":"6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c","Type":"ContainerDied","Data":"fb65cc573a06ee8aad541ad64916f2932cf15256ac5ca6039406345119a6e914"}
Sep 16 00:55:23.921343 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.921143    2563 scope.go:117] "RemoveContainer" containerID="68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11"
Sep 16 00:55:23.922458 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.922393    2563 generic.go:356] "Generic (PLEG): container finished" podID="9867a056-16ab-44a5-9053-ac69ef60bbae" containerID="7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6" exitCode=0
Sep 16 00:55:23.922458 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.922449    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"
Sep 16 00:55:23.922564 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.922470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf" event={"ID":"9867a056-16ab-44a5-9053-ac69ef60bbae","Type":"ContainerDied","Data":"7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6"}
Sep 16 00:55:23.922564 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.922511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf" event={"ID":"9867a056-16ab-44a5-9053-ac69ef60bbae","Type":"ContainerDied","Data":"39f1cd7f715725d3fef81f8789db489d90ebe0958e561caabb2e1193c51b7cad"}
Sep 16 00:55:23.930276 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.930267    2563 scope.go:117] "RemoveContainer" containerID="68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11"
Sep 16 00:55:23.930545 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:55:23.930527    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11\": container with ID starting with 68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11 not found: ID does not exist" containerID="68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11"
Sep 16 00:55:23.930618 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.930552    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11"} err="failed to get container status \"68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11\": rpc error: code = NotFound desc = could not find container \"68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11\": container with ID starting with 68f89a30ceec571b74641e47fdf7075c930db07d9b6d8bd36ba4571cb8f9cf11 not found: ID does not exist"
Sep 16 00:55:23.930618 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.930567    2563 scope.go:117] "RemoveContainer" containerID="7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6"
Sep 16 00:55:23.938817 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.938790    2563 scope.go:117] "RemoveContainer" containerID="7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6"
Sep 16 00:55:23.939070 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:55:23.939054    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6\": container with ID starting with 7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6 not found: ID does not exist" containerID="7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6"
Sep 16 00:55:23.939116 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.939080    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6"} err="failed to get container status \"7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6\": rpc error: code = NotFound desc = could not find container \"7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6\": container with ID starting with 7d8289fec0743d9d379c10d7a4ca8aa9a6c3e8bc4cfaf906079cd0300db950c6 not found: ID does not exist"
Sep 16 00:55:23.942099 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.942075    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"]
Sep 16 00:55:23.945473 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.945452    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-5270e2-868d58cf89-bxggb"]
Sep 16 00:55:23.954845 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.954822    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"]
Sep 16 00:55:23.958378 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:23.958360    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-5270e2-5bb4564c8-8zjqf"]
Sep 16 00:55:25.667543 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:25.667512    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c" path="/var/lib/kubelet/pods/6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c/volumes"
Sep 16 00:55:25.667984 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:25.667884    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9867a056-16ab-44a5-9053-ac69ef60bbae" path="/var/lib/kubelet/pods/9867a056-16ab-44a5-9053-ac69ef60bbae/volumes"
Sep 16 00:55:27.374165 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.374125    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs" podUID="6ef44fe1-1887-4ab6-aba6-f64a0aee05e1" containerName="main" containerID="cri-o://2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6" gracePeriod=45
Sep 16 00:55:27.390172 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.390071    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp" podUID="e5371810-ed56-47f0-a3ea-b1ee8d46a89f" containerName="main" containerID="cri-o://fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7" gracePeriod=45
Sep 16 00:55:27.396119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.396091    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55" podUID="8e1f6394-45dc-4f87-bc6a-df936c5f02cf" containerName="main" containerID="cri-o://2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646" gracePeriod=45
Sep 16 00:55:27.698642 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.698613    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:55:27.702216 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.702190    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:55:27.705872 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.705849    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:55:27.789440 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789407    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-model-cache\") pod \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") "
Sep 16 00:55:27.789634 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789455    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-tmp-dir\") pod \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") "
Sep 16 00:55:27.789634 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789487    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-model-cache\") pod \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") "
Sep 16 00:55:27.789634 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789541    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-tls-certs\") pod \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") "
Sep 16 00:55:27.789634 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789562    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-tls-certs\") pod \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") "
Sep 16 00:55:27.789634 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789589    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-home\") pod \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") "
Sep 16 00:55:27.789634 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789617    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmkcc\" (UniqueName: \"kubernetes.io/projected/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-kube-api-access-qmkcc\") pod \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") "
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789650    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hxs2\" (UniqueName: \"kubernetes.io/projected/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-kube-api-access-5hxs2\") pod \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") "
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789687    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ef44fe1-1887-4ab6-aba6-f64a0aee05e1" (UID: "6ef44fe1-1887-4ab6-aba6-f64a0aee05e1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789700    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-model-cache\") pod \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") "
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789749    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-dshm\") pod \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") "
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789787    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-dshm\") pod \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") "
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789803    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-tmp-dir\") pod \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") "
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789821    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmhw9\" (UniqueName: \"kubernetes.io/projected/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-kube-api-access-vmhw9\") pod \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") "
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789862    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-home\") pod \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\" (UID: \"e5371810-ed56-47f0-a3ea-b1ee8d46a89f\") "
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789888    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-tmp-dir\") pod \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") "
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789896    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "8e1f6394-45dc-4f87-bc6a-df936c5f02cf" (UID: "8e1f6394-45dc-4f87-bc6a-df936c5f02cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789912    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-tls-certs\") pod \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") "
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789942    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-home\") pod \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\" (UID: \"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1\") "
Sep 16 00:55:27.790018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.789962    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-dshm\") pod \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\" (UID: \"8e1f6394-45dc-4f87-bc6a-df936c5f02cf\") "
Sep 16 00:55:27.790756 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.790202    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e5371810-ed56-47f0-a3ea-b1ee8d46a89f" (UID: "e5371810-ed56-47f0-a3ea-b1ee8d46a89f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:55:27.790756 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.790221    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-home" (OuterVolumeSpecName: "home") pod "e5371810-ed56-47f0-a3ea-b1ee8d46a89f" (UID: "e5371810-ed56-47f0-a3ea-b1ee8d46a89f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:55:27.790756 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.790446    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-model-cache\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.790756 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.790465    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-tmp-dir\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.790756 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.790479    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-model-cache\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.790756 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.790494    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-home\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.791093 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.790756    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-home" (OuterVolumeSpecName: "home") pod "8e1f6394-45dc-4f87-bc6a-df936c5f02cf" (UID: "8e1f6394-45dc-4f87-bc6a-df936c5f02cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:55:27.791093 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.790766    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ef44fe1-1887-4ab6-aba6-f64a0aee05e1" (UID: "6ef44fe1-1887-4ab6-aba6-f64a0aee05e1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:55:27.791093 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.790787    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-model-cache" (OuterVolumeSpecName: "model-cache") pod "e5371810-ed56-47f0-a3ea-b1ee8d46a89f" (UID: "e5371810-ed56-47f0-a3ea-b1ee8d46a89f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:55:27.791093 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.791061    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-home" (OuterVolumeSpecName: "home") pod "6ef44fe1-1887-4ab6-aba6-f64a0aee05e1" (UID: "6ef44fe1-1887-4ab6-aba6-f64a0aee05e1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:55:27.791826 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.791312    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8e1f6394-45dc-4f87-bc6a-df936c5f02cf" (UID: "8e1f6394-45dc-4f87-bc6a-df936c5f02cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:55:27.793082 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.793053    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-dshm" (OuterVolumeSpecName: "dshm") pod "e5371810-ed56-47f0-a3ea-b1ee8d46a89f" (UID: "e5371810-ed56-47f0-a3ea-b1ee8d46a89f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:55:27.793244 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.793223    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-dshm" (OuterVolumeSpecName: "dshm") pod "8e1f6394-45dc-4f87-bc6a-df936c5f02cf" (UID: "8e1f6394-45dc-4f87-bc6a-df936c5f02cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:55:27.793304 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.793240    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-kube-api-access-vmhw9" (OuterVolumeSpecName: "kube-api-access-vmhw9") pod "e5371810-ed56-47f0-a3ea-b1ee8d46a89f" (UID: "e5371810-ed56-47f0-a3ea-b1ee8d46a89f"). InnerVolumeSpecName "kube-api-access-vmhw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:55:27.793396 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.793373    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-kube-api-access-qmkcc" (OuterVolumeSpecName: "kube-api-access-qmkcc") pod "6ef44fe1-1887-4ab6-aba6-f64a0aee05e1" (UID: "6ef44fe1-1887-4ab6-aba6-f64a0aee05e1"). InnerVolumeSpecName "kube-api-access-qmkcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:55:27.793703 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.793655    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ef44fe1-1887-4ab6-aba6-f64a0aee05e1" (UID: "6ef44fe1-1887-4ab6-aba6-f64a0aee05e1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:55:27.793859 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.793844    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-dshm" (OuterVolumeSpecName: "dshm") pod "6ef44fe1-1887-4ab6-aba6-f64a0aee05e1" (UID: "6ef44fe1-1887-4ab6-aba6-f64a0aee05e1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:55:27.794107 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.794094    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-kube-api-access-5hxs2" (OuterVolumeSpecName: "kube-api-access-5hxs2") pod "8e1f6394-45dc-4f87-bc6a-df936c5f02cf" (UID: "8e1f6394-45dc-4f87-bc6a-df936c5f02cf"). InnerVolumeSpecName "kube-api-access-5hxs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:55:27.794155 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.794142    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8e1f6394-45dc-4f87-bc6a-df936c5f02cf" (UID: "8e1f6394-45dc-4f87-bc6a-df936c5f02cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:55:27.795114 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.795100    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e5371810-ed56-47f0-a3ea-b1ee8d46a89f" (UID: "e5371810-ed56-47f0-a3ea-b1ee8d46a89f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:55:27.891453 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891411    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-model-cache\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891453 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891445    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-tls-certs\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891453 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891457    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-tls-certs\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891731 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891467    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-home\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891731 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891478    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmkcc\" (UniqueName: \"kubernetes.io/projected/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-kube-api-access-qmkcc\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891731 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891491    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hxs2\" (UniqueName: \"kubernetes.io/projected/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-kube-api-access-5hxs2\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891731 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891502    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-dshm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891731 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891514    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-dshm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891731 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891524    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-tmp-dir\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891731 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891535    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmhw9\" (UniqueName: \"kubernetes.io/projected/e5371810-ed56-47f0-a3ea-b1ee8d46a89f-kube-api-access-vmhw9\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891731 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891546    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-tmp-dir\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891731 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891557    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-tls-certs\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891731 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891567    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1-home\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.891731 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.891576    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e1f6394-45dc-4f87-bc6a-df936c5f02cf-dshm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:55:27.945852 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.945818    2563 generic.go:356] "Generic (PLEG): container finished" podID="6ef44fe1-1887-4ab6-aba6-f64a0aee05e1" containerID="2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6" exitCode=0
Sep 16 00:55:27.946030 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.945870    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"
Sep 16 00:55:27.946030 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.945916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs" event={"ID":"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1","Type":"ContainerDied","Data":"2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6"}
Sep 16 00:55:27.946030 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.945965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs" event={"ID":"6ef44fe1-1887-4ab6-aba6-f64a0aee05e1","Type":"ContainerDied","Data":"a5a0a19f154cc9a62d36f84a0215f1db103e0f3db7e3c58d722672b559874926"}
Sep 16 00:55:27.946030 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.945985    2563 scope.go:117] "RemoveContainer" containerID="2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6"
Sep 16 00:55:27.947517 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.947494    2563 generic.go:356] "Generic (PLEG): container finished" podID="8e1f6394-45dc-4f87-bc6a-df936c5f02cf" containerID="2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646" exitCode=0
Sep 16 00:55:27.947634 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.947530    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"
Sep 16 00:55:27.947634 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.947578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55" event={"ID":"8e1f6394-45dc-4f87-bc6a-df936c5f02cf","Type":"ContainerDied","Data":"2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646"}
Sep 16 00:55:27.947634 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.947620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55" event={"ID":"8e1f6394-45dc-4f87-bc6a-df936c5f02cf","Type":"ContainerDied","Data":"2c9481c0e5a48406d0d63c3729beb70da4a784da0f5546e602819c2486b9ab55"}
Sep 16 00:55:27.949619 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.949590    2563 generic.go:356] "Generic (PLEG): container finished" podID="e5371810-ed56-47f0-a3ea-b1ee8d46a89f" containerID="fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7" exitCode=0
Sep 16 00:55:27.949759 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.949628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp" event={"ID":"e5371810-ed56-47f0-a3ea-b1ee8d46a89f","Type":"ContainerDied","Data":"fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7"}
Sep 16 00:55:27.949759 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.949627    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"
Sep 16 00:55:27.949759 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.949656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp" event={"ID":"e5371810-ed56-47f0-a3ea-b1ee8d46a89f","Type":"ContainerDied","Data":"da26e38128743e9544803468dad121b0316facc72df2c294a90d5f105d9768cb"}
Sep 16 00:55:27.956477 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.956459    2563 scope.go:117] "RemoveContainer" containerID="2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6"
Sep 16 00:55:27.956886 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:55:27.956864    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6\": container with ID starting with 2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6 not found: ID does not exist" containerID="2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6"
Sep 16 00:55:27.956994 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.956895    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6"} err="failed to get container status \"2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6\": rpc error: code = NotFound desc = could not find container \"2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6\": container with ID starting with 2807c67cab4f881b2a072fad8de5f2ca669485f2e1481b814e7b4d85485265d6 not found: ID does not exist"
Sep 16 00:55:27.956994 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.956913    2563 scope.go:117] "RemoveContainer" containerID="2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646"
Sep 16 00:55:27.965650 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.965633    2563 scope.go:117] "RemoveContainer" containerID="2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646"
Sep 16 00:55:27.965976 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:55:27.965958    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646\": container with ID starting with 2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646 not found: ID does not exist" containerID="2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646"
Sep 16 00:55:27.966023 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.965984    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646"} err="failed to get container status \"2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646\": rpc error: code = NotFound desc = could not find container \"2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646\": container with ID starting with 2b72ca94b27242bbea2074ab035931631e97313302cdc4fa7707bfc1bebe0646 not found: ID does not exist"
Sep 16 00:55:27.966023 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.966003    2563 scope.go:117] "RemoveContainer" containerID="fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7"
Sep 16 00:55:27.969653 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.969631    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"]
Sep 16 00:55:27.973508 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.973486    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/embedding-w0-5270e2-kserve-7898cb67c7-h7pqs"]
Sep 16 00:55:27.975070 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.975052    2563 scope.go:117] "RemoveContainer" containerID="fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7"
Sep 16 00:55:27.975382 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:55:27.975364    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7\": container with ID starting with fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7 not found: ID does not exist" containerID="fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7"
Sep 16 00:55:27.975428 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.975390    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7"} err="failed to get container status \"fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7\": rpc error: code = NotFound desc = could not find container \"fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7\": container with ID starting with fd7c70a9a1623e172f547371ee9c36d5b371b3eb211a516c5d45fd9ebe6e94d7 not found: ID does not exist"
Sep 16 00:55:27.984956 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.984920    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"]
Sep 16 00:55:27.997587 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.997545    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/simulator-w0-5270e2-kserve-75d7b657dd-nbc55"]
Sep 16 00:55:27.999190 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:27.999170    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"]
Sep 16 00:55:28.002001 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:28.001976    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-5270e2/premium-w0-5270e2-kserve-644f98f7bf-khlkp"]
Sep 16 00:55:29.667433 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:29.667396    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ef44fe1-1887-4ab6-aba6-f64a0aee05e1" path="/var/lib/kubelet/pods/6ef44fe1-1887-4ab6-aba6-f64a0aee05e1/volumes"
Sep 16 00:55:29.668015 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:29.667993    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e1f6394-45dc-4f87-bc6a-df936c5f02cf" path="/var/lib/kubelet/pods/8e1f6394-45dc-4f87-bc6a-df936c5f02cf/volumes"
Sep 16 00:55:29.668515 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:29.668489    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5371810-ed56-47f0-a3ea-b1ee8d46a89f" path="/var/lib/kubelet/pods/e5371810-ed56-47f0-a3ea-b1ee8d46a89f/volumes"
Sep 16 00:55:57.193958 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.193921    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"]
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194297    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ef44fe1-1887-4ab6-aba6-f64a0aee05e1" containerName="main"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194309    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ef44fe1-1887-4ab6-aba6-f64a0aee05e1" containerName="main"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194321    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5371810-ed56-47f0-a3ea-b1ee8d46a89f" containerName="main"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194327    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5371810-ed56-47f0-a3ea-b1ee8d46a89f" containerName="main"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194335    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9867a056-16ab-44a5-9053-ac69ef60bbae" containerName="payload-pre-processing"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194341    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9867a056-16ab-44a5-9053-ac69ef60bbae" containerName="payload-pre-processing"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194352    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e1f6394-45dc-4f87-bc6a-df936c5f02cf" containerName="main"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194357    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e1f6394-45dc-4f87-bc6a-df936c5f02cf" containerName="main"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194364    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c" containerName="payload-processing"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194370    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c" containerName="payload-processing"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194375    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1653caa-fd64-4e27-9e96-4b3f189b4c9d" containerName="payload-pre-processing"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194380    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1653caa-fd64-4e27-9e96-4b3f189b4c9d" containerName="payload-pre-processing"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194433    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ef44fe1-1887-4ab6-aba6-f64a0aee05e1" containerName="main"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194441    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c02ceb1-1a70-4921-82c1-7ddb1b3dbc1c" containerName="payload-processing"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194447    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e1f6394-45dc-4f87-bc6a-df936c5f02cf" containerName="main"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194454    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1653caa-fd64-4e27-9e96-4b3f189b4c9d" containerName="payload-pre-processing"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194460    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5371810-ed56-47f0-a3ea-b1ee8d46a89f" containerName="main"
Sep 16 00:55:57.194483 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.194469    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9867a056-16ab-44a5-9053-ac69ef60bbae" containerName="payload-pre-processing"
Sep 16 00:55:57.197523 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.197505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"
Sep 16 00:55:57.200635 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.200616    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-228a5f03-dockercfg-p8xcz\""
Sep 16 00:55:57.200635 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.200626    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-228a5f03\""
Sep 16 00:55:57.210362 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.210339    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"]
Sep 16 00:55:57.222817 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.222787    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"]
Sep 16 00:55:57.226448 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.226426    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"
Sep 16 00:55:57.235577 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.235553    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"]
Sep 16 00:55:57.276593 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.276553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694\" (UID: \"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"
Sep 16 00:55:57.276593 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.276595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svh4b\" (UniqueName: \"kubernetes.io/projected/a98d4daf-c7ba-416c-bd32-146a57c41fee-kube-api-access-svh4b\") pod \"payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh\" (UID: \"a98d4daf-c7ba-416c-bd32-146a57c41fee\") " pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"
Sep 16 00:55:57.276835 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.276622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98d4daf-c7ba-416c-bd32-146a57c41fee-plugins-config-volume\") pod \"payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh\" (UID: \"a98d4daf-c7ba-416c-bd32-146a57c41fee\") " pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"
Sep 16 00:55:57.276835 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.276735    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drlrl\" (UniqueName: \"kubernetes.io/projected/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb-kube-api-access-drlrl\") pod \"payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694\" (UID: \"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"
Sep 16 00:55:57.377764 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.377723    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98d4daf-c7ba-416c-bd32-146a57c41fee-plugins-config-volume\") pod \"payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh\" (UID: \"a98d4daf-c7ba-416c-bd32-146a57c41fee\") " pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"
Sep 16 00:55:57.377977 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.377811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drlrl\" (UniqueName: \"kubernetes.io/projected/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb-kube-api-access-drlrl\") pod \"payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694\" (UID: \"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"
Sep 16 00:55:57.377977 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.377865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694\" (UID: \"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"
Sep 16 00:55:57.377977 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.377890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svh4b\" (UniqueName: \"kubernetes.io/projected/a98d4daf-c7ba-416c-bd32-146a57c41fee-kube-api-access-svh4b\") pod \"payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh\" (UID: \"a98d4daf-c7ba-416c-bd32-146a57c41fee\") " pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"
Sep 16 00:55:57.378715 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.378652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694\" (UID: \"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"
Sep 16 00:55:57.378786 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.378652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98d4daf-c7ba-416c-bd32-146a57c41fee-plugins-config-volume\") pod \"payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh\" (UID: \"a98d4daf-c7ba-416c-bd32-146a57c41fee\") " pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"
Sep 16 00:55:57.385280 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.385256    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svh4b\" (UniqueName: \"kubernetes.io/projected/a98d4daf-c7ba-416c-bd32-146a57c41fee-kube-api-access-svh4b\") pod \"payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh\" (UID: \"a98d4daf-c7ba-416c-bd32-146a57c41fee\") " pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"
Sep 16 00:55:57.385417 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.385358    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drlrl\" (UniqueName: \"kubernetes.io/projected/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb-kube-api-access-drlrl\") pod \"payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694\" (UID: \"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"
Sep 16 00:55:57.507469 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.507380    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"
Sep 16 00:55:57.537800 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.537764    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"
Sep 16 00:55:57.784281 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.784198    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"]
Sep 16 00:55:57.788526 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:55:57.788499    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82c1558_4a1e_48da_8dd9_3f1afc9b21bb.slice/crio-982220d8ac6ac096cacf9d6e06a858bacd6e7ff9ef8f3776f922ee7699a36dba WatchSource:0}: Error finding container 982220d8ac6ac096cacf9d6e06a858bacd6e7ff9ef8f3776f922ee7699a36dba: Status 404 returned error can't find the container with id 982220d8ac6ac096cacf9d6e06a858bacd6e7ff9ef8f3776f922ee7699a36dba
Sep 16 00:55:57.818773 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:57.818749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"]
Sep 16 00:55:57.824816 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:55:57.824789    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98d4daf_c7ba_416c_bd32_146a57c41fee.slice/crio-74d440ce652897a2b897ebaef1f79e57635d183a52d62377d4c865cb27544f9d WatchSource:0}: Error finding container 74d440ce652897a2b897ebaef1f79e57635d183a52d62377d4c865cb27544f9d: Status 404 returned error can't find the container with id 74d440ce652897a2b897ebaef1f79e57635d183a52d62377d4c865cb27544f9d
Sep 16 00:55:58.112897 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:58.112803    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh" event={"ID":"a98d4daf-c7ba-416c-bd32-146a57c41fee","Type":"ContainerStarted","Data":"90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665"}
Sep 16 00:55:58.112897 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:58.112860    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh" event={"ID":"a98d4daf-c7ba-416c-bd32-146a57c41fee","Type":"ContainerStarted","Data":"74d440ce652897a2b897ebaef1f79e57635d183a52d62377d4c865cb27544f9d"}
Sep 16 00:55:58.113142 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:58.112919    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"
Sep 16 00:55:58.115045 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:58.115000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694" event={"ID":"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb","Type":"ContainerStarted","Data":"30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b"}
Sep 16 00:55:58.115179 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:58.115061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694" event={"ID":"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb","Type":"ContainerStarted","Data":"982220d8ac6ac096cacf9d6e06a858bacd6e7ff9ef8f3776f922ee7699a36dba"}
Sep 16 00:55:58.115179 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:58.115106    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"
Sep 16 00:55:58.128177 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:58.128131    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh" podStartSLOduration=1.128116546 podStartE2EDuration="1.128116546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:55:58.126404952 +0000 UTC m=+1308.929228016" watchObservedRunningTime="2026-09-16 00:55:58.128116546 +0000 UTC m=+1308.930939609"
Sep 16 00:55:58.141726 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:55:58.141659    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694" podStartSLOduration=1.141641294 podStartE2EDuration="1.141641294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:55:58.140409105 +0000 UTC m=+1308.943232169" watchObservedRunningTime="2026-09-16 00:55:58.141641294 +0000 UTC m=+1308.944464381"
Sep 16 00:56:09.123442 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:09.123405    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"
Sep 16 00:56:09.123854 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:09.123480    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"
Sep 16 00:56:37.830772 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:37.830659    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"]
Sep 16 00:56:37.831326 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:37.830969    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh" podUID="a98d4daf-c7ba-416c-bd32-146a57c41fee" containerName="payload-processing" containerID="cri-o://90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665" gracePeriod=30
Sep 16 00:56:37.839063 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:37.838843    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"]
Sep 16 00:56:37.839228 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:37.839180    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694" podUID="c82c1558-4a1e-48da-8dd9-3f1afc9b21bb" containerName="payload-pre-processing" containerID="cri-o://30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b" gracePeriod=30
Sep 16 00:56:38.109918 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.109893    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"
Sep 16 00:56:38.112814 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.112796    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"
Sep 16 00:56:38.165429 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.165397    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb-plugins-config-volume\") pod \"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb\" (UID: \"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb\") "
Sep 16 00:56:38.165429 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.165432    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drlrl\" (UniqueName: \"kubernetes.io/projected/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb-kube-api-access-drlrl\") pod \"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb\" (UID: \"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb\") "
Sep 16 00:56:38.165718 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.165492    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98d4daf-c7ba-416c-bd32-146a57c41fee-plugins-config-volume\") pod \"a98d4daf-c7ba-416c-bd32-146a57c41fee\" (UID: \"a98d4daf-c7ba-416c-bd32-146a57c41fee\") "
Sep 16 00:56:38.165718 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.165581    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svh4b\" (UniqueName: \"kubernetes.io/projected/a98d4daf-c7ba-416c-bd32-146a57c41fee-kube-api-access-svh4b\") pod \"a98d4daf-c7ba-416c-bd32-146a57c41fee\" (UID: \"a98d4daf-c7ba-416c-bd32-146a57c41fee\") "
Sep 16 00:56:38.165927 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.165897    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c82c1558-4a1e-48da-8dd9-3f1afc9b21bb" (UID: "c82c1558-4a1e-48da-8dd9-3f1afc9b21bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:56:38.165997 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.165938    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a98d4daf-c7ba-416c-bd32-146a57c41fee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a98d4daf-c7ba-416c-bd32-146a57c41fee" (UID: "a98d4daf-c7ba-416c-bd32-146a57c41fee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 00:56:38.167933 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.167904    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a98d4daf-c7ba-416c-bd32-146a57c41fee-kube-api-access-svh4b" (OuterVolumeSpecName: "kube-api-access-svh4b") pod "a98d4daf-c7ba-416c-bd32-146a57c41fee" (UID: "a98d4daf-c7ba-416c-bd32-146a57c41fee"). InnerVolumeSpecName "kube-api-access-svh4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:56:38.168029 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.167933    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb-kube-api-access-drlrl" (OuterVolumeSpecName: "kube-api-access-drlrl") pod "c82c1558-4a1e-48da-8dd9-3f1afc9b21bb" (UID: "c82c1558-4a1e-48da-8dd9-3f1afc9b21bb"). InnerVolumeSpecName "kube-api-access-drlrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:56:38.266707 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.266644    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svh4b\" (UniqueName: \"kubernetes.io/projected/a98d4daf-c7ba-416c-bd32-146a57c41fee-kube-api-access-svh4b\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:56:38.266707 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.266701    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:56:38.266707 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.266710    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drlrl\" (UniqueName: \"kubernetes.io/projected/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb-kube-api-access-drlrl\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:56:38.266938 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.266719    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98d4daf-c7ba-416c-bd32-146a57c41fee-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:56:38.319942 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.319909    2563 generic.go:356] "Generic (PLEG): container finished" podID="a98d4daf-c7ba-416c-bd32-146a57c41fee" containerID="90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665" exitCode=0
Sep 16 00:56:38.320124 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.319963    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"
Sep 16 00:56:38.320124 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.319985    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh" event={"ID":"a98d4daf-c7ba-416c-bd32-146a57c41fee","Type":"ContainerDied","Data":"90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665"}
Sep 16 00:56:38.320124 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.320069    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh" event={"ID":"a98d4daf-c7ba-416c-bd32-146a57c41fee","Type":"ContainerDied","Data":"74d440ce652897a2b897ebaef1f79e57635d183a52d62377d4c865cb27544f9d"}
Sep 16 00:56:38.320262 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.320127    2563 scope.go:117] "RemoveContainer" containerID="90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665"
Sep 16 00:56:38.321417 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.321390    2563 generic.go:356] "Generic (PLEG): container finished" podID="c82c1558-4a1e-48da-8dd9-3f1afc9b21bb" containerID="30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b" exitCode=0
Sep 16 00:56:38.321503 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.321486    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"
Sep 16 00:56:38.321567 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.321539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694" event={"ID":"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb","Type":"ContainerDied","Data":"30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b"}
Sep 16 00:56:38.321638 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.321587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694" event={"ID":"c82c1558-4a1e-48da-8dd9-3f1afc9b21bb","Type":"ContainerDied","Data":"982220d8ac6ac096cacf9d6e06a858bacd6e7ff9ef8f3776f922ee7699a36dba"}
Sep 16 00:56:38.332375 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.332258    2563 scope.go:117] "RemoveContainer" containerID="90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665"
Sep 16 00:56:38.332599 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:56:38.332577    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665\": container with ID starting with 90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665 not found: ID does not exist" containerID="90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665"
Sep 16 00:56:38.332850 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.332610    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665"} err="failed to get container status \"90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665\": rpc error: code = NotFound desc = could not find container \"90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665\": container with ID starting with 90fb5453405a85b711f52e5b7f090ad952699e6283fbfbda931136e869029665 not found: ID does not exist"
Sep 16 00:56:38.332850 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.332634    2563 scope.go:117] "RemoveContainer" containerID="30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b"
Sep 16 00:56:38.340930 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.340886    2563 scope.go:117] "RemoveContainer" containerID="30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b"
Sep 16 00:56:38.341201 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:56:38.341182    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b\": container with ID starting with 30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b not found: ID does not exist" containerID="30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b"
Sep 16 00:56:38.341271 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.341207    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b"} err="failed to get container status \"30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b\": rpc error: code = NotFound desc = could not find container \"30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b\": container with ID starting with 30e7d45f256ba2c3dac03343d0f78c9deec12576595f58dfd8f7f5f1613cbe5b not found: ID does not exist"
Sep 16 00:56:38.344946 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.344923    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"]
Sep 16 00:56:38.350915 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.350890    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-228a5f03-d5c4859df-zf8sh"]
Sep 16 00:56:38.359853 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.359829    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"]
Sep 16 00:56:38.364424 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:38.364402    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-228a5f03-74d66b9d66-dl694"]
Sep 16 00:56:39.668001 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:39.667966    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a98d4daf-c7ba-416c-bd32-146a57c41fee" path="/var/lib/kubelet/pods/a98d4daf-c7ba-416c-bd32-146a57c41fee/volumes"
Sep 16 00:56:39.668374 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:39.668348    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c82c1558-4a1e-48da-8dd9-3f1afc9b21bb" path="/var/lib/kubelet/pods/c82c1558-4a1e-48da-8dd9-3f1afc9b21bb/volumes"
Sep 16 00:56:53.028856 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:56:53.028811    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"]
Sep 16 00:57:04.188508 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.188455    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"]
Sep 16 00:57:04.188982 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.188882    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c82c1558-4a1e-48da-8dd9-3f1afc9b21bb" containerName="payload-pre-processing"
Sep 16 00:57:04.188982 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.188895    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c82c1558-4a1e-48da-8dd9-3f1afc9b21bb" containerName="payload-pre-processing"
Sep 16 00:57:04.188982 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.188905    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a98d4daf-c7ba-416c-bd32-146a57c41fee" containerName="payload-processing"
Sep 16 00:57:04.188982 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.188914    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a98d4daf-c7ba-416c-bd32-146a57c41fee" containerName="payload-processing"
Sep 16 00:57:04.189146 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.189005    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c82c1558-4a1e-48da-8dd9-3f1afc9b21bb" containerName="payload-pre-processing"
Sep 16 00:57:04.189146 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.189015    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a98d4daf-c7ba-416c-bd32-146a57c41fee" containerName="payload-processing"
Sep 16 00:57:04.193946 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.193926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"
Sep 16 00:57:04.196139 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.196121    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w1-3462ea-dockercfg-qtwvb\""
Sep 16 00:57:04.196238 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.196127    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w1-3462ea\""
Sep 16 00:57:04.201052 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.201030    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"]
Sep 16 00:57:04.216747 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.216722    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"]
Sep 16 00:57:04.220202 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.220184    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"
Sep 16 00:57:04.231049 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.231023    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"]
Sep 16 00:57:04.327929 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.327870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlcnm\" (UniqueName: \"kubernetes.io/projected/7183cf02-c2cc-4a37-ae83-eca96d4896d1-kube-api-access-vlcnm\") pod \"payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq\" (UID: \"7183cf02-c2cc-4a37-ae83-eca96d4896d1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"
Sep 16 00:57:04.328124 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.328007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a742757-ad2d-45e8-856b-0c86cfb962e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp\" (UID: \"9a742757-ad2d-45e8-856b-0c86cfb962e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"
Sep 16 00:57:04.328124 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.328091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7183cf02-c2cc-4a37-ae83-eca96d4896d1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq\" (UID: \"7183cf02-c2cc-4a37-ae83-eca96d4896d1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"
Sep 16 00:57:04.328205 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.328143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8gkm\" (UniqueName: \"kubernetes.io/projected/9a742757-ad2d-45e8-856b-0c86cfb962e0-kube-api-access-c8gkm\") pod \"payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp\" (UID: \"9a742757-ad2d-45e8-856b-0c86cfb962e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"
Sep 16 00:57:04.429092 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.429053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlcnm\" (UniqueName: \"kubernetes.io/projected/7183cf02-c2cc-4a37-ae83-eca96d4896d1-kube-api-access-vlcnm\") pod \"payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq\" (UID: \"7183cf02-c2cc-4a37-ae83-eca96d4896d1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"
Sep 16 00:57:04.429282 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.429142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a742757-ad2d-45e8-856b-0c86cfb962e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp\" (UID: \"9a742757-ad2d-45e8-856b-0c86cfb962e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"
Sep 16 00:57:04.429282 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.429178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7183cf02-c2cc-4a37-ae83-eca96d4896d1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq\" (UID: \"7183cf02-c2cc-4a37-ae83-eca96d4896d1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"
Sep 16 00:57:04.429282 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.429212    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8gkm\" (UniqueName: \"kubernetes.io/projected/9a742757-ad2d-45e8-856b-0c86cfb962e0-kube-api-access-c8gkm\") pod \"payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp\" (UID: \"9a742757-ad2d-45e8-856b-0c86cfb962e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"
Sep 16 00:57:04.430128 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.430104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7183cf02-c2cc-4a37-ae83-eca96d4896d1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq\" (UID: \"7183cf02-c2cc-4a37-ae83-eca96d4896d1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"
Sep 16 00:57:04.430175 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.430104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a742757-ad2d-45e8-856b-0c86cfb962e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp\" (UID: \"9a742757-ad2d-45e8-856b-0c86cfb962e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"
Sep 16 00:57:04.436645 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.436620    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8gkm\" (UniqueName: \"kubernetes.io/projected/9a742757-ad2d-45e8-856b-0c86cfb962e0-kube-api-access-c8gkm\") pod \"payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp\" (UID: \"9a742757-ad2d-45e8-856b-0c86cfb962e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"
Sep 16 00:57:04.436739 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.436694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlcnm\" (UniqueName: \"kubernetes.io/projected/7183cf02-c2cc-4a37-ae83-eca96d4896d1-kube-api-access-vlcnm\") pod \"payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq\" (UID: \"7183cf02-c2cc-4a37-ae83-eca96d4896d1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"
Sep 16 00:57:04.506889 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.506846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"
Sep 16 00:57:04.533542 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.533512    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"
Sep 16 00:57:04.785161 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.785124    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"]
Sep 16 00:57:04.786841 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:57:04.786814    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a742757_ad2d_45e8_856b_0c86cfb962e0.slice/crio-b9ea682293c6e871c462bfeabf063935ab1df4ed07886e39ec558418ce7a4e19 WatchSource:0}: Error finding container b9ea682293c6e871c462bfeabf063935ab1df4ed07886e39ec558418ce7a4e19: Status 404 returned error can't find the container with id b9ea682293c6e871c462bfeabf063935ab1df4ed07886e39ec558418ce7a4e19
Sep 16 00:57:04.825580 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:04.825551    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"]
Sep 16 00:57:04.827602 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:57:04.827569    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7183cf02_c2cc_4a37_ae83_eca96d4896d1.slice/crio-824c300dc30d7261bb5e83a8eb65b039b58567bb64d5eea9bda69989dbebd15b WatchSource:0}: Error finding container 824c300dc30d7261bb5e83a8eb65b039b58567bb64d5eea9bda69989dbebd15b: Status 404 returned error can't find the container with id 824c300dc30d7261bb5e83a8eb65b039b58567bb64d5eea9bda69989dbebd15b
Sep 16 00:57:05.462294 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:05.462252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq" event={"ID":"7183cf02-c2cc-4a37-ae83-eca96d4896d1","Type":"ContainerStarted","Data":"14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a"}
Sep 16 00:57:05.462784 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:05.462317    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq" event={"ID":"7183cf02-c2cc-4a37-ae83-eca96d4896d1","Type":"ContainerStarted","Data":"824c300dc30d7261bb5e83a8eb65b039b58567bb64d5eea9bda69989dbebd15b"}
Sep 16 00:57:05.462784 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:05.462363    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"
Sep 16 00:57:05.463983 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:05.463958    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp" event={"ID":"9a742757-ad2d-45e8-856b-0c86cfb962e0","Type":"ContainerStarted","Data":"b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc"}
Sep 16 00:57:05.464104 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:05.464009    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp" event={"ID":"9a742757-ad2d-45e8-856b-0c86cfb962e0","Type":"ContainerStarted","Data":"b9ea682293c6e871c462bfeabf063935ab1df4ed07886e39ec558418ce7a4e19"}
Sep 16 00:57:05.464104 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:05.464039    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"
Sep 16 00:57:05.476358 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:05.476299    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq" podStartSLOduration=1.476280352 podStartE2EDuration="1.476280352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:57:05.475571775 +0000 UTC m=+1376.278394837" watchObservedRunningTime="2026-09-16 00:57:05.476280352 +0000 UTC m=+1376.279103418"
Sep 16 00:57:05.489360 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:05.489306    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp" podStartSLOduration=1.489285873 podStartE2EDuration="1.489285873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:57:05.488284097 +0000 UTC m=+1376.291107162" watchObservedRunningTime="2026-09-16 00:57:05.489285873 +0000 UTC m=+1376.292108938"
Sep 16 00:57:08.049425 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.049385    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw" podUID="1cc70827-a427-4153-b542-3c17efbd7ce1" containerName="main" containerID="cri-o://9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453" gracePeriod=45
Sep 16 00:57:08.294212 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.294183    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:57:08.368778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.368698    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-home\") pod \"1cc70827-a427-4153-b542-3c17efbd7ce1\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") "
Sep 16 00:57:08.368778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.368737    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-model-cache\") pod \"1cc70827-a427-4153-b542-3c17efbd7ce1\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") "
Sep 16 00:57:08.368778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.368772    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cc70827-a427-4153-b542-3c17efbd7ce1-tls-certs\") pod \"1cc70827-a427-4153-b542-3c17efbd7ce1\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") "
Sep 16 00:57:08.369029 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.368813    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fktfl\" (UniqueName: \"kubernetes.io/projected/1cc70827-a427-4153-b542-3c17efbd7ce1-kube-api-access-fktfl\") pod \"1cc70827-a427-4153-b542-3c17efbd7ce1\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") "
Sep 16 00:57:08.369029 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.368861    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-tmp-dir\") pod \"1cc70827-a427-4153-b542-3c17efbd7ce1\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") "
Sep 16 00:57:08.369029 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.368934    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-dshm\") pod \"1cc70827-a427-4153-b542-3c17efbd7ce1\" (UID: \"1cc70827-a427-4153-b542-3c17efbd7ce1\") "
Sep 16 00:57:08.369029 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.369009    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-model-cache" (OuterVolumeSpecName: "model-cache") pod "1cc70827-a427-4153-b542-3c17efbd7ce1" (UID: "1cc70827-a427-4153-b542-3c17efbd7ce1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:57:08.369207 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.369015    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-home" (OuterVolumeSpecName: "home") pod "1cc70827-a427-4153-b542-3c17efbd7ce1" (UID: "1cc70827-a427-4153-b542-3c17efbd7ce1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:57:08.369256 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.369200    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1cc70827-a427-4153-b542-3c17efbd7ce1" (UID: "1cc70827-a427-4153-b542-3c17efbd7ce1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:57:08.369330 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.369296    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-tmp-dir\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:57:08.369330 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.369310    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-home\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:57:08.369330 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.369319    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-model-cache\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:57:08.371287 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.371257    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-dshm" (OuterVolumeSpecName: "dshm") pod "1cc70827-a427-4153-b542-3c17efbd7ce1" (UID: "1cc70827-a427-4153-b542-3c17efbd7ce1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:57:08.371287 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.371266    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc70827-a427-4153-b542-3c17efbd7ce1-kube-api-access-fktfl" (OuterVolumeSpecName: "kube-api-access-fktfl") pod "1cc70827-a427-4153-b542-3c17efbd7ce1" (UID: "1cc70827-a427-4153-b542-3c17efbd7ce1"). InnerVolumeSpecName "kube-api-access-fktfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:57:08.371438 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.371256    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cc70827-a427-4153-b542-3c17efbd7ce1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1cc70827-a427-4153-b542-3c17efbd7ce1" (UID: "1cc70827-a427-4153-b542-3c17efbd7ce1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:57:08.470330 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.470290    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cc70827-a427-4153-b542-3c17efbd7ce1-tls-certs\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:57:08.470330 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.470325    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fktfl\" (UniqueName: \"kubernetes.io/projected/1cc70827-a427-4153-b542-3c17efbd7ce1-kube-api-access-fktfl\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:57:08.470330 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.470334    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cc70827-a427-4153-b542-3c17efbd7ce1-dshm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:57:08.480076 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.480035    2563 generic.go:356] "Generic (PLEG): container finished" podID="1cc70827-a427-4153-b542-3c17efbd7ce1" containerID="9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453" exitCode=0
Sep 16 00:57:08.480232 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.480096    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"
Sep 16 00:57:08.480232 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.480101    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw" event={"ID":"1cc70827-a427-4153-b542-3c17efbd7ce1","Type":"ContainerDied","Data":"9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453"}
Sep 16 00:57:08.480232 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.480212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw" event={"ID":"1cc70827-a427-4153-b542-3c17efbd7ce1","Type":"ContainerDied","Data":"154962ab49f239789c5dfe754bb49dfd2c456898a1985fcaba4679e96a0d6cc1"}
Sep 16 00:57:08.480370 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.480235    2563 scope.go:117] "RemoveContainer" containerID="9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453"
Sep 16 00:57:08.493633 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.493610    2563 scope.go:117] "RemoveContainer" containerID="9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453"
Sep 16 00:57:08.494013 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:57:08.493982    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453\": container with ID starting with 9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453 not found: ID does not exist" containerID="9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453"
Sep 16 00:57:08.494105 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.494026    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453"} err="failed to get container status \"9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453\": rpc error: code = NotFound desc = could not find container \"9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453\": container with ID starting with 9a92119922a4c80d745f39872dd8efbff2ccc3f78d00b9b5720afe206919e453 not found: ID does not exist"
Sep 16 00:57:08.507245 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.507203    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"]
Sep 16 00:57:08.509258 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:08.509230    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w2-108960/auth-test-model-108960-kserve-5795494f99-lh5jw"]
Sep 16 00:57:09.668132 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:09.668101    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cc70827-a427-4153-b542-3c17efbd7ce1" path="/var/lib/kubelet/pods/1cc70827-a427-4153-b542-3c17efbd7ce1/volumes"
Sep 16 00:57:16.470929 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:16.470901    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"
Sep 16 00:57:16.471365 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:16.471141    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"
Sep 16 00:57:33.374104 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.374066    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"]
Sep 16 00:57:33.374573 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.374549    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc70827-a427-4153-b542-3c17efbd7ce1" containerName="main"
Sep 16 00:57:33.374573 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.374569    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc70827-a427-4153-b542-3c17efbd7ce1" containerName="main"
Sep 16 00:57:33.374685 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.374629    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc70827-a427-4153-b542-3c17efbd7ce1" containerName="main"
Sep 16 00:57:33.377290 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.377272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"
Sep 16 00:57:33.379370 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.379344    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w1-409cde\""
Sep 16 00:57:33.379498 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.379378    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w1-409cde-dockercfg-f4lkk\""
Sep 16 00:57:33.386348 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.386320    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"]
Sep 16 00:57:33.404226 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.404199    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"]
Sep 16 00:57:33.407659 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.407639    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"
Sep 16 00:57:33.417198 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.417174    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"]
Sep 16 00:57:33.510869 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.510831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc9h8\" (UniqueName: \"kubernetes.io/projected/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc-kube-api-access-kc9h8\") pod \"payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg\" (UID: \"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"
Sep 16 00:57:33.510869 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.510875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xntzw\" (UniqueName: \"kubernetes.io/projected/fd0cbb3a-1244-42df-9668-7a9abb90a36b-kube-api-access-xntzw\") pod \"payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47\" (UID: \"fd0cbb3a-1244-42df-9668-7a9abb90a36b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"
Sep 16 00:57:33.511106 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.510902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd0cbb3a-1244-42df-9668-7a9abb90a36b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47\" (UID: \"fd0cbb3a-1244-42df-9668-7a9abb90a36b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"
Sep 16 00:57:33.511106 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.511043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg\" (UID: \"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"
Sep 16 00:57:33.612231 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.612195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc9h8\" (UniqueName: \"kubernetes.io/projected/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc-kube-api-access-kc9h8\") pod \"payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg\" (UID: \"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"
Sep 16 00:57:33.612414 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.612238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xntzw\" (UniqueName: \"kubernetes.io/projected/fd0cbb3a-1244-42df-9668-7a9abb90a36b-kube-api-access-xntzw\") pod \"payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47\" (UID: \"fd0cbb3a-1244-42df-9668-7a9abb90a36b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"
Sep 16 00:57:33.612414 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.612269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd0cbb3a-1244-42df-9668-7a9abb90a36b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47\" (UID: \"fd0cbb3a-1244-42df-9668-7a9abb90a36b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"
Sep 16 00:57:33.612414 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.612362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg\" (UID: \"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"
Sep 16 00:57:33.613088 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.613068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd0cbb3a-1244-42df-9668-7a9abb90a36b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47\" (UID: \"fd0cbb3a-1244-42df-9668-7a9abb90a36b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"
Sep 16 00:57:33.613088 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.613081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg\" (UID: \"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"
Sep 16 00:57:33.621108 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.621087    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xntzw\" (UniqueName: \"kubernetes.io/projected/fd0cbb3a-1244-42df-9668-7a9abb90a36b-kube-api-access-xntzw\") pod \"payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47\" (UID: \"fd0cbb3a-1244-42df-9668-7a9abb90a36b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"
Sep 16 00:57:33.621296 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.621279    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc9h8\" (UniqueName: \"kubernetes.io/projected/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc-kube-api-access-kc9h8\") pod \"payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg\" (UID: \"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"
Sep 16 00:57:33.689139 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.689048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"
Sep 16 00:57:33.689290 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.689136    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"]
Sep 16 00:57:33.693093 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.693073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.695797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.695763    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-2fa86d\"/\"default-dockercfg-rfc58\""
Sep 16 00:57:33.695797 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.695763    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-2fa86d\"/\"openshift-service-ca.crt\""
Sep 16 00:57:33.696080 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.696060    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-2fa86d\"/\"kube-root-ca.crt\""
Sep 16 00:57:33.696201 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.696105    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-2fa86d\"/\"sub-test-model-2fa86d-kserve-self-signed-certs\""
Sep 16 00:57:33.702898 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.702876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"]
Sep 16 00:57:33.718658 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.718486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"
Sep 16 00:57:33.815089 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.815055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-dshm\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.815280 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.815226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-model-cache\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.815280 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.815267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc45x\" (UniqueName: \"kubernetes.io/projected/5e46db0d-0be8-4cd0-a47e-9dae752797d5-kube-api-access-wc45x\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.815398 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.815319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-home\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.815398 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.815360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-tmp-dir\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.815398 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.815387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46db0d-0be8-4cd0-a47e-9dae752797d5-tls-certs\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.915854 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.915823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-tmp-dir\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.916035 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.915864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46db0d-0be8-4cd0-a47e-9dae752797d5-tls-certs\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.916035 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.915887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-dshm\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.916035 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.915951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-model-cache\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.916035 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.915969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc45x\" (UniqueName: \"kubernetes.io/projected/5e46db0d-0be8-4cd0-a47e-9dae752797d5-kube-api-access-wc45x\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.916035 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.916005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-home\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.916640 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.916605    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-tmp-dir\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.916778 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.916475    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-model-cache\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.923205 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.916858    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-home\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.923205 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.919276    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-dshm\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.923205 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.919775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46db0d-0be8-4cd0-a47e-9dae752797d5-tls-certs\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.927484 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.927456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc45x\" (UniqueName: \"kubernetes.io/projected/5e46db0d-0be8-4cd0-a47e-9dae752797d5-kube-api-access-wc45x\") pod \"sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") " pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:33.969986 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.969823    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"]
Sep 16 00:57:33.972818 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:57:33.972789    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bea1b6e_17a7_4eb2_82be_ecb72f876cfc.slice/crio-186ab302e49b9509966aeedc1ec861cc9ad847a49982e486f2ee8679c778599d WatchSource:0}: Error finding container 186ab302e49b9509966aeedc1ec861cc9ad847a49982e486f2ee8679c778599d: Status 404 returned error can't find the container with id 186ab302e49b9509966aeedc1ec861cc9ad847a49982e486f2ee8679c778599d
Sep 16 00:57:33.998645 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:33.998623    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"]
Sep 16 00:57:34.004726 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:57:34.004693    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0cbb3a_1244_42df_9668_7a9abb90a36b.slice/crio-634149ee19b87615b654a03a37d9ea534ae76bec4b866a1c2d9bcf4c710c4c81 WatchSource:0}: Error finding container 634149ee19b87615b654a03a37d9ea534ae76bec4b866a1c2d9bcf4c710c4c81: Status 404 returned error can't find the container with id 634149ee19b87615b654a03a37d9ea534ae76bec4b866a1c2d9bcf4c710c4c81
Sep 16 00:57:34.019855 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.019830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:34.303091 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.303006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"]
Sep 16 00:57:34.306955 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:57:34.306924    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e46db0d_0be8_4cd0_a47e_9dae752797d5.slice/crio-2778bc7005ab8c9b152cb1972d50c9bee09a59ad7e85dc9fdafeb16b7603d292 WatchSource:0}: Error finding container 2778bc7005ab8c9b152cb1972d50c9bee09a59ad7e85dc9fdafeb16b7603d292: Status 404 returned error can't find the container with id 2778bc7005ab8c9b152cb1972d50c9bee09a59ad7e85dc9fdafeb16b7603d292
Sep 16 00:57:34.615120 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.615024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47" event={"ID":"fd0cbb3a-1244-42df-9668-7a9abb90a36b","Type":"ContainerStarted","Data":"80563697ad126b374320da9e04829ee4e1868fe17b7cfd84d3d3dfe6c622921b"}
Sep 16 00:57:34.615559 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.615143    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"
Sep 16 00:57:34.615559 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.615175    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47" event={"ID":"fd0cbb3a-1244-42df-9668-7a9abb90a36b","Type":"ContainerStarted","Data":"634149ee19b87615b654a03a37d9ea534ae76bec4b866a1c2d9bcf4c710c4c81"}
Sep 16 00:57:34.616949 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.616917    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg" event={"ID":"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc","Type":"ContainerStarted","Data":"fed4bcc96175ca1dbb1413e1b3e1d18be90b5141e4b00b34a65300fbadb8f804"}
Sep 16 00:57:34.617097 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.616977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg" event={"ID":"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc","Type":"ContainerStarted","Data":"186ab302e49b9509966aeedc1ec861cc9ad847a49982e486f2ee8679c778599d"}
Sep 16 00:57:34.617097 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.617092    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"
Sep 16 00:57:34.618712 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.618685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn" event={"ID":"5e46db0d-0be8-4cd0-a47e-9dae752797d5","Type":"ContainerStarted","Data":"02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff"}
Sep 16 00:57:34.618827 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.618718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn" event={"ID":"5e46db0d-0be8-4cd0-a47e-9dae752797d5","Type":"ContainerStarted","Data":"2778bc7005ab8c9b152cb1972d50c9bee09a59ad7e85dc9fdafeb16b7603d292"}
Sep 16 00:57:34.630687 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.630598    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47" podStartSLOduration=1.630578036 podStartE2EDuration="1.630578036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:57:34.629985414 +0000 UTC m=+1405.432808479" watchObservedRunningTime="2026-09-16 00:57:34.630578036 +0000 UTC m=+1405.433401101"
Sep 16 00:57:34.645810 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.645767    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg" podStartSLOduration=1.645751902 podStartE2EDuration="1.645751902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:57:34.644068852 +0000 UTC m=+1405.446891926" watchObservedRunningTime="2026-09-16 00:57:34.645751902 +0000 UTC m=+1405.448574965"
Sep 16 00:57:34.663413 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:34.663352    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn" podStartSLOduration=1.663331976 podStartE2EDuration="1.663331976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:57:34.662791017 +0000 UTC m=+1405.465614076" watchObservedRunningTime="2026-09-16 00:57:34.663331976 +0000 UTC m=+1405.466155044"
Sep 16 00:57:44.020577 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:44.020536    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:44.021121 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:44.020590    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:44.033563 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:44.033539    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:44.685646 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:44.685611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:57:45.626784 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:45.626756    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"
Sep 16 00:57:45.627266 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:45.626825    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"
Sep 16 00:57:56.574592 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:56.574555    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9358-9047ce"]
Sep 16 00:57:56.578659 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:56.578639    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9358-9047ce"
Sep 16 00:57:56.581060 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:56.581032    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qndhv\""
Sep 16 00:57:56.583097 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:56.583071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9358-9047ce"]
Sep 16 00:57:56.639342 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:56.639308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbngg\" (UniqueName: \"kubernetes.io/projected/d395e29e-3965-4a43-95f0-2d59cf33d689-kube-api-access-tbngg\") pod \"test-curl-9358-9047ce\" (UID: \"d395e29e-3965-4a43-95f0-2d59cf33d689\") " pod="opendatahub/test-curl-9358-9047ce"
Sep 16 00:57:56.740015 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:56.739984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbngg\" (UniqueName: \"kubernetes.io/projected/d395e29e-3965-4a43-95f0-2d59cf33d689-kube-api-access-tbngg\") pod \"test-curl-9358-9047ce\" (UID: \"d395e29e-3965-4a43-95f0-2d59cf33d689\") " pod="opendatahub/test-curl-9358-9047ce"
Sep 16 00:57:56.747292 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:56.747263    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbngg\" (UniqueName: \"kubernetes.io/projected/d395e29e-3965-4a43-95f0-2d59cf33d689-kube-api-access-tbngg\") pod \"test-curl-9358-9047ce\" (UID: \"d395e29e-3965-4a43-95f0-2d59cf33d689\") " pod="opendatahub/test-curl-9358-9047ce"
Sep 16 00:57:56.890834 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:56.890736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9358-9047ce"
Sep 16 00:57:57.164052 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:57.164022    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9358-9047ce"]
Sep 16 00:57:57.166658 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:57:57.166629    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd395e29e_3965_4a43_95f0_2d59cf33d689.slice/crio-e4e895a8cd157e9b4c54158319d44fb6a9984d0b4ec216e29d53c7c5cb8cd4a0 WatchSource:0}: Error finding container e4e895a8cd157e9b4c54158319d44fb6a9984d0b4ec216e29d53c7c5cb8cd4a0: Status 404 returned error can't find the container with id e4e895a8cd157e9b4c54158319d44fb6a9984d0b4ec216e29d53c7c5cb8cd4a0
Sep 16 00:57:57.168834 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:57.168819    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 00:57:57.742646 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:57.742596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9358-9047ce" event={"ID":"d395e29e-3965-4a43-95f0-2d59cf33d689","Type":"ContainerStarted","Data":"e4e895a8cd157e9b4c54158319d44fb6a9984d0b4ec216e29d53c7c5cb8cd4a0"}
Sep 16 00:57:59.756819 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:59.756780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9358-9047ce" event={"ID":"d395e29e-3965-4a43-95f0-2d59cf33d689","Type":"ContainerStarted","Data":"f834ecd3a18bd03b9ec77ea4cbb915575cab1e63c1c5f576002085fb9e7ee36a"}
Sep 16 00:57:59.771741 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:57:59.771684    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9358-9047ce" podStartSLOduration=1.916500332 podStartE2EDuration="3.771651661s" totalImagesPullingTime="1.855151329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:57:59.769831847 +0000 UTC m=+1430.572654909" watchObservedRunningTime="2026-09-16 00:57:59.771651661 +0000 UTC m=+1430.574474724"
Sep 16 00:58:00.375500 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:00.375465    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9358-9047ce"]
Sep 16 00:58:00.378305 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:00.378278    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9358-9047ce"]
Sep 16 00:58:00.762338 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:58:00.762261    2563 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9358-9047ce" container="test-curl-9358-9047ce"
Sep 16 00:58:01.767209 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:01.767166    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9358-9047ce" podUID="d395e29e-3965-4a43-95f0-2d59cf33d689" containerName="test-curl-9358-9047ce" containerID="cri-o://f834ecd3a18bd03b9ec77ea4cbb915575cab1e63c1c5f576002085fb9e7ee36a" gracePeriod=2
Sep 16 00:58:02.826353 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:02.826321    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9358-de46af"]
Sep 16 00:58:02.826774 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:02.826759    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d395e29e-3965-4a43-95f0-2d59cf33d689" containerName="test-curl-9358-9047ce"
Sep 16 00:58:02.826816 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:02.826775    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d395e29e-3965-4a43-95f0-2d59cf33d689" containerName="test-curl-9358-9047ce"
Sep 16 00:58:02.826859 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:02.826842    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d395e29e-3965-4a43-95f0-2d59cf33d689" containerName="test-curl-9358-9047ce"
Sep 16 00:58:02.830033 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:02.830014    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9358-de46af"
Sep 16 00:58:02.835463 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:02.835438    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9358-de46af"]
Sep 16 00:58:02.904401 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:02.904354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86fgq\" (UniqueName: \"kubernetes.io/projected/b497c626-cbfe-43bb-8617-97ae6da0ebb6-kube-api-access-86fgq\") pod \"test-curl-9358-de46af\" (UID: \"b497c626-cbfe-43bb-8617-97ae6da0ebb6\") " pod="opendatahub/test-curl-9358-de46af"
Sep 16 00:58:03.005876 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:03.005835    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86fgq\" (UniqueName: \"kubernetes.io/projected/b497c626-cbfe-43bb-8617-97ae6da0ebb6-kube-api-access-86fgq\") pod \"test-curl-9358-de46af\" (UID: \"b497c626-cbfe-43bb-8617-97ae6da0ebb6\") " pod="opendatahub/test-curl-9358-de46af"
Sep 16 00:58:03.014154 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:03.014126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86fgq\" (UniqueName: \"kubernetes.io/projected/b497c626-cbfe-43bb-8617-97ae6da0ebb6-kube-api-access-86fgq\") pod \"test-curl-9358-de46af\" (UID: \"b497c626-cbfe-43bb-8617-97ae6da0ebb6\") " pod="opendatahub/test-curl-9358-de46af"
Sep 16 00:58:03.140750 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:03.140633    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9358-de46af"
Sep 16 00:58:03.411493 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:03.411463    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9358-de46af"]
Sep 16 00:58:03.413276 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:58:03.413250    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb497c626_cbfe_43bb_8617_97ae6da0ebb6.slice/crio-5e32b56ba87b36b124b6ab3eaa28d887863a7a6d1eef45b64ac532b0ddca6016 WatchSource:0}: Error finding container 5e32b56ba87b36b124b6ab3eaa28d887863a7a6d1eef45b64ac532b0ddca6016: Status 404 returned error can't find the container with id 5e32b56ba87b36b124b6ab3eaa28d887863a7a6d1eef45b64ac532b0ddca6016
Sep 16 00:58:03.778802 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:03.778771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9358-de46af" event={"ID":"b497c626-cbfe-43bb-8617-97ae6da0ebb6","Type":"ContainerStarted","Data":"326b0c4e49f5aa5b3997822719da7a906c02ffa857860dc22633c0570197ae1c"}
Sep 16 00:58:03.778920 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:03.778814    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9358-de46af" event={"ID":"b497c626-cbfe-43bb-8617-97ae6da0ebb6","Type":"ContainerStarted","Data":"5e32b56ba87b36b124b6ab3eaa28d887863a7a6d1eef45b64ac532b0ddca6016"}
Sep 16 00:58:03.794148 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:03.794095    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9358-de46af" podStartSLOduration=1.794076793 podStartE2EDuration="1.794076793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:58:03.792008477 +0000 UTC m=+1434.594831539" watchObservedRunningTime="2026-09-16 00:58:03.794076793 +0000 UTC m=+1434.596899855"
Sep 16 00:58:03.941973 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:03.941944    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9358-9047ce"
Sep 16 00:58:04.016729 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:04.016696    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbngg\" (UniqueName: \"kubernetes.io/projected/d395e29e-3965-4a43-95f0-2d59cf33d689-kube-api-access-tbngg\") pod \"d395e29e-3965-4a43-95f0-2d59cf33d689\" (UID: \"d395e29e-3965-4a43-95f0-2d59cf33d689\") "
Sep 16 00:58:04.019120 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:04.019086    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d395e29e-3965-4a43-95f0-2d59cf33d689-kube-api-access-tbngg" (OuterVolumeSpecName: "kube-api-access-tbngg") pod "d395e29e-3965-4a43-95f0-2d59cf33d689" (UID: "d395e29e-3965-4a43-95f0-2d59cf33d689"). InnerVolumeSpecName "kube-api-access-tbngg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:58:04.117823 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:04.117794    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbngg\" (UniqueName: \"kubernetes.io/projected/d395e29e-3965-4a43-95f0-2d59cf33d689-kube-api-access-tbngg\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:58:04.379950 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:04.379863    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9358-de46af"]
Sep 16 00:58:04.384013 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:04.383984    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9358-de46af"]
Sep 16 00:58:04.784763 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:04.784728    2563 generic.go:356] "Generic (PLEG): container finished" podID="d395e29e-3965-4a43-95f0-2d59cf33d689" containerID="f834ecd3a18bd03b9ec77ea4cbb915575cab1e63c1c5f576002085fb9e7ee36a" exitCode=137
Sep 16 00:58:04.784763 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:04.784771    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9358-9047ce"
Sep 16 00:58:04.785045 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:04.784793    2563 scope.go:117] "RemoveContainer" containerID="f834ecd3a18bd03b9ec77ea4cbb915575cab1e63c1c5f576002085fb9e7ee36a"
Sep 16 00:58:04.785192 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:58:04.785174    2563 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9358-de46af" container="test-curl-9358-de46af"
Sep 16 00:58:04.794590 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:04.794572    2563 scope.go:117] "RemoveContainer" containerID="f834ecd3a18bd03b9ec77ea4cbb915575cab1e63c1c5f576002085fb9e7ee36a"
Sep 16 00:58:04.794848 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:58:04.794817    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-9358-9047ce\" is forbidden: User \"system:node:ip-10-0-136-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-16.ec2.internal' and this object" podUID="d395e29e-3965-4a43-95f0-2d59cf33d689" pod="opendatahub/test-curl-9358-9047ce"
Sep 16 00:58:04.794946 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:58:04.794924    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f834ecd3a18bd03b9ec77ea4cbb915575cab1e63c1c5f576002085fb9e7ee36a\": container with ID starting with f834ecd3a18bd03b9ec77ea4cbb915575cab1e63c1c5f576002085fb9e7ee36a not found: ID does not exist" containerID="f834ecd3a18bd03b9ec77ea4cbb915575cab1e63c1c5f576002085fb9e7ee36a"
Sep 16 00:58:04.795006 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:04.794956    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f834ecd3a18bd03b9ec77ea4cbb915575cab1e63c1c5f576002085fb9e7ee36a"} err="failed to get container status \"f834ecd3a18bd03b9ec77ea4cbb915575cab1e63c1c5f576002085fb9e7ee36a\": rpc error: code = NotFound desc = could not find container \"f834ecd3a18bd03b9ec77ea4cbb915575cab1e63c1c5f576002085fb9e7ee36a\": container with ID starting with f834ecd3a18bd03b9ec77ea4cbb915575cab1e63c1c5f576002085fb9e7ee36a not found: ID does not exist"
Sep 16 00:58:05.667842 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:05.667812    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d395e29e-3965-4a43-95f0-2d59cf33d689" path="/var/lib/kubelet/pods/d395e29e-3965-4a43-95f0-2d59cf33d689/volumes"
Sep 16 00:58:05.790765 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:05.790723    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9358-de46af" podUID="b497c626-cbfe-43bb-8617-97ae6da0ebb6" containerName="test-curl-9358-de46af" containerID="cri-o://326b0c4e49f5aa5b3997822719da7a906c02ffa857860dc22633c0570197ae1c" gracePeriod=2
Sep 16 00:58:07.964030 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:07.964004    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9358-de46af"
Sep 16 00:58:08.059822 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:08.059723    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86fgq\" (UniqueName: \"kubernetes.io/projected/b497c626-cbfe-43bb-8617-97ae6da0ebb6-kube-api-access-86fgq\") pod \"b497c626-cbfe-43bb-8617-97ae6da0ebb6\" (UID: \"b497c626-cbfe-43bb-8617-97ae6da0ebb6\") "
Sep 16 00:58:08.061941 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:08.061912    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b497c626-cbfe-43bb-8617-97ae6da0ebb6-kube-api-access-86fgq" (OuterVolumeSpecName: "kube-api-access-86fgq") pod "b497c626-cbfe-43bb-8617-97ae6da0ebb6" (UID: "b497c626-cbfe-43bb-8617-97ae6da0ebb6"). InnerVolumeSpecName "kube-api-access-86fgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:58:08.161058 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:08.161023    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86fgq\" (UniqueName: \"kubernetes.io/projected/b497c626-cbfe-43bb-8617-97ae6da0ebb6-kube-api-access-86fgq\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:58:08.807626 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:08.807585    2563 generic.go:356] "Generic (PLEG): container finished" podID="b497c626-cbfe-43bb-8617-97ae6da0ebb6" containerID="326b0c4e49f5aa5b3997822719da7a906c02ffa857860dc22633c0570197ae1c" exitCode=137
Sep 16 00:58:08.807902 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:08.807632    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9358-de46af"
Sep 16 00:58:08.807902 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:08.807652    2563 scope.go:117] "RemoveContainer" containerID="326b0c4e49f5aa5b3997822719da7a906c02ffa857860dc22633c0570197ae1c"
Sep 16 00:58:08.816729 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:08.816710    2563 scope.go:117] "RemoveContainer" containerID="326b0c4e49f5aa5b3997822719da7a906c02ffa857860dc22633c0570197ae1c"
Sep 16 00:58:08.817062 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:58:08.817036    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"326b0c4e49f5aa5b3997822719da7a906c02ffa857860dc22633c0570197ae1c\": container with ID starting with 326b0c4e49f5aa5b3997822719da7a906c02ffa857860dc22633c0570197ae1c not found: ID does not exist" containerID="326b0c4e49f5aa5b3997822719da7a906c02ffa857860dc22633c0570197ae1c"
Sep 16 00:58:08.817159 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:08.817068    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"326b0c4e49f5aa5b3997822719da7a906c02ffa857860dc22633c0570197ae1c"} err="failed to get container status \"326b0c4e49f5aa5b3997822719da7a906c02ffa857860dc22633c0570197ae1c\": rpc error: code = NotFound desc = could not find container \"326b0c4e49f5aa5b3997822719da7a906c02ffa857860dc22633c0570197ae1c\": container with ID starting with 326b0c4e49f5aa5b3997822719da7a906c02ffa857860dc22633c0570197ae1c not found: ID does not exist"
Sep 16 00:58:08.817159 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:58:08.817116    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-9358-de46af\" is forbidden: User \"system:node:ip-10-0-136-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-16.ec2.internal' and this object" podUID="b497c626-cbfe-43bb-8617-97ae6da0ebb6" pod="opendatahub/test-curl-9358-de46af"
Sep 16 00:58:09.668540 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:58:09.668498    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-9358-de46af\" is forbidden: User \"system:node:ip-10-0-136-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-16.ec2.internal' and this object" podUID="b497c626-cbfe-43bb-8617-97ae6da0ebb6" pod="opendatahub/test-curl-9358-de46af"
Sep 16 00:58:09.668913 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:09.668844    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b497c626-cbfe-43bb-8617-97ae6da0ebb6" path="/var/lib/kubelet/pods/b497c626-cbfe-43bb-8617-97ae6da0ebb6/volumes"
Sep 16 00:58:11.649158 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:11.649116    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9361-02dd2e"]
Sep 16 00:58:11.649741 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:11.649721    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b497c626-cbfe-43bb-8617-97ae6da0ebb6" containerName="test-curl-9358-de46af"
Sep 16 00:58:11.649829 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:11.649744    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b497c626-cbfe-43bb-8617-97ae6da0ebb6" containerName="test-curl-9358-de46af"
Sep 16 00:58:11.649893 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:11.649856    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b497c626-cbfe-43bb-8617-97ae6da0ebb6" containerName="test-curl-9358-de46af"
Sep 16 00:58:11.654298 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:11.654272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9361-02dd2e"
Sep 16 00:58:11.656294 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:11.656274    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qndhv\""
Sep 16 00:58:11.656734 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:11.656709    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9361-02dd2e"]
Sep 16 00:58:11.797563 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:11.797523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2262s\" (UniqueName: \"kubernetes.io/projected/413808f7-7e89-4695-8477-a6b0e685d77d-kube-api-access-2262s\") pod \"test-curl-9361-02dd2e\" (UID: \"413808f7-7e89-4695-8477-a6b0e685d77d\") " pod="opendatahub/test-curl-9361-02dd2e"
Sep 16 00:58:11.898643 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:11.898601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2262s\" (UniqueName: \"kubernetes.io/projected/413808f7-7e89-4695-8477-a6b0e685d77d-kube-api-access-2262s\") pod \"test-curl-9361-02dd2e\" (UID: \"413808f7-7e89-4695-8477-a6b0e685d77d\") " pod="opendatahub/test-curl-9361-02dd2e"
Sep 16 00:58:11.906098 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:11.906036    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2262s\" (UniqueName: \"kubernetes.io/projected/413808f7-7e89-4695-8477-a6b0e685d77d-kube-api-access-2262s\") pod \"test-curl-9361-02dd2e\" (UID: \"413808f7-7e89-4695-8477-a6b0e685d77d\") " pod="opendatahub/test-curl-9361-02dd2e"
Sep 16 00:58:11.966018 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:11.965989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9361-02dd2e"
Sep 16 00:58:12.243314 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:12.243221    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9361-02dd2e"]
Sep 16 00:58:12.245785 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:58:12.245752    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod413808f7_7e89_4695_8477_a6b0e685d77d.slice/crio-8d63949df40e7dd0eaebc05b895922901c98ddb0118b512715c97297e1bd8dfc WatchSource:0}: Error finding container 8d63949df40e7dd0eaebc05b895922901c98ddb0118b512715c97297e1bd8dfc: Status 404 returned error can't find the container with id 8d63949df40e7dd0eaebc05b895922901c98ddb0118b512715c97297e1bd8dfc
Sep 16 00:58:12.828058 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:12.828013    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9361-02dd2e" event={"ID":"413808f7-7e89-4695-8477-a6b0e685d77d","Type":"ContainerStarted","Data":"8b70111ba12280c585ee5e048cb918dc57bc2a35b2fe7764ad036b6f12ca5656"}
Sep 16 00:58:12.828058 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:12.828059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9361-02dd2e" event={"ID":"413808f7-7e89-4695-8477-a6b0e685d77d","Type":"ContainerStarted","Data":"8d63949df40e7dd0eaebc05b895922901c98ddb0118b512715c97297e1bd8dfc"}
Sep 16 00:58:12.842051 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:12.841995    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9361-02dd2e" podStartSLOduration=1.841979595 podStartE2EDuration="1.841979595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:58:12.840478936 +0000 UTC m=+1443.643301998" watchObservedRunningTime="2026-09-16 00:58:12.841979595 +0000 UTC m=+1443.644802658"
Sep 16 00:58:13.435915 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:13.435879    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9361-02dd2e"]
Sep 16 00:58:13.442322 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:13.442293    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9361-02dd2e"]
Sep 16 00:58:13.557983 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:13.557905    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9361-485b9e"]
Sep 16 00:58:13.558329 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:13.558316    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413808f7-7e89-4695-8477-a6b0e685d77d" containerName="test-curl-9361-02dd2e"
Sep 16 00:58:13.558375 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:13.558331    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="413808f7-7e89-4695-8477-a6b0e685d77d" containerName="test-curl-9361-02dd2e"
Sep 16 00:58:13.558413 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:13.558409    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="413808f7-7e89-4695-8477-a6b0e685d77d" containerName="test-curl-9361-02dd2e"
Sep 16 00:58:13.561537 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:13.561520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9361-485b9e"
Sep 16 00:58:13.569980 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:13.569956    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9361-485b9e"]
Sep 16 00:58:13.715074 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:13.715040    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtjxl\" (UniqueName: \"kubernetes.io/projected/78c45602-ba04-41a8-bb03-d6f8b19f2817-kube-api-access-jtjxl\") pod \"test-curl-9361-485b9e\" (UID: \"78c45602-ba04-41a8-bb03-d6f8b19f2817\") " pod="opendatahub/test-curl-9361-485b9e"
Sep 16 00:58:13.816386 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:13.816295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjxl\" (UniqueName: \"kubernetes.io/projected/78c45602-ba04-41a8-bb03-d6f8b19f2817-kube-api-access-jtjxl\") pod \"test-curl-9361-485b9e\" (UID: \"78c45602-ba04-41a8-bb03-d6f8b19f2817\") " pod="opendatahub/test-curl-9361-485b9e"
Sep 16 00:58:13.823572 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:13.823545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtjxl\" (UniqueName: \"kubernetes.io/projected/78c45602-ba04-41a8-bb03-d6f8b19f2817-kube-api-access-jtjxl\") pod \"test-curl-9361-485b9e\" (UID: \"78c45602-ba04-41a8-bb03-d6f8b19f2817\") " pod="opendatahub/test-curl-9361-485b9e"
Sep 16 00:58:13.833768 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:58:13.833748    2563 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9361-02dd2e" container="test-curl-9361-02dd2e"
Sep 16 00:58:13.871974 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:13.871937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9361-485b9e"
Sep 16 00:58:14.144260 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:14.144233    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9361-485b9e"]
Sep 16 00:58:14.146539 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:58:14.146510    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78c45602_ba04_41a8_bb03_d6f8b19f2817.slice/crio-5a244f9456896390ef26445cece47def6dc85b67c6b527268a7552273c719f0e WatchSource:0}: Error finding container 5a244f9456896390ef26445cece47def6dc85b67c6b527268a7552273c719f0e: Status 404 returned error can't find the container with id 5a244f9456896390ef26445cece47def6dc85b67c6b527268a7552273c719f0e
Sep 16 00:58:14.840064 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:14.840029    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9361-485b9e" event={"ID":"78c45602-ba04-41a8-bb03-d6f8b19f2817","Type":"ContainerStarted","Data":"bbdf793ad767cc146afbdee4a4e6eee5608e4d09e43466718c3a0a20d1406025"}
Sep 16 00:58:14.840592 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:14.840073    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9361-485b9e" event={"ID":"78c45602-ba04-41a8-bb03-d6f8b19f2817","Type":"ContainerStarted","Data":"5a244f9456896390ef26445cece47def6dc85b67c6b527268a7552273c719f0e"}
Sep 16 00:58:14.840592 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:14.840188    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9361-02dd2e" podUID="413808f7-7e89-4695-8477-a6b0e685d77d" containerName="test-curl-9361-02dd2e" containerID="cri-o://8b70111ba12280c585ee5e048cb918dc57bc2a35b2fe7764ad036b6f12ca5656" gracePeriod=2
Sep 16 00:58:14.854623 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:14.854576    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9361-485b9e" podStartSLOduration=1.854560717 podStartE2EDuration="1.854560717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:58:14.852430287 +0000 UTC m=+1445.655253350" watchObservedRunningTime="2026-09-16 00:58:14.854560717 +0000 UTC m=+1445.657383780"
Sep 16 00:58:15.458179 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:15.458137    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9361-485b9e"]
Sep 16 00:58:15.461776 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:15.461750    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9361-485b9e"]
Sep 16 00:58:15.846333 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:58:15.846304    2563 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9361-485b9e" container="test-curl-9361-485b9e"
Sep 16 00:58:16.851946 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:16.851908    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9361-485b9e" podUID="78c45602-ba04-41a8-bb03-d6f8b19f2817" containerName="test-curl-9361-485b9e" containerID="cri-o://bbdf793ad767cc146afbdee4a4e6eee5608e4d09e43466718c3a0a20d1406025" gracePeriod=2
Sep 16 00:58:17.016598 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:17.016568    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9361-02dd2e"
Sep 16 00:58:17.149863 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:17.149771    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2262s\" (UniqueName: \"kubernetes.io/projected/413808f7-7e89-4695-8477-a6b0e685d77d-kube-api-access-2262s\") pod \"413808f7-7e89-4695-8477-a6b0e685d77d\" (UID: \"413808f7-7e89-4695-8477-a6b0e685d77d\") "
Sep 16 00:58:17.152097 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:17.152071    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413808f7-7e89-4695-8477-a6b0e685d77d-kube-api-access-2262s" (OuterVolumeSpecName: "kube-api-access-2262s") pod "413808f7-7e89-4695-8477-a6b0e685d77d" (UID: "413808f7-7e89-4695-8477-a6b0e685d77d"). InnerVolumeSpecName "kube-api-access-2262s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:58:17.250918 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:17.250881    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2262s\" (UniqueName: \"kubernetes.io/projected/413808f7-7e89-4695-8477-a6b0e685d77d-kube-api-access-2262s\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:58:17.669009 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:17.668967    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="413808f7-7e89-4695-8477-a6b0e685d77d" path="/var/lib/kubelet/pods/413808f7-7e89-4695-8477-a6b0e685d77d/volumes"
Sep 16 00:58:17.858189 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:17.858153    2563 generic.go:356] "Generic (PLEG): container finished" podID="413808f7-7e89-4695-8477-a6b0e685d77d" containerID="8b70111ba12280c585ee5e048cb918dc57bc2a35b2fe7764ad036b6f12ca5656" exitCode=137
Sep 16 00:58:17.858611 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:17.858206    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9361-02dd2e"
Sep 16 00:58:17.858611 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:17.858242    2563 scope.go:117] "RemoveContainer" containerID="8b70111ba12280c585ee5e048cb918dc57bc2a35b2fe7764ad036b6f12ca5656"
Sep 16 00:58:17.867242 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:17.867224    2563 scope.go:117] "RemoveContainer" containerID="8b70111ba12280c585ee5e048cb918dc57bc2a35b2fe7764ad036b6f12ca5656"
Sep 16 00:58:17.867562 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:58:17.867540    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b70111ba12280c585ee5e048cb918dc57bc2a35b2fe7764ad036b6f12ca5656\": container with ID starting with 8b70111ba12280c585ee5e048cb918dc57bc2a35b2fe7764ad036b6f12ca5656 not found: ID does not exist" containerID="8b70111ba12280c585ee5e048cb918dc57bc2a35b2fe7764ad036b6f12ca5656"
Sep 16 00:58:17.867629 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:17.867572    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b70111ba12280c585ee5e048cb918dc57bc2a35b2fe7764ad036b6f12ca5656"} err="failed to get container status \"8b70111ba12280c585ee5e048cb918dc57bc2a35b2fe7764ad036b6f12ca5656\": rpc error: code = NotFound desc = could not find container \"8b70111ba12280c585ee5e048cb918dc57bc2a35b2fe7764ad036b6f12ca5656\": container with ID starting with 8b70111ba12280c585ee5e048cb918dc57bc2a35b2fe7764ad036b6f12ca5656 not found: ID does not exist"
Sep 16 00:58:18.451868 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:18.451828    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"]
Sep 16 00:58:19.064939 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:19.064913    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9361-485b9e"
Sep 16 00:58:19.170866 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:19.170779    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtjxl\" (UniqueName: \"kubernetes.io/projected/78c45602-ba04-41a8-bb03-d6f8b19f2817-kube-api-access-jtjxl\") pod \"78c45602-ba04-41a8-bb03-d6f8b19f2817\" (UID: \"78c45602-ba04-41a8-bb03-d6f8b19f2817\") "
Sep 16 00:58:19.173042 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:19.173010    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78c45602-ba04-41a8-bb03-d6f8b19f2817-kube-api-access-jtjxl" (OuterVolumeSpecName: "kube-api-access-jtjxl") pod "78c45602-ba04-41a8-bb03-d6f8b19f2817" (UID: "78c45602-ba04-41a8-bb03-d6f8b19f2817"). InnerVolumeSpecName "kube-api-access-jtjxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:58:19.272095 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:19.272056    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtjxl\" (UniqueName: \"kubernetes.io/projected/78c45602-ba04-41a8-bb03-d6f8b19f2817-kube-api-access-jtjxl\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:58:19.668167 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:19.668129    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78c45602-ba04-41a8-bb03-d6f8b19f2817" path="/var/lib/kubelet/pods/78c45602-ba04-41a8-bb03-d6f8b19f2817/volumes"
Sep 16 00:58:19.871808 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:19.871767    2563 generic.go:356] "Generic (PLEG): container finished" podID="78c45602-ba04-41a8-bb03-d6f8b19f2817" containerID="bbdf793ad767cc146afbdee4a4e6eee5608e4d09e43466718c3a0a20d1406025" exitCode=137
Sep 16 00:58:19.871808 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:19.871811    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9361-485b9e"
Sep 16 00:58:19.872063 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:19.871868    2563 scope.go:117] "RemoveContainer" containerID="bbdf793ad767cc146afbdee4a4e6eee5608e4d09e43466718c3a0a20d1406025"
Sep 16 00:58:19.880767 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:19.880747    2563 scope.go:117] "RemoveContainer" containerID="bbdf793ad767cc146afbdee4a4e6eee5608e4d09e43466718c3a0a20d1406025"
Sep 16 00:58:19.881071 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:58:19.881051    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbdf793ad767cc146afbdee4a4e6eee5608e4d09e43466718c3a0a20d1406025\": container with ID starting with bbdf793ad767cc146afbdee4a4e6eee5608e4d09e43466718c3a0a20d1406025 not found: ID does not exist" containerID="bbdf793ad767cc146afbdee4a4e6eee5608e4d09e43466718c3a0a20d1406025"
Sep 16 00:58:19.881147 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:19.881084    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbdf793ad767cc146afbdee4a4e6eee5608e4d09e43466718c3a0a20d1406025"} err="failed to get container status \"bbdf793ad767cc146afbdee4a4e6eee5608e4d09e43466718c3a0a20d1406025\": rpc error: code = NotFound desc = could not find container \"bbdf793ad767cc146afbdee4a4e6eee5608e4d09e43466718c3a0a20d1406025\": container with ID starting with bbdf793ad767cc146afbdee4a4e6eee5608e4d09e43466718c3a0a20d1406025 not found: ID does not exist"
Sep 16 00:58:26.993408 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:26.993372    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"]
Sep 16 00:58:26.994034 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:26.994015    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78c45602-ba04-41a8-bb03-d6f8b19f2817" containerName="test-curl-9361-485b9e"
Sep 16 00:58:26.994079 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:26.994038    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="78c45602-ba04-41a8-bb03-d6f8b19f2817" containerName="test-curl-9361-485b9e"
Sep 16 00:58:26.994147 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:26.994135    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="78c45602-ba04-41a8-bb03-d6f8b19f2817" containerName="test-curl-9361-485b9e"
Sep 16 00:58:26.999294 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:26.999268    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.003307 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.003098    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-108960\"/\"default-dockercfg-9wl2p\""
Sep 16 00:58:27.003307 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.003108    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"]
Sep 16 00:58:27.003307 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.003208    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-108960\"/\"kube-root-ca.crt\""
Sep 16 00:58:27.003307 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.003208    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-108960\"/\"rate-test-model-108960-kserve-self-signed-certs\""
Sep 16 00:58:27.003620 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.003469    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-108960\"/\"openshift-service-ca.crt\""
Sep 16 00:58:27.046092 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.046057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-dshm\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.046092 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.046095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-tmp-dir\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.046320 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.046125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfsp7\" (UniqueName: \"kubernetes.io/projected/f8b43c36-caf7-4a16-b780-dcc45b351941-kube-api-access-hfsp7\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.046320 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.046161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b43c36-caf7-4a16-b780-dcc45b351941-tls-certs\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.046320 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.046179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-home\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.046320 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.046202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-model-cache\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.147192 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.147157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-dshm\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.147391 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.147203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-tmp-dir\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.147391 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.147238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfsp7\" (UniqueName: \"kubernetes.io/projected/f8b43c36-caf7-4a16-b780-dcc45b351941-kube-api-access-hfsp7\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.147391 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.147260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b43c36-caf7-4a16-b780-dcc45b351941-tls-certs\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.147391 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.147289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-home\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.147391 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.147330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-model-cache\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.147646 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.147625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-tmp-dir\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.147727 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.147702    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-home\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.147800 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.147712    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-model-cache\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.149539 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.149515    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-dshm\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.149960 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.149941    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b43c36-caf7-4a16-b780-dcc45b351941-tls-certs\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.157864 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.157841    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfsp7\" (UniqueName: \"kubernetes.io/projected/f8b43c36-caf7-4a16-b780-dcc45b351941-kube-api-access-hfsp7\") pod \"rate-test-model-108960-kserve-5584b4d7d7-qsqf8\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") " pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.310939 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.310837    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:27.580694 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.580650    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"]
Sep 16 00:58:27.583195 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:58:27.583168    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8b43c36_caf7_4a16_b780_dcc45b351941.slice/crio-dae8d02321ebbc5084495a8d2ea8f8c174431f22afaae33896faa444cd230e9a WatchSource:0}: Error finding container dae8d02321ebbc5084495a8d2ea8f8c174431f22afaae33896faa444cd230e9a: Status 404 returned error can't find the container with id dae8d02321ebbc5084495a8d2ea8f8c174431f22afaae33896faa444cd230e9a
Sep 16 00:58:27.915931 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.915837    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8" event={"ID":"f8b43c36-caf7-4a16-b780-dcc45b351941","Type":"ContainerStarted","Data":"115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66"}
Sep 16 00:58:27.915931 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.915886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8" event={"ID":"f8b43c36-caf7-4a16-b780-dcc45b351941","Type":"ContainerStarted","Data":"dae8d02321ebbc5084495a8d2ea8f8c174431f22afaae33896faa444cd230e9a"}
Sep 16 00:58:27.932780 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:27.932730    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8" podStartSLOduration=1.932713776 podStartE2EDuration="1.932713776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:58:27.931254538 +0000 UTC m=+1458.734077603" watchObservedRunningTime="2026-09-16 00:58:27.932713776 +0000 UTC m=+1458.735536839"
Sep 16 00:58:33.471280 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.471226    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn" podUID="5e46db0d-0be8-4cd0-a47e-9dae752797d5" containerName="main" containerID="cri-o://02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff" gracePeriod=45
Sep 16 00:58:33.725404 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.725344    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:58:33.815409 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.815370    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46db0d-0be8-4cd0-a47e-9dae752797d5-tls-certs\") pod \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") "
Sep 16 00:58:33.815409 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.815415    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-tmp-dir\") pod \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") "
Sep 16 00:58:33.815636 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.815457    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-home\") pod \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") "
Sep 16 00:58:33.815636 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.815500    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-dshm\") pod \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") "
Sep 16 00:58:33.815636 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.815515    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-model-cache\") pod \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") "
Sep 16 00:58:33.815636 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.815545    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc45x\" (UniqueName: \"kubernetes.io/projected/5e46db0d-0be8-4cd0-a47e-9dae752797d5-kube-api-access-wc45x\") pod \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\" (UID: \"5e46db0d-0be8-4cd0-a47e-9dae752797d5\") "
Sep 16 00:58:33.815882 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.815792    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5e46db0d-0be8-4cd0-a47e-9dae752797d5" (UID: "5e46db0d-0be8-4cd0-a47e-9dae752797d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:58:33.815882 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.815786    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-home" (OuterVolumeSpecName: "home") pod "5e46db0d-0be8-4cd0-a47e-9dae752797d5" (UID: "5e46db0d-0be8-4cd0-a47e-9dae752797d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:58:33.815882 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.815807    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-model-cache" (OuterVolumeSpecName: "model-cache") pod "5e46db0d-0be8-4cd0-a47e-9dae752797d5" (UID: "5e46db0d-0be8-4cd0-a47e-9dae752797d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:58:33.816034 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.815905    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-tmp-dir\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:58:33.816034 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.815918    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-home\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:58:33.816034 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.815926    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-model-cache\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:58:33.817908 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.817882    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-dshm" (OuterVolumeSpecName: "dshm") pod "5e46db0d-0be8-4cd0-a47e-9dae752797d5" (UID: "5e46db0d-0be8-4cd0-a47e-9dae752797d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 00:58:33.818009 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.817989    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e46db0d-0be8-4cd0-a47e-9dae752797d5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5e46db0d-0be8-4cd0-a47e-9dae752797d5" (UID: "5e46db0d-0be8-4cd0-a47e-9dae752797d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 00:58:33.818068 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.818026    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e46db0d-0be8-4cd0-a47e-9dae752797d5-kube-api-access-wc45x" (OuterVolumeSpecName: "kube-api-access-wc45x") pod "5e46db0d-0be8-4cd0-a47e-9dae752797d5" (UID: "5e46db0d-0be8-4cd0-a47e-9dae752797d5"). InnerVolumeSpecName "kube-api-access-wc45x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 00:58:33.916749 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.916700    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46db0d-0be8-4cd0-a47e-9dae752797d5-tls-certs\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:58:33.916749 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.916738    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e46db0d-0be8-4cd0-a47e-9dae752797d5-dshm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:58:33.916749 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.916751    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc45x\" (UniqueName: \"kubernetes.io/projected/5e46db0d-0be8-4cd0-a47e-9dae752797d5-kube-api-access-wc45x\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 00:58:33.952629 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.952592    2563 generic.go:356] "Generic (PLEG): container finished" podID="5e46db0d-0be8-4cd0-a47e-9dae752797d5" containerID="02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff" exitCode=0
Sep 16 00:58:33.952814 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.952635    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"
Sep 16 00:58:33.952814 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.952697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn" event={"ID":"5e46db0d-0be8-4cd0-a47e-9dae752797d5","Type":"ContainerDied","Data":"02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff"}
Sep 16 00:58:33.952814 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.952745    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn" event={"ID":"5e46db0d-0be8-4cd0-a47e-9dae752797d5","Type":"ContainerDied","Data":"2778bc7005ab8c9b152cb1972d50c9bee09a59ad7e85dc9fdafeb16b7603d292"}
Sep 16 00:58:33.952814 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.952762    2563 scope.go:117] "RemoveContainer" containerID="02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff"
Sep 16 00:58:33.962414 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.962392    2563 scope.go:117] "RemoveContainer" containerID="02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff"
Sep 16 00:58:33.962751 ip-10-0-136-16 kubenswrapper[2563]: E0916 00:58:33.962730    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff\": container with ID starting with 02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff not found: ID does not exist" containerID="02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff"
Sep 16 00:58:33.962804 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.962761    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff"} err="failed to get container status \"02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff\": rpc error: code = NotFound desc = could not find container \"02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff\": container with ID starting with 02110385afcea7d39a0a9f0796ac789cc8b4c121eecbf4a35e088b89ecd72bff not found: ID does not exist"
Sep 16 00:58:33.973061 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.973034    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"]
Sep 16 00:58:33.976504 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:33.976440    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w2-2fa86d/sub-test-model-2fa86d-kserve-557f9dc66f-7ggtn"]
Sep 16 00:58:35.668720 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:35.668659    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e46db0d-0be8-4cd0-a47e-9dae752797d5" path="/var/lib/kubelet/pods/5e46db0d-0be8-4cd0-a47e-9dae752797d5/volumes"
Sep 16 00:58:37.311185 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:37.311135    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:37.311721 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:37.311423    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:37.324715 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:37.324689    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:58:37.991652 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:58:37.991619    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 00:59:09.801310 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:09.801276    2563 scope.go:117] "RemoveContainer" containerID="9090d8c2a50c36a03f328033eb9c739c27a86de79dce0a615916506a6af4ac31"
Sep 16 00:59:13.907086 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:13.907053    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"]
Sep 16 00:59:13.907570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:13.907444    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e46db0d-0be8-4cd0-a47e-9dae752797d5" containerName="main"
Sep 16 00:59:13.907570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:13.907454    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e46db0d-0be8-4cd0-a47e-9dae752797d5" containerName="main"
Sep 16 00:59:13.907570 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:13.907538    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e46db0d-0be8-4cd0-a47e-9dae752797d5" containerName="main"
Sep 16 00:59:13.912211 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:13.912189    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:13.914897 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:13.914869    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-37b46587\"/\"default-dockercfg-d5bhn\""
Sep 16 00:59:13.914897 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:13.914887    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-37b46587\"/\"e2e-lifecycle-model-37b46587-kserve-self-signed-certs\""
Sep 16 00:59:13.915097 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:13.914907    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-37b46587\"/\"openshift-service-ca.crt\""
Sep 16 00:59:13.915097 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:13.914914    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-37b46587\"/\"kube-root-ca.crt\""
Sep 16 00:59:13.923511 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:13.923481    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"]
Sep 16 00:59:14.004879 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.004838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-model-cache\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.004879 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.004884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whc5r\" (UniqueName: \"kubernetes.io/projected/f687b920-f142-49d4-8a8c-f5bba7eabc5c-kube-api-access-whc5r\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.005119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.004938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f687b920-f142-49d4-8a8c-f5bba7eabc5c-tls-certs\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.005119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.004982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-tmp-dir\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.005119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.004998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-dshm\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.005119 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.005061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-home\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.105700 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.105626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f687b920-f142-49d4-8a8c-f5bba7eabc5c-tls-certs\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.105700 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.105704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-tmp-dir\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.105958 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.105729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-dshm\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.105958 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.105760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-home\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.105958 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.105851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-model-cache\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.105958 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.105876    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whc5r\" (UniqueName: \"kubernetes.io/projected/f687b920-f142-49d4-8a8c-f5bba7eabc5c-kube-api-access-whc5r\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.106218 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.106108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-tmp-dir\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.106423 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.106398    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-home\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.106719 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.106422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-model-cache\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.108339 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.108306    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-dshm\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.108487 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.108468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f687b920-f142-49d4-8a8c-f5bba7eabc5c-tls-certs\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.113366 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.113342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whc5r\" (UniqueName: \"kubernetes.io/projected/f687b920-f142-49d4-8a8c-f5bba7eabc5c-kube-api-access-whc5r\") pod \"e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") " pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.229798 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.229747    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:14.504165 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:14.504138    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"]
Sep 16 00:59:14.505865 ip-10-0-136-16 kubenswrapper[2563]: W0916 00:59:14.505822    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf687b920_f142_49d4_8a8c_f5bba7eabc5c.slice/crio-7882068ddf7e185aea5e77525a5f5b1b0ff51b23b376b4c00d2cf854250b42f6 WatchSource:0}: Error finding container 7882068ddf7e185aea5e77525a5f5b1b0ff51b23b376b4c00d2cf854250b42f6: Status 404 returned error can't find the container with id 7882068ddf7e185aea5e77525a5f5b1b0ff51b23b376b4c00d2cf854250b42f6
Sep 16 00:59:15.167738 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:15.167696    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q" event={"ID":"f687b920-f142-49d4-8a8c-f5bba7eabc5c","Type":"ContainerStarted","Data":"e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9"}
Sep 16 00:59:15.167738 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:15.167743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q" event={"ID":"f687b920-f142-49d4-8a8c-f5bba7eabc5c","Type":"ContainerStarted","Data":"7882068ddf7e185aea5e77525a5f5b1b0ff51b23b376b4c00d2cf854250b42f6"}
Sep 16 00:59:15.183831 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:15.183772    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q" podStartSLOduration=2.183752592 podStartE2EDuration="2.183752592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 00:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 00:59:15.182343228 +0000 UTC m=+1505.985166288" watchObservedRunningTime="2026-09-16 00:59:15.183752592 +0000 UTC m=+1505.986575655"
Sep 16 00:59:24.229881 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:24.229838    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:24.230351 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:24.229907    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:24.242924 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:24.242891    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 00:59:25.231285 ip-10-0-136-16 kubenswrapper[2563]: I0916 00:59:25.231255    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 01:00:00.134271 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.134234    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd"]
Sep 16 01:00:00.138055 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.138033    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld"]
Sep 16 01:00:00.138205 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.138166    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd"
Sep 16 01:00:00.140791 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.140772    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-npltg\""
Sep 16 01:00:00.141348 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.141332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld"
Sep 16 01:00:00.149614 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.149584    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd"]
Sep 16 01:00:00.152213 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.152190    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd"
Sep 16 01:00:00.153277 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.153251    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld"]
Sep 16 01:00:00.155562 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.155516    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t"]
Sep 16 01:00:00.161284 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.161266    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t"
Sep 16 01:00:00.163301 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.163281    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld"
Sep 16 01:00:00.165007 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.164984    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t"]
Sep 16 01:00:00.201100 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.201040    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t"
Sep 16 01:00:00.443089 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.443056    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd"]
Sep 16 01:00:00.444594 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:00:00.444553    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode238312a_b259_4a1f_9785_ccd4004f9f5d.slice/crio-0eee9c32511f84f271ccf9ffb1bbd0f09bf425824ab2184b251529bdd458dfb5 WatchSource:0}: Error finding container 0eee9c32511f84f271ccf9ffb1bbd0f09bf425824ab2184b251529bdd458dfb5: Status 404 returned error can't find the container with id 0eee9c32511f84f271ccf9ffb1bbd0f09bf425824ab2184b251529bdd458dfb5
Sep 16 01:00:00.448944 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.448925    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld"]
Sep 16 01:00:00.450699 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:00:00.450659    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba81e87b_5e70_45b3_aa4f_79f9832a360e.slice/crio-7941d1cb87bfdb062f8368d0f717acffac95806392ed176c6e2ec449b6e3de68 WatchSource:0}: Error finding container 7941d1cb87bfdb062f8368d0f717acffac95806392ed176c6e2ec449b6e3de68: Status 404 returned error can't find the container with id 7941d1cb87bfdb062f8368d0f717acffac95806392ed176c6e2ec449b6e3de68
Sep 16 01:00:00.511243 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:00.511219    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t"]
Sep 16 01:00:00.513527 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:00:00.513501    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6e7690_1c66_4e6c_9993_15372d6e3d76.slice/crio-5618863694ed2775e79bbaf3021691201dc5305b6e62992e86ef25af6691d07b WatchSource:0}: Error finding container 5618863694ed2775e79bbaf3021691201dc5305b6e62992e86ef25af6691d07b: Status 404 returned error can't find the container with id 5618863694ed2775e79bbaf3021691201dc5305b6e62992e86ef25af6691d07b
Sep 16 01:00:01.291138 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:01.291108    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t"]
Sep 16 01:00:01.407759 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:01.407725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd" event={"ID":"e238312a-b259-4a1f-9785-ccd4004f9f5d","Type":"ContainerStarted","Data":"5970023e254c7a5ac0e15615912573ad68faab7a195d3250b3d1402021bf8cb1"}
Sep 16 01:00:01.407902 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:01.407782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd" event={"ID":"e238312a-b259-4a1f-9785-ccd4004f9f5d","Type":"ContainerStarted","Data":"0eee9c32511f84f271ccf9ffb1bbd0f09bf425824ab2184b251529bdd458dfb5"}
Sep 16 01:00:01.409290 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:01.409265    2563 generic.go:356] "Generic (PLEG): container finished" podID="6f6e7690-1c66-4e6c-9993-15372d6e3d76" containerID="411e30b04eecdfc7797a9348e289dffa0a6bd870f9ad43aa83ae970ffd2f7b04" exitCode=6
Sep 16 01:00:01.409406 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:01.409339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t" event={"ID":"6f6e7690-1c66-4e6c-9993-15372d6e3d76","Type":"ContainerDied","Data":"411e30b04eecdfc7797a9348e289dffa0a6bd870f9ad43aa83ae970ffd2f7b04"}
Sep 16 01:00:01.409406 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:01.409398    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t" event={"ID":"6f6e7690-1c66-4e6c-9993-15372d6e3d76","Type":"ContainerStarted","Data":"5618863694ed2775e79bbaf3021691201dc5305b6e62992e86ef25af6691d07b"}
Sep 16 01:00:01.409509 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:01.409346    2563 scope.go:117] "RemoveContainer" containerID="411e30b04eecdfc7797a9348e289dffa0a6bd870f9ad43aa83ae970ffd2f7b04"
Sep 16 01:00:01.410938 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:01.410916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld" event={"ID":"ba81e87b-5e70-45b3-aa4f-79f9832a360e","Type":"ContainerStarted","Data":"88b63f0654ae87720507b686decefd330ed50ba65ac451a7e6c223eb661829fd"}
Sep 16 01:00:01.411046 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:01.410952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld" event={"ID":"ba81e87b-5e70-45b3-aa4f-79f9832a360e","Type":"ContainerStarted","Data":"7941d1cb87bfdb062f8368d0f717acffac95806392ed176c6e2ec449b6e3de68"}
Sep 16 01:00:01.422119 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:01.422066    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd" podStartSLOduration=1.422044526 podStartE2EDuration="1.422044526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:00:01.421479995 +0000 UTC m=+1552.224303058" watchObservedRunningTime="2026-09-16 01:00:01.422044526 +0000 UTC m=+1552.224867590"
Sep 16 01:00:01.436899 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:01.436840    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld" podStartSLOduration=1.436817966 podStartE2EDuration="1.436817966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:00:01.434808358 +0000 UTC m=+1552.237631421" watchObservedRunningTime="2026-09-16 01:00:01.436817966 +0000 UTC m=+1552.239641041"
Sep 16 01:00:02.418750 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:02.418712    2563 generic.go:356] "Generic (PLEG): container finished" podID="e238312a-b259-4a1f-9785-ccd4004f9f5d" containerID="5970023e254c7a5ac0e15615912573ad68faab7a195d3250b3d1402021bf8cb1" exitCode=0
Sep 16 01:00:02.419321 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:02.418799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd" event={"ID":"e238312a-b259-4a1f-9785-ccd4004f9f5d","Type":"ContainerDied","Data":"5970023e254c7a5ac0e15615912573ad68faab7a195d3250b3d1402021bf8cb1"}
Sep 16 01:00:02.420957 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:02.420933    2563 generic.go:356] "Generic (PLEG): container finished" podID="6f6e7690-1c66-4e6c-9993-15372d6e3d76" containerID="c210ff67ba03d962454a8e207a02853dbcb9caeded28243a060eec8c30f35380" exitCode=6
Sep 16 01:00:02.421099 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:02.421018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t" event={"ID":"6f6e7690-1c66-4e6c-9993-15372d6e3d76","Type":"ContainerDied","Data":"c210ff67ba03d962454a8e207a02853dbcb9caeded28243a060eec8c30f35380"}
Sep 16 01:00:02.421099 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:02.421079    2563 scope.go:117] "RemoveContainer" containerID="411e30b04eecdfc7797a9348e289dffa0a6bd870f9ad43aa83ae970ffd2f7b04"
Sep 16 01:00:02.422788 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:02.422768    2563 generic.go:356] "Generic (PLEG): container finished" podID="ba81e87b-5e70-45b3-aa4f-79f9832a360e" containerID="88b63f0654ae87720507b686decefd330ed50ba65ac451a7e6c223eb661829fd" exitCode=0
Sep 16 01:00:02.422923 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:02.422808    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld" event={"ID":"ba81e87b-5e70-45b3-aa4f-79f9832a360e","Type":"ContainerDied","Data":"88b63f0654ae87720507b686decefd330ed50ba65ac451a7e6c223eb661829fd"}
Sep 16 01:00:02.561590 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:02.561565    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t"
Sep 16 01:00:03.429036 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:03.428999    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t"
Sep 16 01:00:03.429036 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:03.429023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t" event={"ID":"6f6e7690-1c66-4e6c-9993-15372d6e3d76","Type":"ContainerDied","Data":"5618863694ed2775e79bbaf3021691201dc5305b6e62992e86ef25af6691d07b"}
Sep 16 01:00:03.429562 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:03.429122    2563 scope.go:117] "RemoveContainer" containerID="c210ff67ba03d962454a8e207a02853dbcb9caeded28243a060eec8c30f35380"
Sep 16 01:00:03.457699 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:03.457630    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t"]
Sep 16 01:00:03.460438 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:03.460412    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-37b46587-29825340-bdl9t"]
Sep 16 01:00:03.561360 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:03.561337    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd"
Sep 16 01:00:03.600303 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:03.600277    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld"
Sep 16 01:00:03.667534 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:03.667490    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f6e7690-1c66-4e6c-9993-15372d6e3d76" path="/var/lib/kubelet/pods/6f6e7690-1c66-4e6c-9993-15372d6e3d76/volumes"
Sep 16 01:00:04.437655 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:04.437622    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld"
Sep 16 01:00:04.438123 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:04.437658    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld" event={"ID":"ba81e87b-5e70-45b3-aa4f-79f9832a360e","Type":"ContainerDied","Data":"7941d1cb87bfdb062f8368d0f717acffac95806392ed176c6e2ec449b6e3de68"}
Sep 16 01:00:04.438123 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:04.437733    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7941d1cb87bfdb062f8368d0f717acffac95806392ed176c6e2ec449b6e3de68"
Sep 16 01:00:04.439132 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:04.439105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd" event={"ID":"e238312a-b259-4a1f-9785-ccd4004f9f5d","Type":"ContainerDied","Data":"0eee9c32511f84f271ccf9ffb1bbd0f09bf425824ab2184b251529bdd458dfb5"}
Sep 16 01:00:04.439132 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:04.439130    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd"
Sep 16 01:00:04.439285 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:04.439148    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0eee9c32511f84f271ccf9ffb1bbd0f09bf425824ab2184b251529bdd458dfb5"
Sep 16 01:00:09.777172 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:09.777066    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"]
Sep 16 01:00:24.798001 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:24.797937    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q" podUID="f687b920-f142-49d4-8a8c-f5bba7eabc5c" containerName="main" containerID="cri-o://e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9" gracePeriod=45
Sep 16 01:00:25.049539 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.049480    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 01:00:25.129959 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.129921    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whc5r\" (UniqueName: \"kubernetes.io/projected/f687b920-f142-49d4-8a8c-f5bba7eabc5c-kube-api-access-whc5r\") pod \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") "
Sep 16 01:00:25.130145 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.129985    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-model-cache\") pod \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") "
Sep 16 01:00:25.130145 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.130101    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f687b920-f142-49d4-8a8c-f5bba7eabc5c-tls-certs\") pod \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") "
Sep 16 01:00:25.130278 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.130146    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-home\") pod \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") "
Sep 16 01:00:25.130278 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.130178    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-tmp-dir\") pod \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") "
Sep 16 01:00:25.130278 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.130216    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-dshm\") pod \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\" (UID: \"f687b920-f142-49d4-8a8c-f5bba7eabc5c\") "
Sep 16 01:00:25.130427 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.130311    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-model-cache" (OuterVolumeSpecName: "model-cache") pod "f687b920-f142-49d4-8a8c-f5bba7eabc5c" (UID: "f687b920-f142-49d4-8a8c-f5bba7eabc5c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:00:25.130605 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.130581    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-model-cache\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:00:25.130849 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.130635    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f687b920-f142-49d4-8a8c-f5bba7eabc5c" (UID: "f687b920-f142-49d4-8a8c-f5bba7eabc5c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:00:25.130849 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.130733    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-home" (OuterVolumeSpecName: "home") pod "f687b920-f142-49d4-8a8c-f5bba7eabc5c" (UID: "f687b920-f142-49d4-8a8c-f5bba7eabc5c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:00:25.132657 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.132636    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f687b920-f142-49d4-8a8c-f5bba7eabc5c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f687b920-f142-49d4-8a8c-f5bba7eabc5c" (UID: "f687b920-f142-49d4-8a8c-f5bba7eabc5c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 01:00:25.132773 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.132650    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f687b920-f142-49d4-8a8c-f5bba7eabc5c-kube-api-access-whc5r" (OuterVolumeSpecName: "kube-api-access-whc5r") pod "f687b920-f142-49d4-8a8c-f5bba7eabc5c" (UID: "f687b920-f142-49d4-8a8c-f5bba7eabc5c"). InnerVolumeSpecName "kube-api-access-whc5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:00:25.132773 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.132650    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-dshm" (OuterVolumeSpecName: "dshm") pod "f687b920-f142-49d4-8a8c-f5bba7eabc5c" (UID: "f687b920-f142-49d4-8a8c-f5bba7eabc5c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:00:25.231623 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.231590    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f687b920-f142-49d4-8a8c-f5bba7eabc5c-tls-certs\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:00:25.231623 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.231617    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-home\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:00:25.231623 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.231626    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-tmp-dir\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:00:25.231623 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.231634    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f687b920-f142-49d4-8a8c-f5bba7eabc5c-dshm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:00:25.231918 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.231642    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whc5r\" (UniqueName: \"kubernetes.io/projected/f687b920-f142-49d4-8a8c-f5bba7eabc5c-kube-api-access-whc5r\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:00:25.557615 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.557582    2563 generic.go:356] "Generic (PLEG): container finished" podID="f687b920-f142-49d4-8a8c-f5bba7eabc5c" containerID="e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9" exitCode=0
Sep 16 01:00:25.557817 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.557634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q" event={"ID":"f687b920-f142-49d4-8a8c-f5bba7eabc5c","Type":"ContainerDied","Data":"e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9"}
Sep 16 01:00:25.557817 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.557639    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"
Sep 16 01:00:25.557817 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.557693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q" event={"ID":"f687b920-f142-49d4-8a8c-f5bba7eabc5c","Type":"ContainerDied","Data":"7882068ddf7e185aea5e77525a5f5b1b0ff51b23b376b4c00d2cf854250b42f6"}
Sep 16 01:00:25.557817 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.557710    2563 scope.go:117] "RemoveContainer" containerID="e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9"
Sep 16 01:00:25.567318 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.567301    2563 scope.go:117] "RemoveContainer" containerID="e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9"
Sep 16 01:00:25.567620 ip-10-0-136-16 kubenswrapper[2563]: E0916 01:00:25.567601    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9\": container with ID starting with e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9 not found: ID does not exist" containerID="e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9"
Sep 16 01:00:25.567691 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.567630    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9"} err="failed to get container status \"e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9\": rpc error: code = NotFound desc = could not find container \"e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9\": container with ID starting with e007016839e130eb7b5a701ca6f99a008367ddb2338bd79ae5a05ad92fa617e9 not found: ID does not exist"
Sep 16 01:00:25.577638 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.577611    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"]
Sep 16 01:00:25.579561 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.579539    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-37b46587/e2e-lifecycle-model-37b46587-kserve-c6fb459ff-82k2q"]
Sep 16 01:00:25.668091 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:25.668056    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f687b920-f142-49d4-8a8c-f5bba7eabc5c" path="/var/lib/kubelet/pods/f687b920-f142-49d4-8a8c-f5bba7eabc5c/volumes"
Sep 16 01:00:48.152019 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:48.151983    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"]
Sep 16 01:00:57.641587 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.641555    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"]
Sep 16 01:00:57.642051 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642035    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e238312a-b259-4a1f-9785-ccd4004f9f5d" containerName="cleanup"
Sep 16 01:00:57.642097 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642053    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e238312a-b259-4a1f-9785-ccd4004f9f5d" containerName="cleanup"
Sep 16 01:00:57.642097 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642067    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6e7690-1c66-4e6c-9993-15372d6e3d76" containerName="cleanup"
Sep 16 01:00:57.642097 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642073    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6e7690-1c66-4e6c-9993-15372d6e3d76" containerName="cleanup"
Sep 16 01:00:57.642097 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642085    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f687b920-f142-49d4-8a8c-f5bba7eabc5c" containerName="main"
Sep 16 01:00:57.642097 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642092    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f687b920-f142-49d4-8a8c-f5bba7eabc5c" containerName="main"
Sep 16 01:00:57.642250 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642103    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6e7690-1c66-4e6c-9993-15372d6e3d76" containerName="cleanup"
Sep 16 01:00:57.642250 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642109    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6e7690-1c66-4e6c-9993-15372d6e3d76" containerName="cleanup"
Sep 16 01:00:57.642250 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642116    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba81e87b-5e70-45b3-aa4f-79f9832a360e" containerName="cleanup"
Sep 16 01:00:57.642250 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642121    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba81e87b-5e70-45b3-aa4f-79f9832a360e" containerName="cleanup"
Sep 16 01:00:57.642250 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642185    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f687b920-f142-49d4-8a8c-f5bba7eabc5c" containerName="main"
Sep 16 01:00:57.642250 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642193    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6e7690-1c66-4e6c-9993-15372d6e3d76" containerName="cleanup"
Sep 16 01:00:57.642250 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642200    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6e7690-1c66-4e6c-9993-15372d6e3d76" containerName="cleanup"
Sep 16 01:00:57.642250 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642205    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba81e87b-5e70-45b3-aa4f-79f9832a360e" containerName="cleanup"
Sep 16 01:00:57.642250 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.642212    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e238312a-b259-4a1f-9785-ccd4004f9f5d" containerName="cleanup"
Sep 16 01:00:57.644908 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.644892    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"
Sep 16 01:00:57.647033 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.647010    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-715834-dockercfg-lhkvw\""
Sep 16 01:00:57.647638 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.647621    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-715834\""
Sep 16 01:00:57.654003 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.653981    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"]
Sep 16 01:00:57.759754 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.759717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1f3b0e-8177-4455-aec4-72b403c69673-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph\" (UID: \"4e1f3b0e-8177-4455-aec4-72b403c69673\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"
Sep 16 01:00:57.759935 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.759771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj2nq\" (UniqueName: \"kubernetes.io/projected/4e1f3b0e-8177-4455-aec4-72b403c69673-kube-api-access-kj2nq\") pod \"payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph\" (UID: \"4e1f3b0e-8177-4455-aec4-72b403c69673\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"
Sep 16 01:00:57.860580 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.860537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj2nq\" (UniqueName: \"kubernetes.io/projected/4e1f3b0e-8177-4455-aec4-72b403c69673-kube-api-access-kj2nq\") pod \"payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph\" (UID: \"4e1f3b0e-8177-4455-aec4-72b403c69673\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"
Sep 16 01:00:57.860800 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.860653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1f3b0e-8177-4455-aec4-72b403c69673-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph\" (UID: \"4e1f3b0e-8177-4455-aec4-72b403c69673\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"
Sep 16 01:00:57.861347 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.861325    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1f3b0e-8177-4455-aec4-72b403c69673-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph\" (UID: \"4e1f3b0e-8177-4455-aec4-72b403c69673\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"
Sep 16 01:00:57.869274 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.869244    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj2nq\" (UniqueName: \"kubernetes.io/projected/4e1f3b0e-8177-4455-aec4-72b403c69673-kube-api-access-kj2nq\") pod \"payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph\" (UID: \"4e1f3b0e-8177-4455-aec4-72b403c69673\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"
Sep 16 01:00:57.957828 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:57.957794    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"
Sep 16 01:00:58.236279 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:58.236250    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"]
Sep 16 01:00:58.238032 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:00:58.238006    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1f3b0e_8177_4455_aec4_72b403c69673.slice/crio-038869c1dfe8fbe6a2b5605aac7c577c5f63446083fa5ab52d9baf4460e468bc WatchSource:0}: Error finding container 038869c1dfe8fbe6a2b5605aac7c577c5f63446083fa5ab52d9baf4460e468bc: Status 404 returned error can't find the container with id 038869c1dfe8fbe6a2b5605aac7c577c5f63446083fa5ab52d9baf4460e468bc
Sep 16 01:00:58.731136 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:58.731097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph" event={"ID":"4e1f3b0e-8177-4455-aec4-72b403c69673","Type":"ContainerStarted","Data":"6f9abe7d7cfacf331247a2a162ff999a5b01dec7d9e65f1d451bbbfdffd32a3a"}
Sep 16 01:00:58.731536 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:58.731147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph" event={"ID":"4e1f3b0e-8177-4455-aec4-72b403c69673","Type":"ContainerStarted","Data":"038869c1dfe8fbe6a2b5605aac7c577c5f63446083fa5ab52d9baf4460e468bc"}
Sep 16 01:00:58.731536 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:58.731228    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"
Sep 16 01:00:58.748632 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:00:58.748581    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph" podStartSLOduration=1.748565743 podStartE2EDuration="1.748565743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:00:58.746730737 +0000 UTC m=+1609.549553802" watchObservedRunningTime="2026-09-16 01:00:58.748565743 +0000 UTC m=+1609.551388836"
Sep 16 01:01:03.172807 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.172719    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8" podUID="f8b43c36-caf7-4a16-b780-dcc45b351941" containerName="main" containerID="cri-o://115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66" gracePeriod=45
Sep 16 01:01:03.425901 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.425845    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 01:01:03.523294 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.523253    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfsp7\" (UniqueName: \"kubernetes.io/projected/f8b43c36-caf7-4a16-b780-dcc45b351941-kube-api-access-hfsp7\") pod \"f8b43c36-caf7-4a16-b780-dcc45b351941\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") "
Sep 16 01:01:03.523294 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.523299    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b43c36-caf7-4a16-b780-dcc45b351941-tls-certs\") pod \"f8b43c36-caf7-4a16-b780-dcc45b351941\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") "
Sep 16 01:01:03.523547 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.523373    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-model-cache\") pod \"f8b43c36-caf7-4a16-b780-dcc45b351941\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") "
Sep 16 01:01:03.523547 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.523432    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-home\") pod \"f8b43c36-caf7-4a16-b780-dcc45b351941\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") "
Sep 16 01:01:03.523547 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.523455    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-dshm\") pod \"f8b43c36-caf7-4a16-b780-dcc45b351941\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") "
Sep 16 01:01:03.523547 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.523487    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-tmp-dir\") pod \"f8b43c36-caf7-4a16-b780-dcc45b351941\" (UID: \"f8b43c36-caf7-4a16-b780-dcc45b351941\") "
Sep 16 01:01:03.523776 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.523706    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-home" (OuterVolumeSpecName: "home") pod "f8b43c36-caf7-4a16-b780-dcc45b351941" (UID: "f8b43c36-caf7-4a16-b780-dcc45b351941"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:01:03.523776 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.523738    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-model-cache" (OuterVolumeSpecName: "model-cache") pod "f8b43c36-caf7-4a16-b780-dcc45b351941" (UID: "f8b43c36-caf7-4a16-b780-dcc45b351941"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:01:03.523900 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.523838    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f8b43c36-caf7-4a16-b780-dcc45b351941" (UID: "f8b43c36-caf7-4a16-b780-dcc45b351941"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:01:03.523956 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.523931    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-home\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:01:03.523956 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.523942    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-tmp-dir\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:01:03.523956 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.523951    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-model-cache\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:01:03.525719 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.525689    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-dshm" (OuterVolumeSpecName: "dshm") pod "f8b43c36-caf7-4a16-b780-dcc45b351941" (UID: "f8b43c36-caf7-4a16-b780-dcc45b351941"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:01:03.525835 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.525768    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8b43c36-caf7-4a16-b780-dcc45b351941-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f8b43c36-caf7-4a16-b780-dcc45b351941" (UID: "f8b43c36-caf7-4a16-b780-dcc45b351941"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 01:01:03.525835 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.525809    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8b43c36-caf7-4a16-b780-dcc45b351941-kube-api-access-hfsp7" (OuterVolumeSpecName: "kube-api-access-hfsp7") pod "f8b43c36-caf7-4a16-b780-dcc45b351941" (UID: "f8b43c36-caf7-4a16-b780-dcc45b351941"). InnerVolumeSpecName "kube-api-access-hfsp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:01:03.625051 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.625018    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8b43c36-caf7-4a16-b780-dcc45b351941-dshm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:01:03.625051 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.625046    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfsp7\" (UniqueName: \"kubernetes.io/projected/f8b43c36-caf7-4a16-b780-dcc45b351941-kube-api-access-hfsp7\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:01:03.625051 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.625057    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b43c36-caf7-4a16-b780-dcc45b351941-tls-certs\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:01:03.758704 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.758646    2563 generic.go:356] "Generic (PLEG): container finished" podID="f8b43c36-caf7-4a16-b780-dcc45b351941" containerID="115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66" exitCode=0
Sep 16 01:01:03.758885 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.758710    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"
Sep 16 01:01:03.758885 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.758735    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8" event={"ID":"f8b43c36-caf7-4a16-b780-dcc45b351941","Type":"ContainerDied","Data":"115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66"}
Sep 16 01:01:03.758885 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.758784    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8" event={"ID":"f8b43c36-caf7-4a16-b780-dcc45b351941","Type":"ContainerDied","Data":"dae8d02321ebbc5084495a8d2ea8f8c174431f22afaae33896faa444cd230e9a"}
Sep 16 01:01:03.758885 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.758807    2563 scope.go:117] "RemoveContainer" containerID="115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66"
Sep 16 01:01:03.767877 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.767858    2563 scope.go:117] "RemoveContainer" containerID="115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66"
Sep 16 01:01:03.768175 ip-10-0-136-16 kubenswrapper[2563]: E0916 01:01:03.768156    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66\": container with ID starting with 115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66 not found: ID does not exist" containerID="115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66"
Sep 16 01:01:03.768221 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.768184    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66"} err="failed to get container status \"115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66\": rpc error: code = NotFound desc = could not find container \"115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66\": container with ID starting with 115255db10cfa611ba8d4166c341fcf969fe56e4e3e4f57b5bcf966025aaad66 not found: ID does not exist"
Sep 16 01:01:03.774249 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.774226    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"]
Sep 16 01:01:03.778455 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:03.778437    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w2-108960/rate-test-model-108960-kserve-5584b4d7d7-qsqf8"]
Sep 16 01:01:05.667882 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:05.667851    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8b43c36-caf7-4a16-b780-dcc45b351941" path="/var/lib/kubelet/pods/f8b43c36-caf7-4a16-b780-dcc45b351941/volumes"
Sep 16 01:01:09.737932 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:09.737900    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"
Sep 16 01:01:31.255105 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.255065    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"]
Sep 16 01:01:31.255785 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.255764    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8b43c36-caf7-4a16-b780-dcc45b351941" containerName="main"
Sep 16 01:01:31.255854 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.255789    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8b43c36-caf7-4a16-b780-dcc45b351941" containerName="main"
Sep 16 01:01:31.255933 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.255921    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8b43c36-caf7-4a16-b780-dcc45b351941" containerName="main"
Sep 16 01:01:31.261128 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.261109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"
Sep 16 01:01:31.263501 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.263476    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-0e8a7b-dockercfg-kgc7m\""
Sep 16 01:01:31.263812 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.263791    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-0e8a7b\""
Sep 16 01:01:31.268143 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.268122    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"]
Sep 16 01:01:31.285517 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.285481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60655a4-e5aa-40b2-9892-fa0562774bc7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5\" (UID: \"c60655a4-e5aa-40b2-9892-fa0562774bc7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"
Sep 16 01:01:31.285763 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.285563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9qpf\" (UniqueName: \"kubernetes.io/projected/c60655a4-e5aa-40b2-9892-fa0562774bc7-kube-api-access-h9qpf\") pod \"payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5\" (UID: \"c60655a4-e5aa-40b2-9892-fa0562774bc7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"
Sep 16 01:01:31.386534 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.386488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60655a4-e5aa-40b2-9892-fa0562774bc7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5\" (UID: \"c60655a4-e5aa-40b2-9892-fa0562774bc7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"
Sep 16 01:01:31.386743 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.386554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9qpf\" (UniqueName: \"kubernetes.io/projected/c60655a4-e5aa-40b2-9892-fa0562774bc7-kube-api-access-h9qpf\") pod \"payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5\" (UID: \"c60655a4-e5aa-40b2-9892-fa0562774bc7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"
Sep 16 01:01:31.387190 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.387170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60655a4-e5aa-40b2-9892-fa0562774bc7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5\" (UID: \"c60655a4-e5aa-40b2-9892-fa0562774bc7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"
Sep 16 01:01:31.399529 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.399505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9qpf\" (UniqueName: \"kubernetes.io/projected/c60655a4-e5aa-40b2-9892-fa0562774bc7-kube-api-access-h9qpf\") pod \"payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5\" (UID: \"c60655a4-e5aa-40b2-9892-fa0562774bc7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"
Sep 16 01:01:31.572293 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.572204    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"
Sep 16 01:01:31.846024 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.845994    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"]
Sep 16 01:01:31.847885 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:01:31.847856    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60655a4_e5aa_40b2_9892_fa0562774bc7.slice/crio-e6a72aa54d19883e055539bf8b24d26ce43efef171a2c0031e282e2466f2f834 WatchSource:0}: Error finding container e6a72aa54d19883e055539bf8b24d26ce43efef171a2c0031e282e2466f2f834: Status 404 returned error can't find the container with id e6a72aa54d19883e055539bf8b24d26ce43efef171a2c0031e282e2466f2f834
Sep 16 01:01:31.907907 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:31.907878    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5" event={"ID":"c60655a4-e5aa-40b2-9892-fa0562774bc7","Type":"ContainerStarted","Data":"e6a72aa54d19883e055539bf8b24d26ce43efef171a2c0031e282e2466f2f834"}
Sep 16 01:01:32.914910 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:32.914877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5" event={"ID":"c60655a4-e5aa-40b2-9892-fa0562774bc7","Type":"ContainerStarted","Data":"6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc"}
Sep 16 01:01:32.915316 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:32.914966    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"
Sep 16 01:01:32.932650 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:32.932601    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5" podStartSLOduration=1.932585396 podStartE2EDuration="1.932585396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:01:32.931139148 +0000 UTC m=+1643.733962213" watchObservedRunningTime="2026-09-16 01:01:32.932585396 +0000 UTC m=+1643.735408459"
Sep 16 01:01:43.922799 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:43.922764    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"
Sep 16 01:01:57.203257 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.203223    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"]
Sep 16 01:01:57.207112 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.207093    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"
Sep 16 01:01:57.209585 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.209565    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-2c31c5\""
Sep 16 01:01:57.209764 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.209747    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-2c31c5-dockercfg-v6sml\""
Sep 16 01:01:57.216354 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.216335    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"]
Sep 16 01:01:57.229895 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.229862    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"]
Sep 16 01:01:57.233712 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.233651    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"
Sep 16 01:01:57.246181 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.246155    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"]
Sep 16 01:01:57.341419 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.341382    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4b0ff65-4653-48db-956d-bf95e10a29de-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm\" (UID: \"b4b0ff65-4653-48db-956d-bf95e10a29de\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"
Sep 16 01:01:57.341624 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.341428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr2ld\" (UniqueName: \"kubernetes.io/projected/a78a2465-aab5-46cd-a268-603a42c4f088-kube-api-access-zr2ld\") pod \"payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75\" (UID: \"a78a2465-aab5-46cd-a268-603a42c4f088\") " pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"
Sep 16 01:01:57.341624 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.341502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a78a2465-aab5-46cd-a268-603a42c4f088-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75\" (UID: \"a78a2465-aab5-46cd-a268-603a42c4f088\") " pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"
Sep 16 01:01:57.341766 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.341640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlksj\" (UniqueName: \"kubernetes.io/projected/b4b0ff65-4653-48db-956d-bf95e10a29de-kube-api-access-mlksj\") pod \"payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm\" (UID: \"b4b0ff65-4653-48db-956d-bf95e10a29de\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"
Sep 16 01:01:57.442368 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.442334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4b0ff65-4653-48db-956d-bf95e10a29de-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm\" (UID: \"b4b0ff65-4653-48db-956d-bf95e10a29de\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"
Sep 16 01:01:57.442561 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.442381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr2ld\" (UniqueName: \"kubernetes.io/projected/a78a2465-aab5-46cd-a268-603a42c4f088-kube-api-access-zr2ld\") pod \"payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75\" (UID: \"a78a2465-aab5-46cd-a268-603a42c4f088\") " pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"
Sep 16 01:01:57.442561 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.442515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a78a2465-aab5-46cd-a268-603a42c4f088-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75\" (UID: \"a78a2465-aab5-46cd-a268-603a42c4f088\") " pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"
Sep 16 01:01:57.442720 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.442661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlksj\" (UniqueName: \"kubernetes.io/projected/b4b0ff65-4653-48db-956d-bf95e10a29de-kube-api-access-mlksj\") pod \"payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm\" (UID: \"b4b0ff65-4653-48db-956d-bf95e10a29de\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"
Sep 16 01:01:57.443291 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.443267    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4b0ff65-4653-48db-956d-bf95e10a29de-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm\" (UID: \"b4b0ff65-4653-48db-956d-bf95e10a29de\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"
Sep 16 01:01:57.443341 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.443294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a78a2465-aab5-46cd-a268-603a42c4f088-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75\" (UID: \"a78a2465-aab5-46cd-a268-603a42c4f088\") " pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"
Sep 16 01:01:57.453132 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.453105    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr2ld\" (UniqueName: \"kubernetes.io/projected/a78a2465-aab5-46cd-a268-603a42c4f088-kube-api-access-zr2ld\") pod \"payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75\" (UID: \"a78a2465-aab5-46cd-a268-603a42c4f088\") " pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"
Sep 16 01:01:57.453240 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.453133    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlksj\" (UniqueName: \"kubernetes.io/projected/b4b0ff65-4653-48db-956d-bf95e10a29de-kube-api-access-mlksj\") pod \"payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm\" (UID: \"b4b0ff65-4653-48db-956d-bf95e10a29de\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"
Sep 16 01:01:57.518905 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.518811    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"
Sep 16 01:01:57.543913 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.543885    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"
Sep 16 01:01:57.793737 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.793705    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"]
Sep 16 01:01:57.795699 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:01:57.795649    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b0ff65_4653_48db_956d_bf95e10a29de.slice/crio-6dc2c59761b2018a893c0e2bdd336273391367082a8dde7313515ffa1679b340 WatchSource:0}: Error finding container 6dc2c59761b2018a893c0e2bdd336273391367082a8dde7313515ffa1679b340: Status 404 returned error can't find the container with id 6dc2c59761b2018a893c0e2bdd336273391367082a8dde7313515ffa1679b340
Sep 16 01:01:57.830888 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.830857    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"]
Sep 16 01:01:57.832765 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:01:57.832736    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78a2465_aab5_46cd_a268_603a42c4f088.slice/crio-cc01862a917454925a9b443839c06383db3dce57329b5d98cd4cd3a9fce866ea WatchSource:0}: Error finding container cc01862a917454925a9b443839c06383db3dce57329b5d98cd4cd3a9fce866ea: Status 404 returned error can't find the container with id cc01862a917454925a9b443839c06383db3dce57329b5d98cd4cd3a9fce866ea
Sep 16 01:01:57.972325 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:57.972285    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5_c60655a4-e5aa-40b2-9892-fa0562774bc7/payload-processing/0.log"
Sep 16 01:01:58.043234 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:58.043119    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75" event={"ID":"a78a2465-aab5-46cd-a268-603a42c4f088","Type":"ContainerStarted","Data":"38259580bc4ea6630925d6923b4af71ca386e7cec0cf5a120f3b3044e7569011"}
Sep 16 01:01:58.043234 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:58.043194    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"
Sep 16 01:01:58.043234 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:58.043219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75" event={"ID":"a78a2465-aab5-46cd-a268-603a42c4f088","Type":"ContainerStarted","Data":"cc01862a917454925a9b443839c06383db3dce57329b5d98cd4cd3a9fce866ea"}
Sep 16 01:01:58.044725 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:58.044698    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm" event={"ID":"b4b0ff65-4653-48db-956d-bf95e10a29de","Type":"ContainerStarted","Data":"72b85e59c8b260e0b76d282abbd470859fe11b5fc6d61670f2e569ff9c08b9e9"}
Sep 16 01:01:58.044857 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:58.044744    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm" event={"ID":"b4b0ff65-4653-48db-956d-bf95e10a29de","Type":"ContainerStarted","Data":"6dc2c59761b2018a893c0e2bdd336273391367082a8dde7313515ffa1679b340"}
Sep 16 01:01:58.044857 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:58.044771    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"
Sep 16 01:01:58.063711 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:58.063625    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75" podStartSLOduration=1.063609197 podStartE2EDuration="1.063609197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:01:58.061029006 +0000 UTC m=+1668.863852066" watchObservedRunningTime="2026-09-16 01:01:58.063609197 +0000 UTC m=+1668.866432261"
Sep 16 01:01:58.075906 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:01:58.075855    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm" podStartSLOduration=1.075835854 podStartE2EDuration="1.075835854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:01:58.075365941 +0000 UTC m=+1668.878189007" watchObservedRunningTime="2026-09-16 01:01:58.075835854 +0000 UTC m=+1668.878658918"
Sep 16 01:02:09.060130 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:09.060094    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"
Sep 16 01:02:09.060733 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:09.060327    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"
Sep 16 01:02:31.295208 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.295125    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"]
Sep 16 01:02:31.299312 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.299290    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"
Sep 16 01:02:31.301453 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.301428    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-761551\""
Sep 16 01:02:31.307744 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.307723    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"]
Sep 16 01:02:31.338061 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.338024    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"]
Sep 16 01:02:31.341634 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.341617    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"
Sep 16 01:02:31.343982 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.343958    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-761551-dockercfg-n4kwm\""
Sep 16 01:02:31.352613 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.352592    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"]
Sep 16 01:02:31.458395 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.458358    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6647ab-3d51-4ece-853e-99c8580fb1db-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps\" (UID: \"6a6647ab-3d51-4ece-853e-99c8580fb1db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"
Sep 16 01:02:31.458621 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.458442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckdrf\" (UniqueName: \"kubernetes.io/projected/6a6647ab-3d51-4ece-853e-99c8580fb1db-kube-api-access-ckdrf\") pod \"payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps\" (UID: \"6a6647ab-3d51-4ece-853e-99c8580fb1db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"
Sep 16 01:02:31.458621 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.458480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdbtq\" (UniqueName: \"kubernetes.io/projected/d6c849f8-08cd-4fe3-8aac-625524f15901-kube-api-access-sdbtq\") pod \"payload-processing-e2e-api-b-761551-5c64678db7-z2jh4\" (UID: \"d6c849f8-08cd-4fe3-8aac-625524f15901\") " pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"
Sep 16 01:02:31.458621 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.458558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6c849f8-08cd-4fe3-8aac-625524f15901-plugins-config-volume\") pod \"payload-processing-e2e-api-b-761551-5c64678db7-z2jh4\" (UID: \"d6c849f8-08cd-4fe3-8aac-625524f15901\") " pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"
Sep 16 01:02:31.559486 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.559395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6c849f8-08cd-4fe3-8aac-625524f15901-plugins-config-volume\") pod \"payload-processing-e2e-api-b-761551-5c64678db7-z2jh4\" (UID: \"d6c849f8-08cd-4fe3-8aac-625524f15901\") " pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"
Sep 16 01:02:31.559486 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.559443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6647ab-3d51-4ece-853e-99c8580fb1db-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps\" (UID: \"6a6647ab-3d51-4ece-853e-99c8580fb1db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"
Sep 16 01:02:31.559731 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.559517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckdrf\" (UniqueName: \"kubernetes.io/projected/6a6647ab-3d51-4ece-853e-99c8580fb1db-kube-api-access-ckdrf\") pod \"payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps\" (UID: \"6a6647ab-3d51-4ece-853e-99c8580fb1db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"
Sep 16 01:02:31.559731 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.559565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdbtq\" (UniqueName: \"kubernetes.io/projected/d6c849f8-08cd-4fe3-8aac-625524f15901-kube-api-access-sdbtq\") pod \"payload-processing-e2e-api-b-761551-5c64678db7-z2jh4\" (UID: \"d6c849f8-08cd-4fe3-8aac-625524f15901\") " pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"
Sep 16 01:02:31.560224 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.560202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6c849f8-08cd-4fe3-8aac-625524f15901-plugins-config-volume\") pod \"payload-processing-e2e-api-b-761551-5c64678db7-z2jh4\" (UID: \"d6c849f8-08cd-4fe3-8aac-625524f15901\") " pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"
Sep 16 01:02:31.560265 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.560239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6647ab-3d51-4ece-853e-99c8580fb1db-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps\" (UID: \"6a6647ab-3d51-4ece-853e-99c8580fb1db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"
Sep 16 01:02:31.567606 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.567578    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckdrf\" (UniqueName: \"kubernetes.io/projected/6a6647ab-3d51-4ece-853e-99c8580fb1db-kube-api-access-ckdrf\") pod \"payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps\" (UID: \"6a6647ab-3d51-4ece-853e-99c8580fb1db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"
Sep 16 01:02:31.567819 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.567799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdbtq\" (UniqueName: \"kubernetes.io/projected/d6c849f8-08cd-4fe3-8aac-625524f15901-kube-api-access-sdbtq\") pod \"payload-processing-e2e-api-b-761551-5c64678db7-z2jh4\" (UID: \"d6c849f8-08cd-4fe3-8aac-625524f15901\") " pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"
Sep 16 01:02:31.612002 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.611964    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"
Sep 16 01:02:31.652489 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.652447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"
Sep 16 01:02:31.885835 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.885809    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"]
Sep 16 01:02:31.888079 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:02:31.888048    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6647ab_3d51_4ece_853e_99c8580fb1db.slice/crio-f60baacf1abc92594bf07ea8736483abfc9b1e6097167e74df1c63f9d59c0e63 WatchSource:0}: Error finding container f60baacf1abc92594bf07ea8736483abfc9b1e6097167e74df1c63f9d59c0e63: Status 404 returned error can't find the container with id f60baacf1abc92594bf07ea8736483abfc9b1e6097167e74df1c63f9d59c0e63
Sep 16 01:02:31.943299 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:31.943270    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"]
Sep 16 01:02:31.945000 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:02:31.944974    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c849f8_08cd_4fe3_8aac_625524f15901.slice/crio-b926c208d49722b8f7c0a59612f9b8835b189dfb0b4e4c5e2f797df44c2f62d4 WatchSource:0}: Error finding container b926c208d49722b8f7c0a59612f9b8835b189dfb0b4e4c5e2f797df44c2f62d4: Status 404 returned error can't find the container with id b926c208d49722b8f7c0a59612f9b8835b189dfb0b4e4c5e2f797df44c2f62d4
Sep 16 01:02:32.241010 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:32.240966    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps" event={"ID":"6a6647ab-3d51-4ece-853e-99c8580fb1db","Type":"ContainerStarted","Data":"451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59"}
Sep 16 01:02:32.241230 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:32.241039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps" event={"ID":"6a6647ab-3d51-4ece-853e-99c8580fb1db","Type":"ContainerStarted","Data":"f60baacf1abc92594bf07ea8736483abfc9b1e6097167e74df1c63f9d59c0e63"}
Sep 16 01:02:32.241230 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:32.241193    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"
Sep 16 01:02:32.242568 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:32.242542    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4" event={"ID":"d6c849f8-08cd-4fe3-8aac-625524f15901","Type":"ContainerStarted","Data":"19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474"}
Sep 16 01:02:32.242719 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:32.242586    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4" event={"ID":"d6c849f8-08cd-4fe3-8aac-625524f15901","Type":"ContainerStarted","Data":"b926c208d49722b8f7c0a59612f9b8835b189dfb0b4e4c5e2f797df44c2f62d4"}
Sep 16 01:02:32.242719 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:32.242611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"
Sep 16 01:02:32.261481 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:32.261429    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps" podStartSLOduration=1.2614099730000001 podStartE2EDuration="1.261409973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:02:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:02:32.258595436 +0000 UTC m=+1703.061418501" watchObservedRunningTime="2026-09-16 01:02:32.261409973 +0000 UTC m=+1703.064233036"
Sep 16 01:02:32.274747 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:32.274703    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4" podStartSLOduration=1.274687226 podStartE2EDuration="1.274687226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:02:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:02:32.273902188 +0000 UTC m=+1703.076725253" watchObservedRunningTime="2026-09-16 01:02:32.274687226 +0000 UTC m=+1703.077510285"
Sep 16 01:02:43.250297 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:43.250262    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"
Sep 16 01:02:43.250817 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:43.250339    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"
Sep 16 01:02:47.168800 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:47.168767    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5_c60655a4-e5aa-40b2-9892-fa0562774bc7/payload-processing/0.log"
Sep 16 01:02:47.317337 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:47.317303    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5_c60655a4-e5aa-40b2-9892-fa0562774bc7/payload-processing/0.log"
Sep 16 01:02:58.042242 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.042210    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"]
Sep 16 01:02:58.045940 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.045920    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"
Sep 16 01:02:58.048188 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.048168    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-eba3d3-dockercfg-hx5mc\""
Sep 16 01:02:58.048188 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.048184    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-eba3d3\""
Sep 16 01:02:58.058618 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.058591    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"]
Sep 16 01:02:58.123226 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.123187    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e47c79a-4e1d-4eab-84e7-491bb596474c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv\" (UID: \"0e47c79a-4e1d-4eab-84e7-491bb596474c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"
Sep 16 01:02:58.123426 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.123260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn6qd\" (UniqueName: \"kubernetes.io/projected/0e47c79a-4e1d-4eab-84e7-491bb596474c-kube-api-access-xn6qd\") pod \"payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv\" (UID: \"0e47c79a-4e1d-4eab-84e7-491bb596474c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"
Sep 16 01:02:58.223911 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.223876    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e47c79a-4e1d-4eab-84e7-491bb596474c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv\" (UID: \"0e47c79a-4e1d-4eab-84e7-491bb596474c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"
Sep 16 01:02:58.224135 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.223938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn6qd\" (UniqueName: \"kubernetes.io/projected/0e47c79a-4e1d-4eab-84e7-491bb596474c-kube-api-access-xn6qd\") pod \"payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv\" (UID: \"0e47c79a-4e1d-4eab-84e7-491bb596474c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"
Sep 16 01:02:58.224650 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.224623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e47c79a-4e1d-4eab-84e7-491bb596474c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv\" (UID: \"0e47c79a-4e1d-4eab-84e7-491bb596474c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"
Sep 16 01:02:58.232514 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.232488    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn6qd\" (UniqueName: \"kubernetes.io/projected/0e47c79a-4e1d-4eab-84e7-491bb596474c-kube-api-access-xn6qd\") pod \"payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv\" (UID: \"0e47c79a-4e1d-4eab-84e7-491bb596474c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"
Sep 16 01:02:58.357482 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.357392    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"
Sep 16 01:02:58.633459 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:58.633428    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"]
Sep 16 01:02:58.635299 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:02:58.635273    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e47c79a_4e1d_4eab_84e7_491bb596474c.slice/crio-e1f91836461b9215a476a8a9ab89cc4bbf7eb57c9f2ce5177f486e56ed6dd3e7 WatchSource:0}: Error finding container e1f91836461b9215a476a8a9ab89cc4bbf7eb57c9f2ce5177f486e56ed6dd3e7: Status 404 returned error can't find the container with id e1f91836461b9215a476a8a9ab89cc4bbf7eb57c9f2ce5177f486e56ed6dd3e7
Sep 16 01:02:59.080960 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.080923    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88"]
Sep 16 01:02:59.084602 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.084583    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88"
Sep 16 01:02:59.086897 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.086868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:02:59.087010 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.086939    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-npltg\""
Sep 16 01:02:59.091338 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.091081    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88"]
Sep 16 01:02:59.135158 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.135109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c551b1fa-fde3-43d7-b4cf-b01306c4e029-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2c31c5-glz88\" (UID: \"c551b1fa-fde3-43d7-b4cf-b01306c4e029\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88"
Sep 16 01:02:59.236125 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.236087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c551b1fa-fde3-43d7-b4cf-b01306c4e029-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2c31c5-glz88\" (UID: \"c551b1fa-fde3-43d7-b4cf-b01306c4e029\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88"
Sep 16 01:02:59.236789 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.236769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c551b1fa-fde3-43d7-b4cf-b01306c4e029-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2c31c5-glz88\" (UID: \"c551b1fa-fde3-43d7-b4cf-b01306c4e029\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88"
Sep 16 01:02:59.398793 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.398656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv" event={"ID":"0e47c79a-4e1d-4eab-84e7-491bb596474c","Type":"ContainerStarted","Data":"a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767"}
Sep 16 01:02:59.398793 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.398756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv" event={"ID":"0e47c79a-4e1d-4eab-84e7-491bb596474c","Type":"ContainerStarted","Data":"e1f91836461b9215a476a8a9ab89cc4bbf7eb57c9f2ce5177f486e56ed6dd3e7"}
Sep 16 01:02:59.399058 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.398872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88"
Sep 16 01:02:59.399058 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.398901    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"
Sep 16 01:02:59.413073 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.413015    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv" podStartSLOduration=1.41299442 podStartE2EDuration="1.41299442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:02:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:02:59.412042815 +0000 UTC m=+1730.214865880" watchObservedRunningTime="2026-09-16 01:02:59.41299442 +0000 UTC m=+1730.215817481"
Sep 16 01:02:59.679034 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:02:59.672858    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88"]
Sep 16 01:02:59.680649 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:02:59.680610    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc551b1fa_fde3_43d7_b4cf_b01306c4e029.slice/crio-377baa5cdecc9b726a68339b029664e3988617d10834f742cff84602a42c4a66 WatchSource:0}: Error finding container 377baa5cdecc9b726a68339b029664e3988617d10834f742cff84602a42c4a66: Status 404 returned error can't find the container with id 377baa5cdecc9b726a68339b029664e3988617d10834f742cff84602a42c4a66
Sep 16 01:03:00.407018 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:00.406922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88" event={"ID":"c551b1fa-fde3-43d7-b4cf-b01306c4e029","Type":"ContainerStarted","Data":"317afbdaacd95ec688c8b7730779576f0de1e679b923278c8cead033a0a48015"}
Sep 16 01:03:00.407018 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:00.406976    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88" event={"ID":"c551b1fa-fde3-43d7-b4cf-b01306c4e029","Type":"ContainerStarted","Data":"377baa5cdecc9b726a68339b029664e3988617d10834f742cff84602a42c4a66"}
Sep 16 01:03:00.421327 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:00.421278    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88" podStartSLOduration=1.421260912 podStartE2EDuration="1.421260912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:02:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:03:00.419683228 +0000 UTC m=+1731.222506285" watchObservedRunningTime="2026-09-16 01:03:00.421260912 +0000 UTC m=+1731.224083975"
Sep 16 01:03:01.414950 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:01.414914    2563 generic.go:356] "Generic (PLEG): container finished" podID="c551b1fa-fde3-43d7-b4cf-b01306c4e029" containerID="317afbdaacd95ec688c8b7730779576f0de1e679b923278c8cead033a0a48015" exitCode=0
Sep 16 01:03:01.415422 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:01.414997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88" event={"ID":"c551b1fa-fde3-43d7-b4cf-b01306c4e029","Type":"ContainerDied","Data":"317afbdaacd95ec688c8b7730779576f0de1e679b923278c8cead033a0a48015"}
Sep 16 01:03:02.564299 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:02.564275    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88"
Sep 16 01:03:02.672415 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:02.672314    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c551b1fa-fde3-43d7-b4cf-b01306c4e029-maas-api-service-ca\") pod \"c551b1fa-fde3-43d7-b4cf-b01306c4e029\" (UID: \"c551b1fa-fde3-43d7-b4cf-b01306c4e029\") "
Sep 16 01:03:02.672766 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:02.672736    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c551b1fa-fde3-43d7-b4cf-b01306c4e029-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c551b1fa-fde3-43d7-b4cf-b01306c4e029" (UID: "c551b1fa-fde3-43d7-b4cf-b01306c4e029"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:03:02.773277 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:02.773234    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c551b1fa-fde3-43d7-b4cf-b01306c4e029-maas-api-service-ca\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:03.427079 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:03.427051    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88"
Sep 16 01:03:03.427294 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:03.427098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88" event={"ID":"c551b1fa-fde3-43d7-b4cf-b01306c4e029","Type":"ContainerDied","Data":"377baa5cdecc9b726a68339b029664e3988617d10834f742cff84602a42c4a66"}
Sep 16 01:03:03.427294 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:03.427149    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="377baa5cdecc9b726a68339b029664e3988617d10834f742cff84602a42c4a66"
Sep 16 01:03:10.409581 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:10.409544    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"
Sep 16 01:03:11.567610 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:11.567573    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4"]
Sep 16 01:03:11.568089 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:11.568074    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c551b1fa-fde3-43d7-b4cf-b01306c4e029" containerName="revoke-keys"
Sep 16 01:03:11.568134 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:11.568091    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c551b1fa-fde3-43d7-b4cf-b01306c4e029" containerName="revoke-keys"
Sep 16 01:03:11.568182 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:11.568174    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c551b1fa-fde3-43d7-b4cf-b01306c4e029" containerName="revoke-keys"
Sep 16 01:03:11.571416 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:11.571398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4"
Sep 16 01:03:11.573553 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:11.573527    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-npltg\""
Sep 16 01:03:11.573553 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:11.573544    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:03:11.577989 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:11.577964    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4"]
Sep 16 01:03:11.662092 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:11.662058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d981d51-45f0-40a5-bbe2-17b1ba3fb72b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4\" (UID: \"2d981d51-45f0-40a5-bbe2-17b1ba3fb72b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4"
Sep 16 01:03:11.763598 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:11.763560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d981d51-45f0-40a5-bbe2-17b1ba3fb72b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4\" (UID: \"2d981d51-45f0-40a5-bbe2-17b1ba3fb72b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4"
Sep 16 01:03:11.764208 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:11.764185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d981d51-45f0-40a5-bbe2-17b1ba3fb72b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4\" (UID: \"2d981d51-45f0-40a5-bbe2-17b1ba3fb72b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4"
Sep 16 01:03:11.886172 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:11.886077    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4"
Sep 16 01:03:12.159565 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:12.159535    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4"]
Sep 16 01:03:12.161312 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:03:12.161282    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d981d51_45f0_40a5_bbe2_17b1ba3fb72b.slice/crio-9d7ed4c77f9e19a9e600e985346b7a01eb229151545465238eecf99ecc247264 WatchSource:0}: Error finding container 9d7ed4c77f9e19a9e600e985346b7a01eb229151545465238eecf99ecc247264: Status 404 returned error can't find the container with id 9d7ed4c77f9e19a9e600e985346b7a01eb229151545465238eecf99ecc247264
Sep 16 01:03:12.479592 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:12.479558    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4" event={"ID":"2d981d51-45f0-40a5-bbe2-17b1ba3fb72b","Type":"ContainerStarted","Data":"9d7ed4c77f9e19a9e600e985346b7a01eb229151545465238eecf99ecc247264"}
Sep 16 01:03:13.487609 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:13.487572    2563 generic.go:356] "Generic (PLEG): container finished" podID="2d981d51-45f0-40a5-bbe2-17b1ba3fb72b" containerID="17979a7c7067b8096ad28418082ff90066338c710fc946c2e6f12242da6c1743" exitCode=0
Sep 16 01:03:13.488036 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:13.487645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4" event={"ID":"2d981d51-45f0-40a5-bbe2-17b1ba3fb72b","Type":"ContainerDied","Data":"17979a7c7067b8096ad28418082ff90066338c710fc946c2e6f12242da6c1743"}
Sep 16 01:03:14.630236 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:14.630212    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4"
Sep 16 01:03:14.796507 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:14.796417    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d981d51-45f0-40a5-bbe2-17b1ba3fb72b-maas-api-service-ca\") pod \"2d981d51-45f0-40a5-bbe2-17b1ba3fb72b\" (UID: \"2d981d51-45f0-40a5-bbe2-17b1ba3fb72b\") "
Sep 16 01:03:14.796887 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:14.796858    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d981d51-45f0-40a5-bbe2-17b1ba3fb72b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d981d51-45f0-40a5-bbe2-17b1ba3fb72b" (UID: "2d981d51-45f0-40a5-bbe2-17b1ba3fb72b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:03:14.898254 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:14.898212    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d981d51-45f0-40a5-bbe2-17b1ba3fb72b-maas-api-service-ca\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:15.500039 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:15.500008    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4"
Sep 16 01:03:15.500213 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:15.500047    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4" event={"ID":"2d981d51-45f0-40a5-bbe2-17b1ba3fb72b","Type":"ContainerDied","Data":"9d7ed4c77f9e19a9e600e985346b7a01eb229151545465238eecf99ecc247264"}
Sep 16 01:03:15.500213 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:15.500121    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d7ed4c77f9e19a9e600e985346b7a01eb229151545465238eecf99ecc247264"
Sep 16 01:03:19.329256 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.329213    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"]
Sep 16 01:03:19.329778 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.329438    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75" podUID="a78a2465-aab5-46cd-a268-603a42c4f088" containerName="payload-processing" containerID="cri-o://38259580bc4ea6630925d6923b4af71ca386e7cec0cf5a120f3b3044e7569011" gracePeriod=30
Sep 16 01:03:19.337179 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.336590    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"]
Sep 16 01:03:19.337179 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.336881    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm" podUID="b4b0ff65-4653-48db-956d-bf95e10a29de" containerName="payload-pre-processing" containerID="cri-o://72b85e59c8b260e0b76d282abbd470859fe11b5fc6d61670f2e569ff9c08b9e9" gracePeriod=30
Sep 16 01:03:19.506691 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.506563    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88"]
Sep 16 01:03:19.510252 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.510203    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2c31c5-glz88"]
Sep 16 01:03:19.526186 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.526156    2563 generic.go:356] "Generic (PLEG): container finished" podID="b4b0ff65-4653-48db-956d-bf95e10a29de" containerID="72b85e59c8b260e0b76d282abbd470859fe11b5fc6d61670f2e569ff9c08b9e9" exitCode=0
Sep 16 01:03:19.526336 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.526234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm" event={"ID":"b4b0ff65-4653-48db-956d-bf95e10a29de","Type":"ContainerDied","Data":"72b85e59c8b260e0b76d282abbd470859fe11b5fc6d61670f2e569ff9c08b9e9"}
Sep 16 01:03:19.528058 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.528035    2563 generic.go:356] "Generic (PLEG): container finished" podID="a78a2465-aab5-46cd-a268-603a42c4f088" containerID="38259580bc4ea6630925d6923b4af71ca386e7cec0cf5a120f3b3044e7569011" exitCode=0
Sep 16 01:03:19.528179 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.528087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75" event={"ID":"a78a2465-aab5-46cd-a268-603a42c4f088","Type":"ContainerDied","Data":"38259580bc4ea6630925d6923b4af71ca386e7cec0cf5a120f3b3044e7569011"}
Sep 16 01:03:19.625421 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.625391    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"
Sep 16 01:03:19.628573 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.628551    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"
Sep 16 01:03:19.647382 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.647359    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlksj\" (UniqueName: \"kubernetes.io/projected/b4b0ff65-4653-48db-956d-bf95e10a29de-kube-api-access-mlksj\") pod \"b4b0ff65-4653-48db-956d-bf95e10a29de\" (UID: \"b4b0ff65-4653-48db-956d-bf95e10a29de\") "
Sep 16 01:03:19.647535 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.647392    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4b0ff65-4653-48db-956d-bf95e10a29de-plugins-config-volume\") pod \"b4b0ff65-4653-48db-956d-bf95e10a29de\" (UID: \"b4b0ff65-4653-48db-956d-bf95e10a29de\") "
Sep 16 01:03:19.647535 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.647476    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr2ld\" (UniqueName: \"kubernetes.io/projected/a78a2465-aab5-46cd-a268-603a42c4f088-kube-api-access-zr2ld\") pod \"a78a2465-aab5-46cd-a268-603a42c4f088\" (UID: \"a78a2465-aab5-46cd-a268-603a42c4f088\") "
Sep 16 01:03:19.647535 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.647504    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a78a2465-aab5-46cd-a268-603a42c4f088-plugins-config-volume\") pod \"a78a2465-aab5-46cd-a268-603a42c4f088\" (UID: \"a78a2465-aab5-46cd-a268-603a42c4f088\") "
Sep 16 01:03:19.648036 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.648013    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4b0ff65-4653-48db-956d-bf95e10a29de-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b4b0ff65-4653-48db-956d-bf95e10a29de" (UID: "b4b0ff65-4653-48db-956d-bf95e10a29de"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:03:19.648250 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.648224    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a78a2465-aab5-46cd-a268-603a42c4f088-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a78a2465-aab5-46cd-a268-603a42c4f088" (UID: "a78a2465-aab5-46cd-a268-603a42c4f088"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:03:19.649984 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.649953    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4b0ff65-4653-48db-956d-bf95e10a29de-kube-api-access-mlksj" (OuterVolumeSpecName: "kube-api-access-mlksj") pod "b4b0ff65-4653-48db-956d-bf95e10a29de" (UID: "b4b0ff65-4653-48db-956d-bf95e10a29de"). InnerVolumeSpecName "kube-api-access-mlksj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:03:19.650089 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.649998    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a78a2465-aab5-46cd-a268-603a42c4f088-kube-api-access-zr2ld" (OuterVolumeSpecName: "kube-api-access-zr2ld") pod "a78a2465-aab5-46cd-a268-603a42c4f088" (UID: "a78a2465-aab5-46cd-a268-603a42c4f088"). InnerVolumeSpecName "kube-api-access-zr2ld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:03:19.670727 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.670694    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c551b1fa-fde3-43d7-b4cf-b01306c4e029" path="/var/lib/kubelet/pods/c551b1fa-fde3-43d7-b4cf-b01306c4e029/volumes"
Sep 16 01:03:19.749204 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.749168    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlksj\" (UniqueName: \"kubernetes.io/projected/b4b0ff65-4653-48db-956d-bf95e10a29de-kube-api-access-mlksj\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:19.749204 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.749197    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4b0ff65-4653-48db-956d-bf95e10a29de-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:19.749204 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.749208    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr2ld\" (UniqueName: \"kubernetes.io/projected/a78a2465-aab5-46cd-a268-603a42c4f088-kube-api-access-zr2ld\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:19.749450 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:19.749216    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a78a2465-aab5-46cd-a268-603a42c4f088-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:20.534727 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:20.534696    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"
Sep 16 01:03:20.534727 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:20.534705    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75" event={"ID":"a78a2465-aab5-46cd-a268-603a42c4f088","Type":"ContainerDied","Data":"cc01862a917454925a9b443839c06383db3dce57329b5d98cd4cd3a9fce866ea"}
Sep 16 01:03:20.535284 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:20.534816    2563 scope.go:117] "RemoveContainer" containerID="38259580bc4ea6630925d6923b4af71ca386e7cec0cf5a120f3b3044e7569011"
Sep 16 01:03:20.536360 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:20.536130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm" event={"ID":"b4b0ff65-4653-48db-956d-bf95e10a29de","Type":"ContainerDied","Data":"6dc2c59761b2018a893c0e2bdd336273391367082a8dde7313515ffa1679b340"}
Sep 16 01:03:20.536360 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:20.536150    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"
Sep 16 01:03:20.544738 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:20.544721    2563 scope.go:117] "RemoveContainer" containerID="72b85e59c8b260e0b76d282abbd470859fe11b5fc6d61670f2e569ff9c08b9e9"
Sep 16 01:03:20.552831 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:20.552802    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"]
Sep 16 01:03:20.561129 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:20.561098    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2c31c5-ddf6f9cdb-xjxwm"]
Sep 16 01:03:20.570617 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:20.570586    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"]
Sep 16 01:03:20.574595 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:20.574565    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2c31c5-75db6f9665-dmp75"]
Sep 16 01:03:21.668495 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:21.668458    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a78a2465-aab5-46cd-a268-603a42c4f088" path="/var/lib/kubelet/pods/a78a2465-aab5-46cd-a268-603a42c4f088/volumes"
Sep 16 01:03:21.669020 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:21.668992    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4b0ff65-4653-48db-956d-bf95e10a29de" path="/var/lib/kubelet/pods/b4b0ff65-4653-48db-956d-bf95e10a29de/volumes"
Sep 16 01:03:25.060509 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.060474    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"]
Sep 16 01:03:25.061113 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.061079    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv" podUID="0e47c79a-4e1d-4eab-84e7-491bb596474c" containerName="payload-pre-processing" containerID="cri-o://a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767" gracePeriod=30
Sep 16 01:03:25.225345 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.225301    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4"]
Sep 16 01:03:25.227588 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.227559    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eba3d3-2ttw4"]
Sep 16 01:03:25.323029 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.322957    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"
Sep 16 01:03:25.406504 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.406475    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn6qd\" (UniqueName: \"kubernetes.io/projected/0e47c79a-4e1d-4eab-84e7-491bb596474c-kube-api-access-xn6qd\") pod \"0e47c79a-4e1d-4eab-84e7-491bb596474c\" (UID: \"0e47c79a-4e1d-4eab-84e7-491bb596474c\") "
Sep 16 01:03:25.406780 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.406578    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e47c79a-4e1d-4eab-84e7-491bb596474c-plugins-config-volume\") pod \"0e47c79a-4e1d-4eab-84e7-491bb596474c\" (UID: \"0e47c79a-4e1d-4eab-84e7-491bb596474c\") "
Sep 16 01:03:25.407007 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.406982    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e47c79a-4e1d-4eab-84e7-491bb596474c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e47c79a-4e1d-4eab-84e7-491bb596474c" (UID: "0e47c79a-4e1d-4eab-84e7-491bb596474c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:03:25.408903 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.408877    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e47c79a-4e1d-4eab-84e7-491bb596474c-kube-api-access-xn6qd" (OuterVolumeSpecName: "kube-api-access-xn6qd") pod "0e47c79a-4e1d-4eab-84e7-491bb596474c" (UID: "0e47c79a-4e1d-4eab-84e7-491bb596474c"). InnerVolumeSpecName "kube-api-access-xn6qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:03:25.511887 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.508902    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn6qd\" (UniqueName: \"kubernetes.io/projected/0e47c79a-4e1d-4eab-84e7-491bb596474c-kube-api-access-xn6qd\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:25.511887 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.508936    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e47c79a-4e1d-4eab-84e7-491bb596474c-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:25.568099 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.568054    2563 generic.go:356] "Generic (PLEG): container finished" podID="0e47c79a-4e1d-4eab-84e7-491bb596474c" containerID="a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767" exitCode=0
Sep 16 01:03:25.568283 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.568169    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"
Sep 16 01:03:25.568283 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.568196    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv" event={"ID":"0e47c79a-4e1d-4eab-84e7-491bb596474c","Type":"ContainerDied","Data":"a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767"}
Sep 16 01:03:25.568431 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.568295    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv" event={"ID":"0e47c79a-4e1d-4eab-84e7-491bb596474c","Type":"ContainerDied","Data":"e1f91836461b9215a476a8a9ab89cc4bbf7eb57c9f2ce5177f486e56ed6dd3e7"}
Sep 16 01:03:25.568431 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.568329    2563 scope.go:117] "RemoveContainer" containerID="a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767"
Sep 16 01:03:25.578091 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.578074    2563 scope.go:117] "RemoveContainer" containerID="a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767"
Sep 16 01:03:25.578412 ip-10-0-136-16 kubenswrapper[2563]: E0916 01:03:25.578392    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767\": container with ID starting with a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767 not found: ID does not exist" containerID="a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767"
Sep 16 01:03:25.578470 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.578423    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767"} err="failed to get container status \"a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767\": rpc error: code = NotFound desc = could not find container \"a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767\": container with ID starting with a4565fc758efee0b7bff152b5103dad23d45913311ad6fd954f617bd24ceb767 not found: ID does not exist"
Sep 16 01:03:25.593376 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.593342    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"]
Sep 16 01:03:25.597628 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.597600    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eba3d3-65f7fcd4db-4dwxv"]
Sep 16 01:03:25.668788 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.668744    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e47c79a-4e1d-4eab-84e7-491bb596474c" path="/var/lib/kubelet/pods/0e47c79a-4e1d-4eab-84e7-491bb596474c/volumes"
Sep 16 01:03:25.669214 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:25.669192    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d981d51-45f0-40a5-bbe2-17b1ba3fb72b" path="/var/lib/kubelet/pods/2d981d51-45f0-40a5-bbe2-17b1ba3fb72b/volumes"
Sep 16 01:03:27.603399 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.603356    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp"]
Sep 16 01:03:27.603983 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.603963    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a78a2465-aab5-46cd-a268-603a42c4f088" containerName="payload-processing"
Sep 16 01:03:27.604086 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.603986    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a78a2465-aab5-46cd-a268-603a42c4f088" containerName="payload-processing"
Sep 16 01:03:27.604086 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.604001    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e47c79a-4e1d-4eab-84e7-491bb596474c" containerName="payload-pre-processing"
Sep 16 01:03:27.604086 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.604033    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e47c79a-4e1d-4eab-84e7-491bb596474c" containerName="payload-pre-processing"
Sep 16 01:03:27.604086 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.604046    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d981d51-45f0-40a5-bbe2-17b1ba3fb72b" containerName="revoke-keys"
Sep 16 01:03:27.604086 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.604055    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d981d51-45f0-40a5-bbe2-17b1ba3fb72b" containerName="revoke-keys"
Sep 16 01:03:27.604348 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.604092    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4b0ff65-4653-48db-956d-bf95e10a29de" containerName="payload-pre-processing"
Sep 16 01:03:27.604348 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.604101    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4b0ff65-4653-48db-956d-bf95e10a29de" containerName="payload-pre-processing"
Sep 16 01:03:27.604348 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.604197    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a78a2465-aab5-46cd-a268-603a42c4f088" containerName="payload-processing"
Sep 16 01:03:27.604348 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.604209    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d981d51-45f0-40a5-bbe2-17b1ba3fb72b" containerName="revoke-keys"
Sep 16 01:03:27.604348 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.604221    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e47c79a-4e1d-4eab-84e7-491bb596474c" containerName="payload-pre-processing"
Sep 16 01:03:27.604348 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.604230    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4b0ff65-4653-48db-956d-bf95e10a29de" containerName="payload-pre-processing"
Sep 16 01:03:27.607647 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.607623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp"
Sep 16 01:03:27.609882 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.609827    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:03:27.610027 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.609927    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-npltg\""
Sep 16 01:03:27.612110 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.612083    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp"]
Sep 16 01:03:27.731244 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.731204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-761551-x5tzp\" (UID: \"61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp"
Sep 16 01:03:27.832257 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.832223    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-761551-x5tzp\" (UID: \"61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp"
Sep 16 01:03:27.832899 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.832881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-761551-x5tzp\" (UID: \"61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp"
Sep 16 01:03:27.921457 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:27.921372    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp"
Sep 16 01:03:28.192714 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:28.192685    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp"]
Sep 16 01:03:28.194164 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:03:28.194128    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b1b2fc_d4b4_4543_b0c3_1ce976fa49c1.slice/crio-9045dedc84803d9c55cccf010e34ca645290274db47ba3cda2c1a945afc19653 WatchSource:0}: Error finding container 9045dedc84803d9c55cccf010e34ca645290274db47ba3cda2c1a945afc19653: Status 404 returned error can't find the container with id 9045dedc84803d9c55cccf010e34ca645290274db47ba3cda2c1a945afc19653
Sep 16 01:03:28.588217 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:28.588177    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp" event={"ID":"61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1","Type":"ContainerStarted","Data":"d0e146708d2b7a1cee1a139eeb4aabd7f6405e402b8b08425c5b3d221dc48d02"}
Sep 16 01:03:28.588418 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:28.588233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp" event={"ID":"61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1","Type":"ContainerStarted","Data":"9045dedc84803d9c55cccf010e34ca645290274db47ba3cda2c1a945afc19653"}
Sep 16 01:03:28.606139 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:28.606087    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp" podStartSLOduration=1.6060693270000002 podStartE2EDuration="1.606069327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:03:28.605076923 +0000 UTC m=+1759.407899988" watchObservedRunningTime="2026-09-16 01:03:28.606069327 +0000 UTC m=+1759.408892392"
Sep 16 01:03:29.594899 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:29.594865    2563 generic.go:356] "Generic (PLEG): container finished" podID="61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1" containerID="d0e146708d2b7a1cee1a139eeb4aabd7f6405e402b8b08425c5b3d221dc48d02" exitCode=0
Sep 16 01:03:29.595077 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:29.594957    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp" event={"ID":"61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1","Type":"ContainerDied","Data":"d0e146708d2b7a1cee1a139eeb4aabd7f6405e402b8b08425c5b3d221dc48d02"}
Sep 16 01:03:30.739967 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:30.739939    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp"
Sep 16 01:03:30.861120 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:30.861037    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1-maas-api-service-ca\") pod \"61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1\" (UID: \"61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1\") "
Sep 16 01:03:30.861402 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:30.861377    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1" (UID: "61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:03:30.962340 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:30.962304    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1-maas-api-service-ca\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:31.607744 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:31.607708    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp"
Sep 16 01:03:31.607744 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:31.607723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp" event={"ID":"61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1","Type":"ContainerDied","Data":"9045dedc84803d9c55cccf010e34ca645290274db47ba3cda2c1a945afc19653"}
Sep 16 01:03:31.607953 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:31.607771    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9045dedc84803d9c55cccf010e34ca645290274db47ba3cda2c1a945afc19653"
Sep 16 01:03:36.172264 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.172224    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965"]
Sep 16 01:03:36.172693 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.172677    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1" containerName="revoke-keys"
Sep 16 01:03:36.172693 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.172692    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1" containerName="revoke-keys"
Sep 16 01:03:36.172787 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.172763    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1" containerName="revoke-keys"
Sep 16 01:03:36.175833 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.175817    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965"
Sep 16 01:03:36.177983 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.177960    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:03:36.178134 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.177962    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-npltg\""
Sep 16 01:03:36.182115 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.182090    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965"]
Sep 16 01:03:36.315311 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.315267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bd4a66-b1e0-4e36-936b-41ed4f24cc9e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-715834-fr965\" (UID: \"36bd4a66-b1e0-4e36-936b-41ed4f24cc9e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965"
Sep 16 01:03:36.416192 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.416151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bd4a66-b1e0-4e36-936b-41ed4f24cc9e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-715834-fr965\" (UID: \"36bd4a66-b1e0-4e36-936b-41ed4f24cc9e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965"
Sep 16 01:03:36.416822 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.416801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bd4a66-b1e0-4e36-936b-41ed4f24cc9e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-715834-fr965\" (UID: \"36bd4a66-b1e0-4e36-936b-41ed4f24cc9e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965"
Sep 16 01:03:36.490782 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.490738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965"
Sep 16 01:03:36.767101 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:36.767076    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965"]
Sep 16 01:03:36.769284 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:03:36.769242    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bd4a66_b1e0_4e36_936b_41ed4f24cc9e.slice/crio-715780756c3b42b8bfe79b88aa9d108c37107759ba75aee06a00f2c6523afa8f WatchSource:0}: Error finding container 715780756c3b42b8bfe79b88aa9d108c37107759ba75aee06a00f2c6523afa8f: Status 404 returned error can't find the container with id 715780756c3b42b8bfe79b88aa9d108c37107759ba75aee06a00f2c6523afa8f
Sep 16 01:03:37.642112 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:37.642075    2563 generic.go:356] "Generic (PLEG): container finished" podID="36bd4a66-b1e0-4e36-936b-41ed4f24cc9e" containerID="27147c395bd891f235def62e57a538bafd82f4dc1f9abcb91c672eb1249fc989" exitCode=0
Sep 16 01:03:37.642527 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:37.642170    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965" event={"ID":"36bd4a66-b1e0-4e36-936b-41ed4f24cc9e","Type":"ContainerDied","Data":"27147c395bd891f235def62e57a538bafd82f4dc1f9abcb91c672eb1249fc989"}
Sep 16 01:03:37.642527 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:37.642232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965" event={"ID":"36bd4a66-b1e0-4e36-936b-41ed4f24cc9e","Type":"ContainerStarted","Data":"715780756c3b42b8bfe79b88aa9d108c37107759ba75aee06a00f2c6523afa8f"}
Sep 16 01:03:38.784826 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:38.784801    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965"
Sep 16 01:03:38.940909 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:38.940819    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bd4a66-b1e0-4e36-936b-41ed4f24cc9e-maas-api-service-ca\") pod \"36bd4a66-b1e0-4e36-936b-41ed4f24cc9e\" (UID: \"36bd4a66-b1e0-4e36-936b-41ed4f24cc9e\") "
Sep 16 01:03:38.941191 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:38.941168    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36bd4a66-b1e0-4e36-936b-41ed4f24cc9e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "36bd4a66-b1e0-4e36-936b-41ed4f24cc9e" (UID: "36bd4a66-b1e0-4e36-936b-41ed4f24cc9e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:03:39.042585 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:39.042549    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bd4a66-b1e0-4e36-936b-41ed4f24cc9e-maas-api-service-ca\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:39.654039 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:39.654003    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965"
Sep 16 01:03:39.654039 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:39.654024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965" event={"ID":"36bd4a66-b1e0-4e36-936b-41ed4f24cc9e","Type":"ContainerDied","Data":"715780756c3b42b8bfe79b88aa9d108c37107759ba75aee06a00f2c6523afa8f"}
Sep 16 01:03:39.654266 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:39.654079    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="715780756c3b42b8bfe79b88aa9d108c37107759ba75aee06a00f2c6523afa8f"
Sep 16 01:03:44.625982 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:44.625945    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"]
Sep 16 01:03:44.626483 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:44.626434    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4" podUID="d6c849f8-08cd-4fe3-8aac-625524f15901" containerName="payload-processing" containerID="cri-o://19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474" gracePeriod=30
Sep 16 01:03:44.634972 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:44.634531    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"]
Sep 16 01:03:44.634972 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:44.634782    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps" podUID="6a6647ab-3d51-4ece-853e-99c8580fb1db" containerName="payload-pre-processing" containerID="cri-o://451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59" gracePeriod=30
Sep 16 01:03:44.793817 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:44.793780    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp"]
Sep 16 01:03:44.795958 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:44.795935    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-761551-x5tzp"]
Sep 16 01:03:44.929873 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:44.929847    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"
Sep 16 01:03:44.934021 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:44.933999    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"
Sep 16 01:03:45.104759 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.104716    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6647ab-3d51-4ece-853e-99c8580fb1db-plugins-config-volume\") pod \"6a6647ab-3d51-4ece-853e-99c8580fb1db\" (UID: \"6a6647ab-3d51-4ece-853e-99c8580fb1db\") "
Sep 16 01:03:45.104759 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.104759    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6c849f8-08cd-4fe3-8aac-625524f15901-plugins-config-volume\") pod \"d6c849f8-08cd-4fe3-8aac-625524f15901\" (UID: \"d6c849f8-08cd-4fe3-8aac-625524f15901\") "
Sep 16 01:03:45.105030 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.104780    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckdrf\" (UniqueName: \"kubernetes.io/projected/6a6647ab-3d51-4ece-853e-99c8580fb1db-kube-api-access-ckdrf\") pod \"6a6647ab-3d51-4ece-853e-99c8580fb1db\" (UID: \"6a6647ab-3d51-4ece-853e-99c8580fb1db\") "
Sep 16 01:03:45.105030 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.104809    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdbtq\" (UniqueName: \"kubernetes.io/projected/d6c849f8-08cd-4fe3-8aac-625524f15901-kube-api-access-sdbtq\") pod \"d6c849f8-08cd-4fe3-8aac-625524f15901\" (UID: \"d6c849f8-08cd-4fe3-8aac-625524f15901\") "
Sep 16 01:03:45.105178 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.105154    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a6647ab-3d51-4ece-853e-99c8580fb1db-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a6647ab-3d51-4ece-853e-99c8580fb1db" (UID: "6a6647ab-3d51-4ece-853e-99c8580fb1db"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:03:45.105227 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.105173    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6c849f8-08cd-4fe3-8aac-625524f15901-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6c849f8-08cd-4fe3-8aac-625524f15901" (UID: "d6c849f8-08cd-4fe3-8aac-625524f15901"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:03:45.107102 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.107082    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6647ab-3d51-4ece-853e-99c8580fb1db-kube-api-access-ckdrf" (OuterVolumeSpecName: "kube-api-access-ckdrf") pod "6a6647ab-3d51-4ece-853e-99c8580fb1db" (UID: "6a6647ab-3d51-4ece-853e-99c8580fb1db"). InnerVolumeSpecName "kube-api-access-ckdrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:03:45.107168 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.107102    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6c849f8-08cd-4fe3-8aac-625524f15901-kube-api-access-sdbtq" (OuterVolumeSpecName: "kube-api-access-sdbtq") pod "d6c849f8-08cd-4fe3-8aac-625524f15901" (UID: "d6c849f8-08cd-4fe3-8aac-625524f15901"). InnerVolumeSpecName "kube-api-access-sdbtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:03:45.205656 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.205616    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6647ab-3d51-4ece-853e-99c8580fb1db-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:45.205656 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.205652    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6c849f8-08cd-4fe3-8aac-625524f15901-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:45.205656 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.205678    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckdrf\" (UniqueName: \"kubernetes.io/projected/6a6647ab-3d51-4ece-853e-99c8580fb1db-kube-api-access-ckdrf\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:45.205656 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.205690    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdbtq\" (UniqueName: \"kubernetes.io/projected/d6c849f8-08cd-4fe3-8aac-625524f15901-kube-api-access-sdbtq\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:45.668989 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.668946    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1" path="/var/lib/kubelet/pods/61b1b2fc-d4b4-4543-b0c3-1ce976fa49c1/volumes"
Sep 16 01:03:45.689057 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.689027    2563 generic.go:356] "Generic (PLEG): container finished" podID="6a6647ab-3d51-4ece-853e-99c8580fb1db" containerID="451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59" exitCode=0
Sep 16 01:03:45.689213 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.689074    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"
Sep 16 01:03:45.689213 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.689116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps" event={"ID":"6a6647ab-3d51-4ece-853e-99c8580fb1db","Type":"ContainerDied","Data":"451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59"}
Sep 16 01:03:45.689213 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.689169    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps" event={"ID":"6a6647ab-3d51-4ece-853e-99c8580fb1db","Type":"ContainerDied","Data":"f60baacf1abc92594bf07ea8736483abfc9b1e6097167e74df1c63f9d59c0e63"}
Sep 16 01:03:45.689213 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.689199    2563 scope.go:117] "RemoveContainer" containerID="451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59"
Sep 16 01:03:45.690680 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.690609    2563 generic.go:356] "Generic (PLEG): container finished" podID="d6c849f8-08cd-4fe3-8aac-625524f15901" containerID="19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474" exitCode=0
Sep 16 01:03:45.690680 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.690656    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"
Sep 16 01:03:45.690819 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.690698    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4" event={"ID":"d6c849f8-08cd-4fe3-8aac-625524f15901","Type":"ContainerDied","Data":"19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474"}
Sep 16 01:03:45.690819 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.690751    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4" event={"ID":"d6c849f8-08cd-4fe3-8aac-625524f15901","Type":"ContainerDied","Data":"b926c208d49722b8f7c0a59612f9b8835b189dfb0b4e4c5e2f797df44c2f62d4"}
Sep 16 01:03:45.699558 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.699535    2563 scope.go:117] "RemoveContainer" containerID="451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59"
Sep 16 01:03:45.699853 ip-10-0-136-16 kubenswrapper[2563]: E0916 01:03:45.699835    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59\": container with ID starting with 451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59 not found: ID does not exist" containerID="451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59"
Sep 16 01:03:45.699920 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.699862    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59"} err="failed to get container status \"451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59\": rpc error: code = NotFound desc = could not find container \"451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59\": container with ID starting with 451f5922a41471c67aa64b135ba17dd2d46f8ce88368960c6df6fc09e3317b59 not found: ID does not exist"
Sep 16 01:03:45.699920 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.699877    2563 scope.go:117] "RemoveContainer" containerID="19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474"
Sep 16 01:03:45.707206 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.707177    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"]
Sep 16 01:03:45.709209 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.709179    2563 scope.go:117] "RemoveContainer" containerID="19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474"
Sep 16 01:03:45.709333 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.709312    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-761551-5c64678db7-z2jh4"]
Sep 16 01:03:45.709481 ip-10-0-136-16 kubenswrapper[2563]: E0916 01:03:45.709463    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474\": container with ID starting with 19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474 not found: ID does not exist" containerID="19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474"
Sep 16 01:03:45.709520 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.709489    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474"} err="failed to get container status \"19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474\": rpc error: code = NotFound desc = could not find container \"19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474\": container with ID starting with 19c01ced925974994c59c7c417e363fd144dcccf7aabdee52789b4ed1f77f474 not found: ID does not exist"
Sep 16 01:03:45.718202 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.718174    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"]
Sep 16 01:03:45.720108 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:45.720088    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-761551-fbc689c5d-k62ps"]
Sep 16 01:03:47.668302 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:47.668268    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a6647ab-3d51-4ece-853e-99c8580fb1db" path="/var/lib/kubelet/pods/6a6647ab-3d51-4ece-853e-99c8580fb1db/volumes"
Sep 16 01:03:47.668708 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:47.668626    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6c849f8-08cd-4fe3-8aac-625524f15901" path="/var/lib/kubelet/pods/d6c849f8-08cd-4fe3-8aac-625524f15901/volumes"
Sep 16 01:03:51.528405 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.528368    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5"]
Sep 16 01:03:51.528818 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.528780    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a6647ab-3d51-4ece-853e-99c8580fb1db" containerName="payload-pre-processing"
Sep 16 01:03:51.528818 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.528792    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a6647ab-3d51-4ece-853e-99c8580fb1db" containerName="payload-pre-processing"
Sep 16 01:03:51.528818 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.528806    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6c849f8-08cd-4fe3-8aac-625524f15901" containerName="payload-processing"
Sep 16 01:03:51.528818 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.528813    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6c849f8-08cd-4fe3-8aac-625524f15901" containerName="payload-processing"
Sep 16 01:03:51.528818 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.528818    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36bd4a66-b1e0-4e36-936b-41ed4f24cc9e" containerName="revoke-keys"
Sep 16 01:03:51.528997 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.528825    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="36bd4a66-b1e0-4e36-936b-41ed4f24cc9e" containerName="revoke-keys"
Sep 16 01:03:51.528997 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.528897    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a6647ab-3d51-4ece-853e-99c8580fb1db" containerName="payload-pre-processing"
Sep 16 01:03:51.528997 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.528904    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="36bd4a66-b1e0-4e36-936b-41ed4f24cc9e" containerName="revoke-keys"
Sep 16 01:03:51.528997 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.528914    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6c849f8-08cd-4fe3-8aac-625524f15901" containerName="payload-processing"
Sep 16 01:03:51.533982 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.533964    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5"
Sep 16 01:03:51.536530 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.536504    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-npltg\""
Sep 16 01:03:51.536713 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.536505    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:03:51.538954 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.538928    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5"]
Sep 16 01:03:51.570975 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.570943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a01b74-a628-4165-a888-7da9c3cb01fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5\" (UID: \"a0a01b74-a628-4165-a888-7da9c3cb01fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5"
Sep 16 01:03:51.671787 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.671757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a01b74-a628-4165-a888-7da9c3cb01fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5\" (UID: \"a0a01b74-a628-4165-a888-7da9c3cb01fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5"
Sep 16 01:03:51.672365 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.672336    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a01b74-a628-4165-a888-7da9c3cb01fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5\" (UID: \"a0a01b74-a628-4165-a888-7da9c3cb01fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5"
Sep 16 01:03:51.847494 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:51.847407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5"
Sep 16 01:03:52.119294 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.119268    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5"]
Sep 16 01:03:52.122412 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:03:52.122381    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a01b74_a628_4165_a888_7da9c3cb01fc.slice/crio-0f48b2f2ca7fdee0353b01f624ede5fc9f168dbe24d6229ea8e7396ee30a428c WatchSource:0}: Error finding container 0f48b2f2ca7fdee0353b01f624ede5fc9f168dbe24d6229ea8e7396ee30a428c: Status 404 returned error can't find the container with id 0f48b2f2ca7fdee0353b01f624ede5fc9f168dbe24d6229ea8e7396ee30a428c
Sep 16 01:03:52.608315 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.608280    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"]
Sep 16 01:03:52.608752 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.608524    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph" podUID="4e1f3b0e-8177-4455-aec4-72b403c69673" containerName="payload-pre-processing" containerID="cri-o://6f9abe7d7cfacf331247a2a162ff999a5b01dec7d9e65f1d451bbbfdffd32a3a" gracePeriod=30
Sep 16 01:03:52.733486 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.733450    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e1f3b0e-8177-4455-aec4-72b403c69673" containerID="6f9abe7d7cfacf331247a2a162ff999a5b01dec7d9e65f1d451bbbfdffd32a3a" exitCode=0
Sep 16 01:03:52.733624 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.733533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph" event={"ID":"4e1f3b0e-8177-4455-aec4-72b403c69673","Type":"ContainerDied","Data":"6f9abe7d7cfacf331247a2a162ff999a5b01dec7d9e65f1d451bbbfdffd32a3a"}
Sep 16 01:03:52.735320 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.735297    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5" event={"ID":"a0a01b74-a628-4165-a888-7da9c3cb01fc","Type":"ContainerStarted","Data":"49403858f4dec3fe10875546383be2553476a5804c8453feda644e4278c18d4c"}
Sep 16 01:03:52.735444 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.735337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5" event={"ID":"a0a01b74-a628-4165-a888-7da9c3cb01fc","Type":"ContainerStarted","Data":"0f48b2f2ca7fdee0353b01f624ede5fc9f168dbe24d6229ea8e7396ee30a428c"}
Sep 16 01:03:52.750589 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.750515    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5" podStartSLOduration=1.7504888090000001 podStartE2EDuration="1.750488809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:03:52.748771088 +0000 UTC m=+1783.551594153" watchObservedRunningTime="2026-09-16 01:03:52.750488809 +0000 UTC m=+1783.553311876"
Sep 16 01:03:52.793376 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.793343    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965"]
Sep 16 01:03:52.796593 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.796565    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-715834-fr965"]
Sep 16 01:03:52.858632 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.858599    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"
Sep 16 01:03:52.880366 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.880314    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj2nq\" (UniqueName: \"kubernetes.io/projected/4e1f3b0e-8177-4455-aec4-72b403c69673-kube-api-access-kj2nq\") pod \"4e1f3b0e-8177-4455-aec4-72b403c69673\" (UID: \"4e1f3b0e-8177-4455-aec4-72b403c69673\") "
Sep 16 01:03:52.883899 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.883872    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e1f3b0e-8177-4455-aec4-72b403c69673-kube-api-access-kj2nq" (OuterVolumeSpecName: "kube-api-access-kj2nq") pod "4e1f3b0e-8177-4455-aec4-72b403c69673" (UID: "4e1f3b0e-8177-4455-aec4-72b403c69673"). InnerVolumeSpecName "kube-api-access-kj2nq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:03:52.981639 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.981548    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1f3b0e-8177-4455-aec4-72b403c69673-plugins-config-volume\") pod \"4e1f3b0e-8177-4455-aec4-72b403c69673\" (UID: \"4e1f3b0e-8177-4455-aec4-72b403c69673\") "
Sep 16 01:03:52.981842 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.981778    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj2nq\" (UniqueName: \"kubernetes.io/projected/4e1f3b0e-8177-4455-aec4-72b403c69673-kube-api-access-kj2nq\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:52.981928 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:52.981904    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e1f3b0e-8177-4455-aec4-72b403c69673-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4e1f3b0e-8177-4455-aec4-72b403c69673" (UID: "4e1f3b0e-8177-4455-aec4-72b403c69673"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:03:53.082569 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:53.082537    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1f3b0e-8177-4455-aec4-72b403c69673-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:53.667560 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:53.667525    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36bd4a66-b1e0-4e36-936b-41ed4f24cc9e" path="/var/lib/kubelet/pods/36bd4a66-b1e0-4e36-936b-41ed4f24cc9e/volumes"
Sep 16 01:03:53.742371 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:53.742344    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"
Sep 16 01:03:53.742579 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:53.742375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph" event={"ID":"4e1f3b0e-8177-4455-aec4-72b403c69673","Type":"ContainerDied","Data":"038869c1dfe8fbe6a2b5605aac7c577c5f63446083fa5ab52d9baf4460e468bc"}
Sep 16 01:03:53.742579 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:53.742439    2563 scope.go:117] "RemoveContainer" containerID="6f9abe7d7cfacf331247a2a162ff999a5b01dec7d9e65f1d451bbbfdffd32a3a"
Sep 16 01:03:53.744219 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:53.744194    2563 generic.go:356] "Generic (PLEG): container finished" podID="a0a01b74-a628-4165-a888-7da9c3cb01fc" containerID="49403858f4dec3fe10875546383be2553476a5804c8453feda644e4278c18d4c" exitCode=0
Sep 16 01:03:53.744352 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:53.744261    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5" event={"ID":"a0a01b74-a628-4165-a888-7da9c3cb01fc","Type":"ContainerDied","Data":"49403858f4dec3fe10875546383be2553476a5804c8453feda644e4278c18d4c"}
Sep 16 01:03:53.759146 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:53.759114    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"]
Sep 16 01:03:53.765453 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:53.765430    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-715834-7dc765dd54-bt6ph"]
Sep 16 01:03:54.890686 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:54.890647    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5"
Sep 16 01:03:54.898734 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:54.898708    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a01b74-a628-4165-a888-7da9c3cb01fc-maas-api-service-ca\") pod \"a0a01b74-a628-4165-a888-7da9c3cb01fc\" (UID: \"a0a01b74-a628-4165-a888-7da9c3cb01fc\") "
Sep 16 01:03:54.899061 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:54.899032    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a01b74-a628-4165-a888-7da9c3cb01fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a0a01b74-a628-4165-a888-7da9c3cb01fc" (UID: "a0a01b74-a628-4165-a888-7da9c3cb01fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:03:55.000472 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:55.000430    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0a01b74-a628-4165-a888-7da9c3cb01fc-maas-api-service-ca\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:03:55.668307 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:55.668273    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e1f3b0e-8177-4455-aec4-72b403c69673" path="/var/lib/kubelet/pods/4e1f3b0e-8177-4455-aec4-72b403c69673/volumes"
Sep 16 01:03:55.757940 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:55.757910    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5"
Sep 16 01:03:55.758118 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:55.757948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5" event={"ID":"a0a01b74-a628-4165-a888-7da9c3cb01fc","Type":"ContainerDied","Data":"0f48b2f2ca7fdee0353b01f624ede5fc9f168dbe24d6229ea8e7396ee30a428c"}
Sep 16 01:03:55.758118 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:03:55.757996    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f48b2f2ca7fdee0353b01f624ede5fc9f168dbe24d6229ea8e7396ee30a428c"
Sep 16 01:04:02.293022 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.292930    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"]
Sep 16 01:04:02.293426 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.293174    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq" podUID="7183cf02-c2cc-4a37-ae83-eca96d4896d1" containerName="payload-processing" containerID="cri-o://14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a" gracePeriod=30
Sep 16 01:04:02.302225 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.302199    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"]
Sep 16 01:04:02.302442 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.302418    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp" podUID="9a742757-ad2d-45e8-856b-0c86cfb962e0" containerName="payload-pre-processing" containerID="cri-o://b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc" gracePeriod=30
Sep 16 01:04:02.466353 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.466319    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5"]
Sep 16 01:04:02.468808 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.468786    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-3462ea-2rxt5"]
Sep 16 01:04:02.583055 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.583028    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"
Sep 16 01:04:02.586159 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.586139    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"
Sep 16 01:04:02.675705 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.675648    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlcnm\" (UniqueName: \"kubernetes.io/projected/7183cf02-c2cc-4a37-ae83-eca96d4896d1-kube-api-access-vlcnm\") pod \"7183cf02-c2cc-4a37-ae83-eca96d4896d1\" (UID: \"7183cf02-c2cc-4a37-ae83-eca96d4896d1\") "
Sep 16 01:04:02.675705 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.675708    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7183cf02-c2cc-4a37-ae83-eca96d4896d1-plugins-config-volume\") pod \"7183cf02-c2cc-4a37-ae83-eca96d4896d1\" (UID: \"7183cf02-c2cc-4a37-ae83-eca96d4896d1\") "
Sep 16 01:04:02.675989 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.675740    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a742757-ad2d-45e8-856b-0c86cfb962e0-plugins-config-volume\") pod \"9a742757-ad2d-45e8-856b-0c86cfb962e0\" (UID: \"9a742757-ad2d-45e8-856b-0c86cfb962e0\") "
Sep 16 01:04:02.675989 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.675794    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8gkm\" (UniqueName: \"kubernetes.io/projected/9a742757-ad2d-45e8-856b-0c86cfb962e0-kube-api-access-c8gkm\") pod \"9a742757-ad2d-45e8-856b-0c86cfb962e0\" (UID: \"9a742757-ad2d-45e8-856b-0c86cfb962e0\") "
Sep 16 01:04:02.676107 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.676087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7183cf02-c2cc-4a37-ae83-eca96d4896d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7183cf02-c2cc-4a37-ae83-eca96d4896d1" (UID: "7183cf02-c2cc-4a37-ae83-eca96d4896d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:04:02.676180 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.676152    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a742757-ad2d-45e8-856b-0c86cfb962e0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a742757-ad2d-45e8-856b-0c86cfb962e0" (UID: "9a742757-ad2d-45e8-856b-0c86cfb962e0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:04:02.676236 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.676163    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7183cf02-c2cc-4a37-ae83-eca96d4896d1-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:04:02.677929 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.677908    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7183cf02-c2cc-4a37-ae83-eca96d4896d1-kube-api-access-vlcnm" (OuterVolumeSpecName: "kube-api-access-vlcnm") pod "7183cf02-c2cc-4a37-ae83-eca96d4896d1" (UID: "7183cf02-c2cc-4a37-ae83-eca96d4896d1"). InnerVolumeSpecName "kube-api-access-vlcnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:04:02.678051 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.678033    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a742757-ad2d-45e8-856b-0c86cfb962e0-kube-api-access-c8gkm" (OuterVolumeSpecName: "kube-api-access-c8gkm") pod "9a742757-ad2d-45e8-856b-0c86cfb962e0" (UID: "9a742757-ad2d-45e8-856b-0c86cfb962e0"). InnerVolumeSpecName "kube-api-access-c8gkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:04:02.777284 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.777241    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlcnm\" (UniqueName: \"kubernetes.io/projected/7183cf02-c2cc-4a37-ae83-eca96d4896d1-kube-api-access-vlcnm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:04:02.777284 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.777273    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a742757-ad2d-45e8-856b-0c86cfb962e0-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:04:02.777284 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.777282    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8gkm\" (UniqueName: \"kubernetes.io/projected/9a742757-ad2d-45e8-856b-0c86cfb962e0-kube-api-access-c8gkm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:04:02.805315 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.805279    2563 generic.go:356] "Generic (PLEG): container finished" podID="7183cf02-c2cc-4a37-ae83-eca96d4896d1" containerID="14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a" exitCode=0
Sep 16 01:04:02.805504 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.805323    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"
Sep 16 01:04:02.805504 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.805373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq" event={"ID":"7183cf02-c2cc-4a37-ae83-eca96d4896d1","Type":"ContainerDied","Data":"14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a"}
Sep 16 01:04:02.805504 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.805438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq" event={"ID":"7183cf02-c2cc-4a37-ae83-eca96d4896d1","Type":"ContainerDied","Data":"824c300dc30d7261bb5e83a8eb65b039b58567bb64d5eea9bda69989dbebd15b"}
Sep 16 01:04:02.805504 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.805469    2563 scope.go:117] "RemoveContainer" containerID="14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a"
Sep 16 01:04:02.806859 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.806833    2563 generic.go:356] "Generic (PLEG): container finished" podID="9a742757-ad2d-45e8-856b-0c86cfb962e0" containerID="b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc" exitCode=0
Sep 16 01:04:02.806977 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.806866    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp" event={"ID":"9a742757-ad2d-45e8-856b-0c86cfb962e0","Type":"ContainerDied","Data":"b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc"}
Sep 16 01:04:02.806977 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.806885    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"
Sep 16 01:04:02.806977 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.806925    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp" event={"ID":"9a742757-ad2d-45e8-856b-0c86cfb962e0","Type":"ContainerDied","Data":"b9ea682293c6e871c462bfeabf063935ab1df4ed07886e39ec558418ce7a4e19"}
Sep 16 01:04:02.816329 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.816310    2563 scope.go:117] "RemoveContainer" containerID="14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a"
Sep 16 01:04:02.816659 ip-10-0-136-16 kubenswrapper[2563]: E0916 01:04:02.816632    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a\": container with ID starting with 14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a not found: ID does not exist" containerID="14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a"
Sep 16 01:04:02.816802 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.816687    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a"} err="failed to get container status \"14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a\": rpc error: code = NotFound desc = could not find container \"14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a\": container with ID starting with 14b1bb08bc60259056b5125402bc4bfadaab982bfc15f65950fbb99362fc441a not found: ID does not exist"
Sep 16 01:04:02.816802 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.816713    2563 scope.go:117] "RemoveContainer" containerID="b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc"
Sep 16 01:04:02.825449 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.825430    2563 scope.go:117] "RemoveContainer" containerID="b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc"
Sep 16 01:04:02.825808 ip-10-0-136-16 kubenswrapper[2563]: E0916 01:04:02.825786    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc\": container with ID starting with b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc not found: ID does not exist" containerID="b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc"
Sep 16 01:04:02.825913 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.825815    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc"} err="failed to get container status \"b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc\": rpc error: code = NotFound desc = could not find container \"b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc\": container with ID starting with b910a07734cb2a8a4f5a3bc604907ecd3c8827423ae827be6e0d0d84758102dc not found: ID does not exist"
Sep 16 01:04:02.826922 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.826902    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"]
Sep 16 01:04:02.831035 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.831014    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-3462ea-55c755865c-9j9zq"]
Sep 16 01:04:02.839647 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.839617    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"]
Sep 16 01:04:02.843870 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:02.843845    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-3462ea-658fbc89f4-f5lwp"]
Sep 16 01:04:03.667815 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:03.667781    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7183cf02-c2cc-4a37-ae83-eca96d4896d1" path="/var/lib/kubelet/pods/7183cf02-c2cc-4a37-ae83-eca96d4896d1/volumes"
Sep 16 01:04:03.668204 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:03.668182    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a742757-ad2d-45e8-856b-0c86cfb962e0" path="/var/lib/kubelet/pods/9a742757-ad2d-45e8-856b-0c86cfb962e0/volumes"
Sep 16 01:04:03.668471 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:03.668458    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0a01b74-a628-4165-a888-7da9c3cb01fc" path="/var/lib/kubelet/pods/a0a01b74-a628-4165-a888-7da9c3cb01fc/volumes"
Sep 16 01:04:09.135068 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135032    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk"]
Sep 16 01:04:09.135451 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135403    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7183cf02-c2cc-4a37-ae83-eca96d4896d1" containerName="payload-processing"
Sep 16 01:04:09.135451 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135415    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7183cf02-c2cc-4a37-ae83-eca96d4896d1" containerName="payload-processing"
Sep 16 01:04:09.135451 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135425    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a01b74-a628-4165-a888-7da9c3cb01fc" containerName="revoke-keys"
Sep 16 01:04:09.135451 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135432    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a01b74-a628-4165-a888-7da9c3cb01fc" containerName="revoke-keys"
Sep 16 01:04:09.135451 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135447    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e1f3b0e-8177-4455-aec4-72b403c69673" containerName="payload-pre-processing"
Sep 16 01:04:09.135451 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135453    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e1f3b0e-8177-4455-aec4-72b403c69673" containerName="payload-pre-processing"
Sep 16 01:04:09.135699 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135464    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a742757-ad2d-45e8-856b-0c86cfb962e0" containerName="payload-pre-processing"
Sep 16 01:04:09.135699 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135470    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a742757-ad2d-45e8-856b-0c86cfb962e0" containerName="payload-pre-processing"
Sep 16 01:04:09.135699 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135529    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7183cf02-c2cc-4a37-ae83-eca96d4896d1" containerName="payload-processing"
Sep 16 01:04:09.135699 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135537    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a01b74-a628-4165-a888-7da9c3cb01fc" containerName="revoke-keys"
Sep 16 01:04:09.135699 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135546    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e1f3b0e-8177-4455-aec4-72b403c69673" containerName="payload-pre-processing"
Sep 16 01:04:09.135699 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.135554    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a742757-ad2d-45e8-856b-0c86cfb962e0" containerName="payload-pre-processing"
Sep 16 01:04:09.138586 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.138568    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk"
Sep 16 01:04:09.140464 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.140447    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:04:09.140552 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.140534    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-npltg\""
Sep 16 01:04:09.146800 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.146536    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk"]
Sep 16 01:04:09.239194 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.239152    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d71ba2c-8884-4f90-8a00-bd3da7e56b38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk\" (UID: \"4d71ba2c-8884-4f90-8a00-bd3da7e56b38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk"
Sep 16 01:04:09.340008 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.339971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d71ba2c-8884-4f90-8a00-bd3da7e56b38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk\" (UID: \"4d71ba2c-8884-4f90-8a00-bd3da7e56b38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk"
Sep 16 01:04:09.340608 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.340585    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d71ba2c-8884-4f90-8a00-bd3da7e56b38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk\" (UID: \"4d71ba2c-8884-4f90-8a00-bd3da7e56b38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk"
Sep 16 01:04:09.450995 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.450955    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk"
Sep 16 01:04:09.723598 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.723498    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk"]
Sep 16 01:04:09.726172 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:04:09.726139    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d71ba2c_8884_4f90_8a00_bd3da7e56b38.slice/crio-2925d5606c2c6cbc689364c0aebe72f1ed7af30a3182ee59247546e425794890 WatchSource:0}: Error finding container 2925d5606c2c6cbc689364c0aebe72f1ed7af30a3182ee59247546e425794890: Status 404 returned error can't find the container with id 2925d5606c2c6cbc689364c0aebe72f1ed7af30a3182ee59247546e425794890
Sep 16 01:04:09.849941 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:09.849903    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk" event={"ID":"4d71ba2c-8884-4f90-8a00-bd3da7e56b38","Type":"ContainerStarted","Data":"2925d5606c2c6cbc689364c0aebe72f1ed7af30a3182ee59247546e425794890"}
Sep 16 01:04:10.857254 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:10.857216    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d71ba2c-8884-4f90-8a00-bd3da7e56b38" containerID="89f8f79930c75aa7418374fa479e210fcf7933b2ee9ab5a774886be380e0b513" exitCode=0
Sep 16 01:04:10.857700 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:10.857261    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk" event={"ID":"4d71ba2c-8884-4f90-8a00-bd3da7e56b38","Type":"ContainerDied","Data":"89f8f79930c75aa7418374fa479e210fcf7933b2ee9ab5a774886be380e0b513"}
Sep 16 01:04:12.000954 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:12.000929    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk"
Sep 16 01:04:12.065534 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:12.065494    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d71ba2c-8884-4f90-8a00-bd3da7e56b38-maas-api-service-ca\") pod \"4d71ba2c-8884-4f90-8a00-bd3da7e56b38\" (UID: \"4d71ba2c-8884-4f90-8a00-bd3da7e56b38\") "
Sep 16 01:04:12.065926 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:12.065903    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d71ba2c-8884-4f90-8a00-bd3da7e56b38-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4d71ba2c-8884-4f90-8a00-bd3da7e56b38" (UID: "4d71ba2c-8884-4f90-8a00-bd3da7e56b38"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:04:12.166688 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:12.166576    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d71ba2c-8884-4f90-8a00-bd3da7e56b38-maas-api-service-ca\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:04:12.869337 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:12.869303    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk"
Sep 16 01:04:12.869529 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:12.869342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk" event={"ID":"4d71ba2c-8884-4f90-8a00-bd3da7e56b38","Type":"ContainerDied","Data":"2925d5606c2c6cbc689364c0aebe72f1ed7af30a3182ee59247546e425794890"}
Sep 16 01:04:12.869529 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:12.869390    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2925d5606c2c6cbc689364c0aebe72f1ed7af30a3182ee59247546e425794890"
Sep 16 01:04:19.655390 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.655355    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld"]
Sep 16 01:04:19.659553 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.659528    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-409cde-29825340-2bbld"]
Sep 16 01:04:19.668204 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.668165    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba81e87b-5e70-45b3-aa4f-79f9832a360e" path="/var/lib/kubelet/pods/ba81e87b-5e70-45b3-aa4f-79f9832a360e/volumes"
Sep 16 01:04:19.685167 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.685133    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"]
Sep 16 01:04:19.685411 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.685384    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47" podUID="fd0cbb3a-1244-42df-9668-7a9abb90a36b" containerName="payload-processing" containerID="cri-o://80563697ad126b374320da9e04829ee4e1868fe17b7cfd84d3d3dfe6c622921b" gracePeriod=30
Sep 16 01:04:19.694540 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.693792    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"]
Sep 16 01:04:19.694540 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.694018    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg" podUID="7bea1b6e-17a7-4eb2-82be-ecb72f876cfc" containerName="payload-pre-processing" containerID="cri-o://fed4bcc96175ca1dbb1413e1b3e1d18be90b5141e4b00b34a65300fbadb8f804" gracePeriod=30
Sep 16 01:04:19.844103 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.844067    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk"]
Sep 16 01:04:19.846085 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.846057    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-409cde-dvqzk"]
Sep 16 01:04:19.921209 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.920941    2563 generic.go:356] "Generic (PLEG): container finished" podID="7bea1b6e-17a7-4eb2-82be-ecb72f876cfc" containerID="fed4bcc96175ca1dbb1413e1b3e1d18be90b5141e4b00b34a65300fbadb8f804" exitCode=0
Sep 16 01:04:19.921209 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.921075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg" event={"ID":"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc","Type":"ContainerDied","Data":"fed4bcc96175ca1dbb1413e1b3e1d18be90b5141e4b00b34a65300fbadb8f804"}
Sep 16 01:04:19.923310 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.923280    2563 generic.go:356] "Generic (PLEG): container finished" podID="fd0cbb3a-1244-42df-9668-7a9abb90a36b" containerID="80563697ad126b374320da9e04829ee4e1868fe17b7cfd84d3d3dfe6c622921b" exitCode=0
Sep 16 01:04:19.923469 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.923366    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47" event={"ID":"fd0cbb3a-1244-42df-9668-7a9abb90a36b","Type":"ContainerDied","Data":"80563697ad126b374320da9e04829ee4e1868fe17b7cfd84d3d3dfe6c622921b"}
Sep 16 01:04:19.971562 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.971533    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"
Sep 16 01:04:19.974697 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:19.974653    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"
Sep 16 01:04:20.043017 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.042978    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xntzw\" (UniqueName: \"kubernetes.io/projected/fd0cbb3a-1244-42df-9668-7a9abb90a36b-kube-api-access-xntzw\") pod \"fd0cbb3a-1244-42df-9668-7a9abb90a36b\" (UID: \"fd0cbb3a-1244-42df-9668-7a9abb90a36b\") "
Sep 16 01:04:20.043206 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.043081    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd0cbb3a-1244-42df-9668-7a9abb90a36b-plugins-config-volume\") pod \"fd0cbb3a-1244-42df-9668-7a9abb90a36b\" (UID: \"fd0cbb3a-1244-42df-9668-7a9abb90a36b\") "
Sep 16 01:04:20.043206 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.043109    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc9h8\" (UniqueName: \"kubernetes.io/projected/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc-kube-api-access-kc9h8\") pod \"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc\" (UID: \"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc\") "
Sep 16 01:04:20.043206 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.043135    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc-plugins-config-volume\") pod \"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc\" (UID: \"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc\") "
Sep 16 01:04:20.043488 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.043456    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd0cbb3a-1244-42df-9668-7a9abb90a36b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd0cbb3a-1244-42df-9668-7a9abb90a36b" (UID: "fd0cbb3a-1244-42df-9668-7a9abb90a36b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:04:20.043613 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.043535    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7bea1b6e-17a7-4eb2-82be-ecb72f876cfc" (UID: "7bea1b6e-17a7-4eb2-82be-ecb72f876cfc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:04:20.045393 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.045367    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc-kube-api-access-kc9h8" (OuterVolumeSpecName: "kube-api-access-kc9h8") pod "7bea1b6e-17a7-4eb2-82be-ecb72f876cfc" (UID: "7bea1b6e-17a7-4eb2-82be-ecb72f876cfc"). InnerVolumeSpecName "kube-api-access-kc9h8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:04:20.045478 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.045405    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd0cbb3a-1244-42df-9668-7a9abb90a36b-kube-api-access-xntzw" (OuterVolumeSpecName: "kube-api-access-xntzw") pod "fd0cbb3a-1244-42df-9668-7a9abb90a36b" (UID: "fd0cbb3a-1244-42df-9668-7a9abb90a36b"). InnerVolumeSpecName "kube-api-access-xntzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:04:20.144300 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.144264    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xntzw\" (UniqueName: \"kubernetes.io/projected/fd0cbb3a-1244-42df-9668-7a9abb90a36b-kube-api-access-xntzw\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:04:20.144300 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.144297    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd0cbb3a-1244-42df-9668-7a9abb90a36b-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:04:20.144300 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.144307    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc9h8\" (UniqueName: \"kubernetes.io/projected/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc-kube-api-access-kc9h8\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:04:20.144567 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.144317    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:04:20.930520 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.930483    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"
Sep 16 01:04:20.930520 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.930511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg" event={"ID":"7bea1b6e-17a7-4eb2-82be-ecb72f876cfc","Type":"ContainerDied","Data":"186ab302e49b9509966aeedc1ec861cc9ad847a49982e486f2ee8679c778599d"}
Sep 16 01:04:20.931122 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.930585    2563 scope.go:117] "RemoveContainer" containerID="fed4bcc96175ca1dbb1413e1b3e1d18be90b5141e4b00b34a65300fbadb8f804"
Sep 16 01:04:20.932079 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.932063    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"
Sep 16 01:04:20.932161 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.932118    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47" event={"ID":"fd0cbb3a-1244-42df-9668-7a9abb90a36b","Type":"ContainerDied","Data":"634149ee19b87615b654a03a37d9ea534ae76bec4b866a1c2d9bcf4c710c4c81"}
Sep 16 01:04:20.941463 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.941446    2563 scope.go:117] "RemoveContainer" containerID="80563697ad126b374320da9e04829ee4e1868fe17b7cfd84d3d3dfe6c622921b"
Sep 16 01:04:20.961651 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.961622    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"]
Sep 16 01:04:20.974180 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.974152    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-409cde-7f5cbf7bcd-cp4tg"]
Sep 16 01:04:20.996338 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:20.996307    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"]
Sep 16 01:04:21.007214 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:21.007183    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-409cde-756748b559-hzx47"]
Sep 16 01:04:21.668086 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:21.668054    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d71ba2c-8884-4f90-8a00-bd3da7e56b38" path="/var/lib/kubelet/pods/4d71ba2c-8884-4f90-8a00-bd3da7e56b38/volumes"
Sep 16 01:04:21.668424 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:21.668411    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bea1b6e-17a7-4eb2-82be-ecb72f876cfc" path="/var/lib/kubelet/pods/7bea1b6e-17a7-4eb2-82be-ecb72f876cfc/volumes"
Sep 16 01:04:21.668740 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:21.668728    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd0cbb3a-1244-42df-9668-7a9abb90a36b" path="/var/lib/kubelet/pods/fd0cbb3a-1244-42df-9668-7a9abb90a36b/volumes"
Sep 16 01:04:41.497593 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.497546    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd"]
Sep 16 01:04:41.498183 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.498161    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd0cbb3a-1244-42df-9668-7a9abb90a36b" containerName="payload-processing"
Sep 16 01:04:41.498282 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.498186    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd0cbb3a-1244-42df-9668-7a9abb90a36b" containerName="payload-processing"
Sep 16 01:04:41.498282 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.498229    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bea1b6e-17a7-4eb2-82be-ecb72f876cfc" containerName="payload-pre-processing"
Sep 16 01:04:41.498282 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.498238    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bea1b6e-17a7-4eb2-82be-ecb72f876cfc" containerName="payload-pre-processing"
Sep 16 01:04:41.498282 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.498247    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d71ba2c-8884-4f90-8a00-bd3da7e56b38" containerName="revoke-keys"
Sep 16 01:04:41.498282 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.498256    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d71ba2c-8884-4f90-8a00-bd3da7e56b38" containerName="revoke-keys"
Sep 16 01:04:41.498529 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.498350    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bea1b6e-17a7-4eb2-82be-ecb72f876cfc" containerName="payload-pre-processing"
Sep 16 01:04:41.498529 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.498363    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d71ba2c-8884-4f90-8a00-bd3da7e56b38" containerName="revoke-keys"
Sep 16 01:04:41.498529 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.498374    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd0cbb3a-1244-42df-9668-7a9abb90a36b" containerName="payload-processing"
Sep 16 01:04:41.501126 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.501103    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd"
Sep 16 01:04:41.503144 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.503112    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:04:41.503255 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.503169    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-npltg\""
Sep 16 01:04:41.507461 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.507432    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd"]
Sep 16 01:04:41.541446 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.541409    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42876dc6-39e8-49ac-8ff0-c5aa5ebf174a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd\" (UID: \"42876dc6-39e8-49ac-8ff0-c5aa5ebf174a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd"
Sep 16 01:04:41.641934 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.641901    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42876dc6-39e8-49ac-8ff0-c5aa5ebf174a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd\" (UID: \"42876dc6-39e8-49ac-8ff0-c5aa5ebf174a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd"
Sep 16 01:04:41.642616 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.642596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42876dc6-39e8-49ac-8ff0-c5aa5ebf174a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd\" (UID: \"42876dc6-39e8-49ac-8ff0-c5aa5ebf174a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd"
Sep 16 01:04:41.813911 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:41.813829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd"
Sep 16 01:04:42.083109 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:42.083081    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd"]
Sep 16 01:04:42.086080 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:04:42.086033    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42876dc6_39e8_49ac_8ff0_c5aa5ebf174a.slice/crio-8b2029c8f03075aeb002ef4b5929852c0a74017177e8d5dd1b9ce0e5cf31baeb WatchSource:0}: Error finding container 8b2029c8f03075aeb002ef4b5929852c0a74017177e8d5dd1b9ce0e5cf31baeb: Status 404 returned error can't find the container with id 8b2029c8f03075aeb002ef4b5929852c0a74017177e8d5dd1b9ce0e5cf31baeb
Sep 16 01:04:43.047580 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:43.047544    2563 generic.go:356] "Generic (PLEG): container finished" podID="42876dc6-39e8-49ac-8ff0-c5aa5ebf174a" containerID="db4e17c58f68612970d4f8db7291b9bb5c14750ab2d605ca8c9d3340e0854772" exitCode=0
Sep 16 01:04:43.048012 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:43.047587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd" event={"ID":"42876dc6-39e8-49ac-8ff0-c5aa5ebf174a","Type":"ContainerDied","Data":"db4e17c58f68612970d4f8db7291b9bb5c14750ab2d605ca8c9d3340e0854772"}
Sep 16 01:04:43.048012 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:43.047644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd" event={"ID":"42876dc6-39e8-49ac-8ff0-c5aa5ebf174a","Type":"ContainerStarted","Data":"8b2029c8f03075aeb002ef4b5929852c0a74017177e8d5dd1b9ce0e5cf31baeb"}
Sep 16 01:04:44.184613 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:44.184588    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd"
Sep 16 01:04:44.270470 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:44.270436    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42876dc6-39e8-49ac-8ff0-c5aa5ebf174a-maas-api-service-ca\") pod \"42876dc6-39e8-49ac-8ff0-c5aa5ebf174a\" (UID: \"42876dc6-39e8-49ac-8ff0-c5aa5ebf174a\") "
Sep 16 01:04:44.270853 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:44.270828    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42876dc6-39e8-49ac-8ff0-c5aa5ebf174a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "42876dc6-39e8-49ac-8ff0-c5aa5ebf174a" (UID: "42876dc6-39e8-49ac-8ff0-c5aa5ebf174a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:04:44.372180 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:44.372088    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42876dc6-39e8-49ac-8ff0-c5aa5ebf174a-maas-api-service-ca\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:04:45.059379 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:45.059347    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd"
Sep 16 01:04:45.059539 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:45.059380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd" event={"ID":"42876dc6-39e8-49ac-8ff0-c5aa5ebf174a","Type":"ContainerDied","Data":"8b2029c8f03075aeb002ef4b5929852c0a74017177e8d5dd1b9ce0e5cf31baeb"}
Sep 16 01:04:45.059539 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:45.059429    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b2029c8f03075aeb002ef4b5929852c0a74017177e8d5dd1b9ce0e5cf31baeb"
Sep 16 01:04:52.009801 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:52.009763    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"]
Sep 16 01:04:52.010458 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:52.010096    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5" podUID="c60655a4-e5aa-40b2-9892-fa0562774bc7" containerName="payload-processing" containerID="cri-o://6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc" gracePeriod=30
Sep 16 01:04:52.154114 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:52.154068    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd"]
Sep 16 01:04:52.157154 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:52.157120    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e8a7b-6x5gd"]
Sep 16 01:04:52.264781 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:52.264723    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"
Sep 16 01:04:52.345965 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:52.345931    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9qpf\" (UniqueName: \"kubernetes.io/projected/c60655a4-e5aa-40b2-9892-fa0562774bc7-kube-api-access-h9qpf\") pod \"c60655a4-e5aa-40b2-9892-fa0562774bc7\" (UID: \"c60655a4-e5aa-40b2-9892-fa0562774bc7\") "
Sep 16 01:04:52.346155 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:52.345996    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60655a4-e5aa-40b2-9892-fa0562774bc7-plugins-config-volume\") pod \"c60655a4-e5aa-40b2-9892-fa0562774bc7\" (UID: \"c60655a4-e5aa-40b2-9892-fa0562774bc7\") "
Sep 16 01:04:52.346426 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:52.346399    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c60655a4-e5aa-40b2-9892-fa0562774bc7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c60655a4-e5aa-40b2-9892-fa0562774bc7" (UID: "c60655a4-e5aa-40b2-9892-fa0562774bc7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:04:52.348296 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:52.348270    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c60655a4-e5aa-40b2-9892-fa0562774bc7-kube-api-access-h9qpf" (OuterVolumeSpecName: "kube-api-access-h9qpf") pod "c60655a4-e5aa-40b2-9892-fa0562774bc7" (UID: "c60655a4-e5aa-40b2-9892-fa0562774bc7"). InnerVolumeSpecName "kube-api-access-h9qpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:04:52.446750 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:52.446715    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9qpf\" (UniqueName: \"kubernetes.io/projected/c60655a4-e5aa-40b2-9892-fa0562774bc7-kube-api-access-h9qpf\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:04:52.446750 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:52.446745    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c60655a4-e5aa-40b2-9892-fa0562774bc7-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:04:53.100559 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:53.100525    2563 generic.go:356] "Generic (PLEG): container finished" podID="c60655a4-e5aa-40b2-9892-fa0562774bc7" containerID="6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc" exitCode=0
Sep 16 01:04:53.101031 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:53.100567    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"
Sep 16 01:04:53.101031 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:53.100594    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5" event={"ID":"c60655a4-e5aa-40b2-9892-fa0562774bc7","Type":"ContainerDied","Data":"6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc"}
Sep 16 01:04:53.101031 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:53.100637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5" event={"ID":"c60655a4-e5aa-40b2-9892-fa0562774bc7","Type":"ContainerDied","Data":"e6a72aa54d19883e055539bf8b24d26ce43efef171a2c0031e282e2466f2f834"}
Sep 16 01:04:53.101031 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:53.100658    2563 scope.go:117] "RemoveContainer" containerID="6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc"
Sep 16 01:04:53.110082 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:53.110064    2563 scope.go:117] "RemoveContainer" containerID="6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc"
Sep 16 01:04:53.110363 ip-10-0-136-16 kubenswrapper[2563]: E0916 01:04:53.110340    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc\": container with ID starting with 6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc not found: ID does not exist" containerID="6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc"
Sep 16 01:04:53.110430 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:53.110375    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc"} err="failed to get container status \"6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc\": rpc error: code = NotFound desc = could not find container \"6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc\": container with ID starting with 6c2b8f1cf03798b3351637fadaf8bff2d84b7b23936cbdc314bc21cc3cc212bc not found: ID does not exist"
Sep 16 01:04:53.120594 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:53.120560    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"]
Sep 16 01:04:53.123935 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:53.123913    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0e8a7b-76d68b5685-bgxt5"]
Sep 16 01:04:53.667599 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:53.667554    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42876dc6-39e8-49ac-8ff0-c5aa5ebf174a" path="/var/lib/kubelet/pods/42876dc6-39e8-49ac-8ff0-c5aa5ebf174a/volumes"
Sep 16 01:04:53.668071 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:53.668048    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c60655a4-e5aa-40b2-9892-fa0562774bc7" path="/var/lib/kubelet/pods/c60655a4-e5aa-40b2-9892-fa0562774bc7/volumes"
Sep 16 01:04:59.021524 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.021472    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs"]
Sep 16 01:04:59.021953 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.021910    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c60655a4-e5aa-40b2-9892-fa0562774bc7" containerName="payload-processing"
Sep 16 01:04:59.021953 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.021924    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c60655a4-e5aa-40b2-9892-fa0562774bc7" containerName="payload-processing"
Sep 16 01:04:59.021953 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.021933    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42876dc6-39e8-49ac-8ff0-c5aa5ebf174a" containerName="revoke-keys"
Sep 16 01:04:59.021953 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.021939    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42876dc6-39e8-49ac-8ff0-c5aa5ebf174a" containerName="revoke-keys"
Sep 16 01:04:59.022092 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.022008    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42876dc6-39e8-49ac-8ff0-c5aa5ebf174a" containerName="revoke-keys"
Sep 16 01:04:59.022092 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.022021    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c60655a4-e5aa-40b2-9892-fa0562774bc7" containerName="payload-processing"
Sep 16 01:04:59.026549 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.026530    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs"
Sep 16 01:04:59.028530 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.028506    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:04:59.028703 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.028621    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-npltg\""
Sep 16 01:04:59.031980 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.031955    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs"]
Sep 16 01:04:59.113574 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.113541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6a0ff8-2141-40c5-8de9-44f328dda587-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs\" (UID: \"6b6a0ff8-2141-40c5-8de9-44f328dda587\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs"
Sep 16 01:04:59.214546 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.214499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6a0ff8-2141-40c5-8de9-44f328dda587-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs\" (UID: \"6b6a0ff8-2141-40c5-8de9-44f328dda587\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs"
Sep 16 01:04:59.215175 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.215152    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6a0ff8-2141-40c5-8de9-44f328dda587-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs\" (UID: \"6b6a0ff8-2141-40c5-8de9-44f328dda587\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs"
Sep 16 01:04:59.339165 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.339062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs"
Sep 16 01:04:59.615274 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:04:59.615243    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs"]
Sep 16 01:04:59.616986 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:04:59.616956    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6a0ff8_2141_40c5_8de9_44f328dda587.slice/crio-b6f4b4bd16f9dfa644fc5131f8a29535e8efd31ab27ca47446fd53a4de7d8c68 WatchSource:0}: Error finding container b6f4b4bd16f9dfa644fc5131f8a29535e8efd31ab27ca47446fd53a4de7d8c68: Status 404 returned error can't find the container with id b6f4b4bd16f9dfa644fc5131f8a29535e8efd31ab27ca47446fd53a4de7d8c68
Sep 16 01:05:00.146831 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:00.146736    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs" event={"ID":"6b6a0ff8-2141-40c5-8de9-44f328dda587","Type":"ContainerStarted","Data":"a3388bf567f362af200a17e5a52ac3e8698d552e7a49ddce48776e791661e4e0"}
Sep 16 01:05:00.146831 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:00.146804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs" event={"ID":"6b6a0ff8-2141-40c5-8de9-44f328dda587","Type":"ContainerStarted","Data":"b6f4b4bd16f9dfa644fc5131f8a29535e8efd31ab27ca47446fd53a4de7d8c68"}
Sep 16 01:05:00.161322 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:00.161276    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs" podStartSLOduration=1.161258673 podStartE2EDuration="1.161258673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:04:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:05:00.15948576 +0000 UTC m=+1850.962308823" watchObservedRunningTime="2026-09-16 01:05:00.161258673 +0000 UTC m=+1850.964081735"
Sep 16 01:05:01.154562 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:01.154524    2563 generic.go:356] "Generic (PLEG): container finished" podID="6b6a0ff8-2141-40c5-8de9-44f328dda587" containerID="a3388bf567f362af200a17e5a52ac3e8698d552e7a49ddce48776e791661e4e0" exitCode=0
Sep 16 01:05:01.154970 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:01.154614    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs" event={"ID":"6b6a0ff8-2141-40c5-8de9-44f328dda587","Type":"ContainerDied","Data":"a3388bf567f362af200a17e5a52ac3e8698d552e7a49ddce48776e791661e4e0"}
Sep 16 01:05:02.299453 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:02.299427    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs"
Sep 16 01:05:02.444835 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:02.444799    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6a0ff8-2141-40c5-8de9-44f328dda587-maas-api-service-ca\") pod \"6b6a0ff8-2141-40c5-8de9-44f328dda587\" (UID: \"6b6a0ff8-2141-40c5-8de9-44f328dda587\") "
Sep 16 01:05:02.445170 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:02.445144    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b6a0ff8-2141-40c5-8de9-44f328dda587-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6b6a0ff8-2141-40c5-8de9-44f328dda587" (UID: "6b6a0ff8-2141-40c5-8de9-44f328dda587"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:05:02.545506 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:02.545455    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6a0ff8-2141-40c5-8de9-44f328dda587-maas-api-service-ca\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:05:03.167456 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:03.167420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs" event={"ID":"6b6a0ff8-2141-40c5-8de9-44f328dda587","Type":"ContainerDied","Data":"b6f4b4bd16f9dfa644fc5131f8a29535e8efd31ab27ca47446fd53a4de7d8c68"}
Sep 16 01:05:03.167456 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:03.167451    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs"
Sep 16 01:05:03.167695 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:03.167469    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6f4b4bd16f9dfa644fc5131f8a29535e8efd31ab27ca47446fd53a4de7d8c68"
Sep 16 01:05:09.548551 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:09.548478    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd"]
Sep 16 01:05:09.550981 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:09.550956    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-108960-29825340-6pzdd"]
Sep 16 01:05:09.580540 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:09.580496    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"]
Sep 16 01:05:09.580822 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:09.580776    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt" podUID="20110a96-69a1-468b-b8fc-bdfbc613584c" containerName="payload-pre-processing" containerID="cri-o://5b543ca69b7101e857a294b3bbe7a89c21dce42eed53f9d107e1b3435520e263" gracePeriod=30
Sep 16 01:05:09.667888 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:09.667858    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e238312a-b259-4a1f-9785-ccd4004f9f5d" path="/var/lib/kubelet/pods/e238312a-b259-4a1f-9785-ccd4004f9f5d/volumes"
Sep 16 01:05:09.739641 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:09.739596    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs"]
Sep 16 01:05:09.741320 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:09.741292    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-108960-2djbs"]
Sep 16 01:05:09.831827 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:09.831802    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"
Sep 16 01:05:09.923489 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:09.923457    2563 scope.go:117] "RemoveContainer" containerID="5b543ca69b7101e857a294b3bbe7a89c21dce42eed53f9d107e1b3435520e263"
Sep 16 01:05:10.017502 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:10.017462    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20110a96-69a1-468b-b8fc-bdfbc613584c-plugins-config-volume\") pod \"20110a96-69a1-468b-b8fc-bdfbc613584c\" (UID: \"20110a96-69a1-468b-b8fc-bdfbc613584c\") "
Sep 16 01:05:10.017502 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:10.017509    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbccr\" (UniqueName: \"kubernetes.io/projected/20110a96-69a1-468b-b8fc-bdfbc613584c-kube-api-access-mbccr\") pod \"20110a96-69a1-468b-b8fc-bdfbc613584c\" (UID: \"20110a96-69a1-468b-b8fc-bdfbc613584c\") "
Sep 16 01:05:10.017914 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:10.017888    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20110a96-69a1-468b-b8fc-bdfbc613584c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "20110a96-69a1-468b-b8fc-bdfbc613584c" (UID: "20110a96-69a1-468b-b8fc-bdfbc613584c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:05:10.019799 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:10.019764    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20110a96-69a1-468b-b8fc-bdfbc613584c-kube-api-access-mbccr" (OuterVolumeSpecName: "kube-api-access-mbccr") pod "20110a96-69a1-468b-b8fc-bdfbc613584c" (UID: "20110a96-69a1-468b-b8fc-bdfbc613584c"). InnerVolumeSpecName "kube-api-access-mbccr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:05:10.118233 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:10.118139    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20110a96-69a1-468b-b8fc-bdfbc613584c-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:05:10.118233 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:10.118168    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbccr\" (UniqueName: \"kubernetes.io/projected/20110a96-69a1-468b-b8fc-bdfbc613584c-kube-api-access-mbccr\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:05:10.203648 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:10.203608    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt" event={"ID":"20110a96-69a1-468b-b8fc-bdfbc613584c","Type":"ContainerDied","Data":"5b543ca69b7101e857a294b3bbe7a89c21dce42eed53f9d107e1b3435520e263"}
Sep 16 01:05:10.203868 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:10.203628    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"
Sep 16 01:05:10.203868 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:10.203739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt" event={"ID":"20110a96-69a1-468b-b8fc-bdfbc613584c","Type":"ContainerDied","Data":"d02d71be6186c331e0a11ae93f9aa3d8c3b3856a2b8f1383835dcf330288800f"}
Sep 16 01:05:10.228819 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:10.228782    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"]
Sep 16 01:05:10.232189 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:10.232161    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-108960-66fdfd5d6b-v8hdt"]
Sep 16 01:05:11.667289 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:11.667248    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20110a96-69a1-468b-b8fc-bdfbc613584c" path="/var/lib/kubelet/pods/20110a96-69a1-468b-b8fc-bdfbc613584c/volumes"
Sep 16 01:05:11.667695 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:11.667614    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b6a0ff8-2141-40c5-8de9-44f328dda587" path="/var/lib/kubelet/pods/6b6a0ff8-2141-40c5-8de9-44f328dda587/volumes"
Sep 16 01:05:27.010108 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.010071    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"]
Sep 16 01:05:27.010736 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.010320    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds" podUID="10b39872-73df-4f7e-bafb-07fb68f88b43" containerName="payload-processing" containerID="cri-o://4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e" gracePeriod=30
Sep 16 01:05:27.261514 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.261435    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"
Sep 16 01:05:27.294159 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.294125    2563 generic.go:356] "Generic (PLEG): container finished" podID="10b39872-73df-4f7e-bafb-07fb68f88b43" containerID="4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e" exitCode=0
Sep 16 01:05:27.294359 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.294176    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds" event={"ID":"10b39872-73df-4f7e-bafb-07fb68f88b43","Type":"ContainerDied","Data":"4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e"}
Sep 16 01:05:27.294359 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.294230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds" event={"ID":"10b39872-73df-4f7e-bafb-07fb68f88b43","Type":"ContainerDied","Data":"f27779bf8e4c15bae8ea3519c8df43733034fc5943c5560f45c807e867618897"}
Sep 16 01:05:27.294359 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.294241    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"
Sep 16 01:05:27.294359 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.294260    2563 scope.go:117] "RemoveContainer" containerID="4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e"
Sep 16 01:05:27.302903 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.302885    2563 scope.go:117] "RemoveContainer" containerID="4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e"
Sep 16 01:05:27.303192 ip-10-0-136-16 kubenswrapper[2563]: E0916 01:05:27.303172    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e\": container with ID starting with 4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e not found: ID does not exist" containerID="4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e"
Sep 16 01:05:27.303250 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.303203    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e"} err="failed to get container status \"4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e\": rpc error: code = NotFound desc = could not find container \"4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e\": container with ID starting with 4cac589df31fd494df4e3a7252ac58c0f449c4994b6db00b89ee4c0613aa392e not found: ID does not exist"
Sep 16 01:05:27.379397 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.379366    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frmp9\" (UniqueName: \"kubernetes.io/projected/10b39872-73df-4f7e-bafb-07fb68f88b43-kube-api-access-frmp9\") pod \"10b39872-73df-4f7e-bafb-07fb68f88b43\" (UID: \"10b39872-73df-4f7e-bafb-07fb68f88b43\") "
Sep 16 01:05:27.379603 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.379418    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b39872-73df-4f7e-bafb-07fb68f88b43-plugins-config-volume\") pod \"10b39872-73df-4f7e-bafb-07fb68f88b43\" (UID: \"10b39872-73df-4f7e-bafb-07fb68f88b43\") "
Sep 16 01:05:27.379906 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.379873    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10b39872-73df-4f7e-bafb-07fb68f88b43-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "10b39872-73df-4f7e-bafb-07fb68f88b43" (UID: "10b39872-73df-4f7e-bafb-07fb68f88b43"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:05:27.381705 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.381655    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10b39872-73df-4f7e-bafb-07fb68f88b43-kube-api-access-frmp9" (OuterVolumeSpecName: "kube-api-access-frmp9") pod "10b39872-73df-4f7e-bafb-07fb68f88b43" (UID: "10b39872-73df-4f7e-bafb-07fb68f88b43"). InnerVolumeSpecName "kube-api-access-frmp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:05:27.480848 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.480806    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frmp9\" (UniqueName: \"kubernetes.io/projected/10b39872-73df-4f7e-bafb-07fb68f88b43-kube-api-access-frmp9\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:05:27.480848 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.480841    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b39872-73df-4f7e-bafb-07fb68f88b43-plugins-config-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:05:27.614285 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.614254    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"]
Sep 16 01:05:27.620039 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.620012    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-2fa86d-5dcb7c67bf-l6mds"]
Sep 16 01:05:27.666868 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:05:27.666832    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10b39872-73df-4f7e-bafb-07fb68f88b43" path="/var/lib/kubelet/pods/10b39872-73df-4f7e-bafb-07fb68f88b43/volumes"
Sep 16 01:06:09.956459 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:06:09.956427    2563 scope.go:117] "RemoveContainer" containerID="88b63f0654ae87720507b686decefd330ed50ba65ac451a7e6c223eb661829fd"
Sep 16 01:06:09.964955 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:06:09.964930    2563 scope.go:117] "RemoveContainer" containerID="5970023e254c7a5ac0e15615912573ad68faab7a195d3250b3d1402021bf8cb1"
Sep 16 01:08:17.611066 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:17.611027    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"]
Sep 16 01:08:17.611578 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:17.611233    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq" podUID="29d88d27-904c-49e8-b284-26a5d2ad9974" containerName="manager" containerID="cri-o://19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333" gracePeriod=10
Sep 16 01:08:17.860368 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:17.860338    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"
Sep 16 01:08:17.996987 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:17.996957    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29d88d27-904c-49e8-b284-26a5d2ad9974-extensions-socket-volume\") pod \"29d88d27-904c-49e8-b284-26a5d2ad9974\" (UID: \"29d88d27-904c-49e8-b284-26a5d2ad9974\") "
Sep 16 01:08:17.996987 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:17.997001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjv5k\" (UniqueName: \"kubernetes.io/projected/29d88d27-904c-49e8-b284-26a5d2ad9974-kube-api-access-jjv5k\") pod \"29d88d27-904c-49e8-b284-26a5d2ad9974\" (UID: \"29d88d27-904c-49e8-b284-26a5d2ad9974\") "
Sep 16 01:08:17.997297 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:17.997272    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29d88d27-904c-49e8-b284-26a5d2ad9974-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "29d88d27-904c-49e8-b284-26a5d2ad9974" (UID: "29d88d27-904c-49e8-b284-26a5d2ad9974"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:08:17.999211 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:17.999191    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29d88d27-904c-49e8-b284-26a5d2ad9974-kube-api-access-jjv5k" (OuterVolumeSpecName: "kube-api-access-jjv5k") pod "29d88d27-904c-49e8-b284-26a5d2ad9974" (UID: "29d88d27-904c-49e8-b284-26a5d2ad9974"). InnerVolumeSpecName "kube-api-access-jjv5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:08:18.097649 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:18.097611    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29d88d27-904c-49e8-b284-26a5d2ad9974-extensions-socket-volume\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:08:18.097649 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:18.097642    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjv5k\" (UniqueName: \"kubernetes.io/projected/29d88d27-904c-49e8-b284-26a5d2ad9974-kube-api-access-jjv5k\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:08:18.153731 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:18.153693    2563 generic.go:356] "Generic (PLEG): container finished" podID="29d88d27-904c-49e8-b284-26a5d2ad9974" containerID="19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333" exitCode=0
Sep 16 01:08:18.153731 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:18.153727    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"
Sep 16 01:08:18.153943 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:18.153758    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq" event={"ID":"29d88d27-904c-49e8-b284-26a5d2ad9974","Type":"ContainerDied","Data":"19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333"}
Sep 16 01:08:18.153943 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:18.153813    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq" event={"ID":"29d88d27-904c-49e8-b284-26a5d2ad9974","Type":"ContainerDied","Data":"737c3be8765deb387e2141d75c3ee0da009a3bcb069160508d4a91ff82d118b9"}
Sep 16 01:08:18.153943 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:18.153836    2563 scope.go:117] "RemoveContainer" containerID="19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333"
Sep 16 01:08:18.163729 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:18.163712    2563 scope.go:117] "RemoveContainer" containerID="19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333"
Sep 16 01:08:18.163992 ip-10-0-136-16 kubenswrapper[2563]: E0916 01:08:18.163975    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333\": container with ID starting with 19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333 not found: ID does not exist" containerID="19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333"
Sep 16 01:08:18.164066 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:18.163998    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333"} err="failed to get container status \"19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333\": rpc error: code = NotFound desc = could not find container \"19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333\": container with ID starting with 19b16ffc254b4496093b287c8378811c8c078155fad510b5cb18feaa5137b333 not found: ID does not exist"
Sep 16 01:08:18.176175 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:18.176150    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"]
Sep 16 01:08:18.182082 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:18.182054    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-w4djq"]
Sep 16 01:08:19.671338 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:08:19.671300    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29d88d27-904c-49e8-b284-26a5d2ad9974" path="/var/lib/kubelet/pods/29d88d27-904c-49e8-b284-26a5d2ad9974/volumes"
Sep 16 01:09:10.007685 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:10.007638    2563 scope.go:117] "RemoveContainer" containerID="317afbdaacd95ec688c8b7730779576f0de1e679b923278c8cead033a0a48015"
Sep 16 01:09:18.464554 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.464518    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"]
Sep 16 01:09:18.464968 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.464919    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b6a0ff8-2141-40c5-8de9-44f328dda587" containerName="revoke-keys"
Sep 16 01:09:18.464968 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.464932    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b6a0ff8-2141-40c5-8de9-44f328dda587" containerName="revoke-keys"
Sep 16 01:09:18.464968 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.464946    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10b39872-73df-4f7e-bafb-07fb68f88b43" containerName="payload-processing"
Sep 16 01:09:18.464968 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.464953    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="10b39872-73df-4f7e-bafb-07fb68f88b43" containerName="payload-processing"
Sep 16 01:09:18.464968 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.464967    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29d88d27-904c-49e8-b284-26a5d2ad9974" containerName="manager"
Sep 16 01:09:18.465144 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.464976    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="29d88d27-904c-49e8-b284-26a5d2ad9974" containerName="manager"
Sep 16 01:09:18.465144 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.465002    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20110a96-69a1-468b-b8fc-bdfbc613584c" containerName="payload-pre-processing"
Sep 16 01:09:18.465144 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.465007    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="20110a96-69a1-468b-b8fc-bdfbc613584c" containerName="payload-pre-processing"
Sep 16 01:09:18.465144 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.465063    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b6a0ff8-2141-40c5-8de9-44f328dda587" containerName="revoke-keys"
Sep 16 01:09:18.465144 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.465073    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="20110a96-69a1-468b-b8fc-bdfbc613584c" containerName="payload-pre-processing"
Sep 16 01:09:18.465144 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.465079    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="10b39872-73df-4f7e-bafb-07fb68f88b43" containerName="payload-processing"
Sep 16 01:09:18.465144 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.465086    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="29d88d27-904c-49e8-b284-26a5d2ad9974" containerName="manager"
Sep 16 01:09:18.468145 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.468129    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"
Sep 16 01:09:18.470517 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.470486    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8hbc7\""
Sep 16 01:09:18.478119 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.478093    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"]
Sep 16 01:09:18.554237 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.554196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcfj9\" (UniqueName: \"kubernetes.io/projected/dc6142f2-2931-4ba5-b43a-414599d3a67b-kube-api-access-wcfj9\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l58n9\" (UID: \"dc6142f2-2931-4ba5-b43a-414599d3a67b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"
Sep 16 01:09:18.554435 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.554263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc6142f2-2931-4ba5-b43a-414599d3a67b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l58n9\" (UID: \"dc6142f2-2931-4ba5-b43a-414599d3a67b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"
Sep 16 01:09:18.655093 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.655053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc6142f2-2931-4ba5-b43a-414599d3a67b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l58n9\" (UID: \"dc6142f2-2931-4ba5-b43a-414599d3a67b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"
Sep 16 01:09:18.655275 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.655132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcfj9\" (UniqueName: \"kubernetes.io/projected/dc6142f2-2931-4ba5-b43a-414599d3a67b-kube-api-access-wcfj9\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l58n9\" (UID: \"dc6142f2-2931-4ba5-b43a-414599d3a67b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"
Sep 16 01:09:18.655453 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.655431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc6142f2-2931-4ba5-b43a-414599d3a67b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l58n9\" (UID: \"dc6142f2-2931-4ba5-b43a-414599d3a67b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"
Sep 16 01:09:18.669183 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.669145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcfj9\" (UniqueName: \"kubernetes.io/projected/dc6142f2-2931-4ba5-b43a-414599d3a67b-kube-api-access-wcfj9\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l58n9\" (UID: \"dc6142f2-2931-4ba5-b43a-414599d3a67b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"
Sep 16 01:09:18.779055 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:18.778964    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"
Sep 16 01:09:19.057609 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:19.057505    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"]
Sep 16 01:09:19.063052 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:09:19.063016    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc6142f2_2931_4ba5_b43a_414599d3a67b.slice/crio-25631c05239f2a40888fd91120829c00a3cbeae8a1607bbca7808fe38ed7cb6a WatchSource:0}: Error finding container 25631c05239f2a40888fd91120829c00a3cbeae8a1607bbca7808fe38ed7cb6a: Status 404 returned error can't find the container with id 25631c05239f2a40888fd91120829c00a3cbeae8a1607bbca7808fe38ed7cb6a
Sep 16 01:09:19.470818 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:19.470787    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9" event={"ID":"dc6142f2-2931-4ba5-b43a-414599d3a67b","Type":"ContainerStarted","Data":"1a6173ce0a5f7440583abae4a9b68dd126705ce4cc00b404964d5984aba3807f"}
Sep 16 01:09:19.471189 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:19.470838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9" event={"ID":"dc6142f2-2931-4ba5-b43a-414599d3a67b","Type":"ContainerStarted","Data":"25631c05239f2a40888fd91120829c00a3cbeae8a1607bbca7808fe38ed7cb6a"}
Sep 16 01:09:19.471189 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:19.470880    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"
Sep 16 01:09:19.488403 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:19.488347    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9" podStartSLOduration=1.488311528 podStartE2EDuration="1.488311528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:09:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:09:19.487634389 +0000 UTC m=+2110.290457456" watchObservedRunningTime="2026-09-16 01:09:19.488311528 +0000 UTC m=+2110.291134590"
Sep 16 01:09:30.479519 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:09:30.479488    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l58n9"
Sep 16 01:10:10.030904 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.030860    2563 scope.go:117] "RemoveContainer" containerID="89f8f79930c75aa7418374fa479e210fcf7933b2ee9ab5a774886be380e0b513"
Sep 16 01:10:10.039588 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.039564    2563 scope.go:117] "RemoveContainer" containerID="49403858f4dec3fe10875546383be2553476a5804c8453feda644e4278c18d4c"
Sep 16 01:10:10.047896 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.047874    2563 scope.go:117] "RemoveContainer" containerID="27147c395bd891f235def62e57a538bafd82f4dc1f9abcb91c672eb1249fc989"
Sep 16 01:10:10.056051 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.056026    2563 scope.go:117] "RemoveContainer" containerID="17979a7c7067b8096ad28418082ff90066338c710fc946c2e6f12242da6c1743"
Sep 16 01:10:10.064192 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.064172    2563 scope.go:117] "RemoveContainer" containerID="d0e146708d2b7a1cee1a139eeb4aabd7f6405e402b8b08425c5b3d221dc48d02"
Sep 16 01:10:10.301030 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.300932    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"]
Sep 16 01:10:10.306442 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.306417    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.309227 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.309200    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-0a42620d-kserve-self-signed-certs\""
Sep 16 01:10:10.311499 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.311473    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"]
Sep 16 01:10:10.458188 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.458146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-dshm\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.458392 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.458198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcbb56fa-4c71-43fc-8245-2cd729934315-tls-certs\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.458392 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.458231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxlrh\" (UniqueName: \"kubernetes.io/projected/dcbb56fa-4c71-43fc-8245-2cd729934315-kube-api-access-nxlrh\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.458392 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.458280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-home\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.458392 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.458306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-tmp-dir\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.458392 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.458324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-model-cache\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.559008 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.558912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxlrh\" (UniqueName: \"kubernetes.io/projected/dcbb56fa-4c71-43fc-8245-2cd729934315-kube-api-access-nxlrh\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.559008 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.558987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-home\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.559225 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.559023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-tmp-dir\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.559225 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.559040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-model-cache\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.559225 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.559105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-dshm\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.559225 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.559148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcbb56fa-4c71-43fc-8245-2cd729934315-tls-certs\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.559450 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.559367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-home\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.559450 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.559421    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-tmp-dir\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.559561 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.559512    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-model-cache\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.561689 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.561644    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-dshm\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.561814 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.561730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcbb56fa-4c71-43fc-8245-2cd729934315-tls-certs\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.567886 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.567862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxlrh\" (UniqueName: \"kubernetes.io/projected/dcbb56fa-4c71-43fc-8245-2cd729934315-kube-api-access-nxlrh\") pod \"e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") " pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.617853 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.617808    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:10.893047 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:10.893018    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"]
Sep 16 01:10:10.894746 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:10:10.894720    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcbb56fa_4c71_43fc_8245_2cd729934315.slice/crio-882d0c743b354c2e27353300fa0aef39e9629941a3fefe5943d4eec26a310b7d WatchSource:0}: Error finding container 882d0c743b354c2e27353300fa0aef39e9629941a3fefe5943d4eec26a310b7d: Status 404 returned error can't find the container with id 882d0c743b354c2e27353300fa0aef39e9629941a3fefe5943d4eec26a310b7d
Sep 16 01:10:11.737230 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:11.737187    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb" event={"ID":"dcbb56fa-4c71-43fc-8245-2cd729934315","Type":"ContainerStarted","Data":"72c82203e742afbc9db3fff81f38e908c93bf7c853b519f23d33acf804f823e9"}
Sep 16 01:10:11.737681 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:11.737239    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb" event={"ID":"dcbb56fa-4c71-43fc-8245-2cd729934315","Type":"ContainerStarted","Data":"882d0c743b354c2e27353300fa0aef39e9629941a3fefe5943d4eec26a310b7d"}
Sep 16 01:10:11.753045 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:11.752997    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb" podStartSLOduration=1.75297155 podStartE2EDuration="1.75297155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:10:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:10:11.7519244 +0000 UTC m=+2162.554747473" watchObservedRunningTime="2026-09-16 01:10:11.75297155 +0000 UTC m=+2162.555794613"
Sep 16 01:10:20.618628 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:20.618582    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:20.619259 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:20.618648    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:20.631353 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:20.631319    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:20.793029 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:20.792996    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:10:47.753312 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:10:47.753269    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"]
Sep 16 01:11:02.773400 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:02.773351    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb" podUID="dcbb56fa-4c71-43fc-8245-2cd729934315" containerName="main" containerID="cri-o://72c82203e742afbc9db3fff81f38e908c93bf7c853b519f23d33acf804f823e9" gracePeriod=45
Sep 16 01:11:02.985153 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:02.985120    2563 generic.go:356] "Generic (PLEG): container finished" podID="dcbb56fa-4c71-43fc-8245-2cd729934315" containerID="72c82203e742afbc9db3fff81f38e908c93bf7c853b519f23d33acf804f823e9" exitCode=0
Sep 16 01:11:02.985153 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:02.985159    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb" event={"ID":"dcbb56fa-4c71-43fc-8245-2cd729934315","Type":"ContainerDied","Data":"72c82203e742afbc9db3fff81f38e908c93bf7c853b519f23d33acf804f823e9"}
Sep 16 01:11:03.024315 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.024255    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:11:03.056193 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.056153    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcbb56fa-4c71-43fc-8245-2cd729934315-tls-certs\") pod \"dcbb56fa-4c71-43fc-8245-2cd729934315\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") "
Sep 16 01:11:03.056359 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.056209    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxlrh\" (UniqueName: \"kubernetes.io/projected/dcbb56fa-4c71-43fc-8245-2cd729934315-kube-api-access-nxlrh\") pod \"dcbb56fa-4c71-43fc-8245-2cd729934315\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") "
Sep 16 01:11:03.056359 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.056294    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-dshm\") pod \"dcbb56fa-4c71-43fc-8245-2cd729934315\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") "
Sep 16 01:11:03.056359 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.056327    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-tmp-dir\") pod \"dcbb56fa-4c71-43fc-8245-2cd729934315\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") "
Sep 16 01:11:03.056537 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.056381    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-home\") pod \"dcbb56fa-4c71-43fc-8245-2cd729934315\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") "
Sep 16 01:11:03.056537 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.056431    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-model-cache\") pod \"dcbb56fa-4c71-43fc-8245-2cd729934315\" (UID: \"dcbb56fa-4c71-43fc-8245-2cd729934315\") "
Sep 16 01:11:03.056656 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.056596    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dcbb56fa-4c71-43fc-8245-2cd729934315" (UID: "dcbb56fa-4c71-43fc-8245-2cd729934315"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:11:03.056747 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.056715    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-home" (OuterVolumeSpecName: "home") pod "dcbb56fa-4c71-43fc-8245-2cd729934315" (UID: "dcbb56fa-4c71-43fc-8245-2cd729934315"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:11:03.056863 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.056834    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-model-cache" (OuterVolumeSpecName: "model-cache") pod "dcbb56fa-4c71-43fc-8245-2cd729934315" (UID: "dcbb56fa-4c71-43fc-8245-2cd729934315"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:11:03.057164 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.057102    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-tmp-dir\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:11:03.057164 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.057127    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-home\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:11:03.057164 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.057141    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-model-cache\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:11:03.058744 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.058718    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-dshm" (OuterVolumeSpecName: "dshm") pod "dcbb56fa-4c71-43fc-8245-2cd729934315" (UID: "dcbb56fa-4c71-43fc-8245-2cd729934315"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:11:03.058855 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.058770    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcbb56fa-4c71-43fc-8245-2cd729934315-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dcbb56fa-4c71-43fc-8245-2cd729934315" (UID: "dcbb56fa-4c71-43fc-8245-2cd729934315"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 01:11:03.058916 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.058856    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcbb56fa-4c71-43fc-8245-2cd729934315-kube-api-access-nxlrh" (OuterVolumeSpecName: "kube-api-access-nxlrh") pod "dcbb56fa-4c71-43fc-8245-2cd729934315" (UID: "dcbb56fa-4c71-43fc-8245-2cd729934315"). InnerVolumeSpecName "kube-api-access-nxlrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:11:03.158451 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.158413    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcbb56fa-4c71-43fc-8245-2cd729934315-dshm\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:11:03.158451 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.158447    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcbb56fa-4c71-43fc-8245-2cd729934315-tls-certs\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:11:03.158451 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.158458    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxlrh\" (UniqueName: \"kubernetes.io/projected/dcbb56fa-4c71-43fc-8245-2cd729934315-kube-api-access-nxlrh\") on node \"ip-10-0-136-16.ec2.internal\" DevicePath \"\""
Sep 16 01:11:03.991375 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.991344    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"
Sep 16 01:11:03.991839 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.991346    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb" event={"ID":"dcbb56fa-4c71-43fc-8245-2cd729934315","Type":"ContainerDied","Data":"882d0c743b354c2e27353300fa0aef39e9629941a3fefe5943d4eec26a310b7d"}
Sep 16 01:11:03.991839 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:03.991472    2563 scope.go:117] "RemoveContainer" containerID="72c82203e742afbc9db3fff81f38e908c93bf7c853b519f23d33acf804f823e9"
Sep 16 01:11:04.008393 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:04.008364    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"]
Sep 16 01:11:04.014650 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:04.014617    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-0a42620d-kserve-fc58f7bff-j5hfb"]
Sep 16 01:11:05.667456 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:05.667423    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcbb56fa-4c71-43fc-8245-2cd729934315" path="/var/lib/kubelet/pods/dcbb56fa-4c71-43fc-8245-2cd729934315/volumes"
Sep 16 01:11:10.101216 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:10.101182    2563 scope.go:117] "RemoveContainer" containerID="a3388bf567f362af200a17e5a52ac3e8698d552e7a49ddce48776e791661e4e0"
Sep 16 01:11:10.109575 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:11:10.109554    2563 scope.go:117] "RemoveContainer" containerID="db4e17c58f68612970d4f8db7291b9bb5c14750ab2d605ca8c9d3340e0854772"
Sep 16 01:14:40.940644 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:40.940560    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6l74x_ff05bc9e-4000-447e-ba95-1c553022a157/global-pull-secret-syncer/0.log"
Sep 16 01:14:41.152929 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:41.152886    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v77nk_cd912ef0-02c8-41a2-84cb-4567e72d85ab/konnectivity-agent/0.log"
Sep 16 01:14:41.254743 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:41.254705    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-16.ec2.internal_0e0069b0aef7ee63595e298c66c4b96a/haproxy/0.log"
Sep 16 01:14:46.050793 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:46.050706    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-595f4fbd5-6r826_ae6b72ec-a9cf-499d-8b13-727a051da569/authorino/0.log"
Sep 16 01:14:46.127795 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:46.127763    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-ltsw4_6ca0a5c9-bf64-499f-88dd-0d8462228e9f/kuadrant-console-plugin/0.log"
Sep 16 01:14:46.180947 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:46.180910    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-l58n9_dc6142f2-2931-4ba5-b43a-414599d3a67b/manager/0.log"
Sep 16 01:14:47.567524 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:47.567491    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d21ea078-1e76-4528-a5a1-6a1a3b1b2803/alertmanager/0.log"
Sep 16 01:14:47.592882 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:47.592851    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d21ea078-1e76-4528-a5a1-6a1a3b1b2803/config-reloader/0.log"
Sep 16 01:14:47.614317 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:47.614216    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d21ea078-1e76-4528-a5a1-6a1a3b1b2803/kube-rbac-proxy-web/0.log"
Sep 16 01:14:47.635254 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:47.635226    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d21ea078-1e76-4528-a5a1-6a1a3b1b2803/kube-rbac-proxy/0.log"
Sep 16 01:14:47.674236 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:47.674211    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d21ea078-1e76-4528-a5a1-6a1a3b1b2803/kube-rbac-proxy-metric/0.log"
Sep 16 01:14:47.691676 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:47.691641    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d21ea078-1e76-4528-a5a1-6a1a3b1b2803/prom-label-proxy/0.log"
Sep 16 01:14:47.713127 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:47.713098    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d21ea078-1e76-4528-a5a1-6a1a3b1b2803/init-config-reloader/0.log"
Sep 16 01:14:47.875306 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:47.875211    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-758f9c44f-vbc4h_436485ec-b65c-4d7d-b1af-59d4b5219d4e/metrics-server/0.log"
Sep 16 01:14:47.901464 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:47.901433    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-vv6rr_fa6af43e-df1b-466f-a0ba-f4b36aef4781/monitoring-plugin/0.log"
Sep 16 01:14:48.113142 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.113101    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9wfd_e562619d-ddd7-47cc-8d6a-14735e687b60/node-exporter/0.log"
Sep 16 01:14:48.135784 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.135699    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9wfd_e562619d-ddd7-47cc-8d6a-14735e687b60/kube-rbac-proxy/0.log"
Sep 16 01:14:48.161350 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.161322    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9wfd_e562619d-ddd7-47cc-8d6a-14735e687b60/init-textfile/0.log"
Sep 16 01:14:48.291066 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.291025    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ab2d176-0b2b-4ace-9967-46d985adaeb1/prometheus/0.log"
Sep 16 01:14:48.311146 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.311116    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ab2d176-0b2b-4ace-9967-46d985adaeb1/config-reloader/0.log"
Sep 16 01:14:48.334456 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.334424    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ab2d176-0b2b-4ace-9967-46d985adaeb1/thanos-sidecar/0.log"
Sep 16 01:14:48.355422 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.355396    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ab2d176-0b2b-4ace-9967-46d985adaeb1/kube-rbac-proxy-web/0.log"
Sep 16 01:14:48.376866 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.376840    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ab2d176-0b2b-4ace-9967-46d985adaeb1/kube-rbac-proxy/0.log"
Sep 16 01:14:48.399606 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.399521    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ab2d176-0b2b-4ace-9967-46d985adaeb1/kube-rbac-proxy-thanos/0.log"
Sep 16 01:14:48.420923 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.420893    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ab2d176-0b2b-4ace-9967-46d985adaeb1/init-config-reloader/0.log"
Sep 16 01:14:48.499403 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.499366    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-pdd4p_70653cdb-96b6-49fa-9926-f3f500823bf7/prometheus-operator-admission-webhook/0.log"
Sep 16 01:14:48.609808 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.609778    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c9dc99d8-qqfzs_169e1119-441a-409d-8572-e40ba2a8e3f6/thanos-query/0.log"
Sep 16 01:14:48.632103 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.632063    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c9dc99d8-qqfzs_169e1119-441a-409d-8572-e40ba2a8e3f6/kube-rbac-proxy-web/0.log"
Sep 16 01:14:48.656427 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.656340    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c9dc99d8-qqfzs_169e1119-441a-409d-8572-e40ba2a8e3f6/kube-rbac-proxy/0.log"
Sep 16 01:14:48.678883 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.678852    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c9dc99d8-qqfzs_169e1119-441a-409d-8572-e40ba2a8e3f6/prom-label-proxy/0.log"
Sep 16 01:14:48.713798 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.713769    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c9dc99d8-qqfzs_169e1119-441a-409d-8572-e40ba2a8e3f6/kube-rbac-proxy-rules/0.log"
Sep 16 01:14:48.735841 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:48.735811    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c9dc99d8-qqfzs_169e1119-441a-409d-8572-e40ba2a8e3f6/kube-rbac-proxy-metrics/0.log"
Sep 16 01:14:51.003513 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.003472    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"]
Sep 16 01:14:51.003921 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.003853    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcbb56fa-4c71-43fc-8245-2cd729934315" containerName="main"
Sep 16 01:14:51.003921 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.003865    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcbb56fa-4c71-43fc-8245-2cd729934315" containerName="main"
Sep 16 01:14:51.004000 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.003925    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcbb56fa-4c71-43fc-8245-2cd729934315" containerName="main"
Sep 16 01:14:51.007026 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.007004    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.009096 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.009070    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jd2dw\"/\"default-dockercfg-v76dc\""
Sep 16 01:14:51.009227 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.009070    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jd2dw\"/\"kube-root-ca.crt\""
Sep 16 01:14:51.009560 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.009546    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jd2dw\"/\"openshift-service-ca.crt\""
Sep 16 01:14:51.014350 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.014324    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"]
Sep 16 01:14:51.078456 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.078418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdt9r\" (UniqueName: \"kubernetes.io/projected/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-kube-api-access-fdt9r\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.078653 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.078479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-podres\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.078653 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.078590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-proc\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.078653 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.078635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-sys\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.078860 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.078737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-lib-modules\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.179991 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.179946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-sys\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.180194 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.179996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-lib-modules\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.180194 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.180041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdt9r\" (UniqueName: \"kubernetes.io/projected/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-kube-api-access-fdt9r\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.180194 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.180080    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-sys\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.180194 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.180137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-podres\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.180416 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.180203    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-lib-modules\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.180416 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.180223    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-proc\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.180416 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.180280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-proc\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.180416 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.180310    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-podres\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.187583 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.187546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdt9r\" (UniqueName: \"kubernetes.io/projected/3a676f7d-8ef9-43a9-8453-497b34cc2cc0-kube-api-access-fdt9r\") pod \"perf-node-gather-daemonset-4fqdm\" (UID: \"3a676f7d-8ef9-43a9-8453-497b34cc2cc0\") " pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.293836 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.293743    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75b54c7b5f-46z8r_52aaff72-069a-4d13-a761-6963180670d2/console/0.log"
Sep 16 01:14:51.318459 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.318423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:51.590941 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:51.590817    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"]
Sep 16 01:14:51.593699 ip-10-0-136-16 kubenswrapper[2563]: W0916 01:14:51.593655    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3a676f7d_8ef9_43a9_8453_497b34cc2cc0.slice/crio-d599db9eccbee580c8a3faf65680c7421171e675894002e20c5acb16a87df911 WatchSource:0}: Error finding container d599db9eccbee580c8a3faf65680c7421171e675894002e20c5acb16a87df911: Status 404 returned error can't find the container with id d599db9eccbee580c8a3faf65680c7421171e675894002e20c5acb16a87df911
Sep 16 01:14:52.069061 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:52.069025    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm" event={"ID":"3a676f7d-8ef9-43a9-8453-497b34cc2cc0","Type":"ContainerStarted","Data":"d6dba15aed1e7749212bb9d30c89b3473b6fb4e0452a1febef66a1f09460a86e"}
Sep 16 01:14:52.069483 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:52.069083    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm" event={"ID":"3a676f7d-8ef9-43a9-8453-497b34cc2cc0","Type":"ContainerStarted","Data":"d599db9eccbee580c8a3faf65680c7421171e675894002e20c5acb16a87df911"}
Sep 16 01:14:52.069483 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:52.069147    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:14:52.085074 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:52.084974    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm" podStartSLOduration=2.084946463 podStartE2EDuration="2.084946463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:14:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:14:52.083179423 +0000 UTC m=+2442.886002485" watchObservedRunningTime="2026-09-16 01:14:52.084946463 +0000 UTC m=+2442.887769525"
Sep 16 01:14:53.246513 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:53.246485    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-52jxz_0b682231-d5f5-4481-9da5-138e7d76fbaf/dns/0.log"
Sep 16 01:14:53.271286 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:53.271260    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-52jxz_0b682231-d5f5-4481-9da5-138e7d76fbaf/kube-rbac-proxy/0.log"
Sep 16 01:14:53.405369 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:53.405340    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kgmhs_47514264-52fd-443e-9ba3-4bcb3f3717e5/dns-node-resolver/0.log"
Sep 16 01:14:54.006486 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:54.006455    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4k5j9_e79a602a-4cd5-45e4-b7f5-0315498e7dda/node-ca/0.log"
Sep 16 01:14:55.649163 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:55.649124    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bb4c8f6-5zfgr_7005cfcb-1670-4693-be3a-c46b6ccffba3/kube-auth-proxy/0.log"
Sep 16 01:14:56.695593 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:56.695543    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wxgq8_21ad5167-f857-4a02-b688-250965430ad5/serve-healthcheck-canary/0.log"
Sep 16 01:14:57.316542 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:57.316504    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m4czn_ed443896-245f-4066-8efd-543b1447e5da/kube-rbac-proxy/0.log"
Sep 16 01:14:57.337132 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:57.337104    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m4czn_ed443896-245f-4066-8efd-543b1447e5da/exporter/0.log"
Sep 16 01:14:57.358769 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:57.358733    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m4czn_ed443896-245f-4066-8efd-543b1447e5da/extractor/0.log"
Sep 16 01:14:58.084143 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:14:58.084117    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jd2dw/perf-node-gather-daemonset-4fqdm"
Sep 16 01:15:00.209514 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:00.209482    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55d645f7ff-rgj9q_20452936-0e7c-472a-b7fa-6f69ebf322e2/manager/0.log"
Sep 16 01:15:00.230583 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:00.230551    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55d645f7ff-rgj9q_20452936-0e7c-472a-b7fa-6f69ebf322e2/copy-manifests/0.log"
Sep 16 01:15:01.904087 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:01.904051    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-864798458c-glhn5_f51604b0-65c0-44e7-a8ee-d7f1516ede35/manager/0.log"
Sep 16 01:15:02.649621 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:02.649597    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bb4c8f6-5zfgr_7005cfcb-1670-4693-be3a-c46b6ccffba3/kube-auth-proxy/0.log"
Sep 16 01:15:04.964235 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:04.964205    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bb4c8f6-5zfgr_7005cfcb-1670-4693-be3a-c46b6ccffba3/kube-auth-proxy/0.log"
Sep 16 01:15:08.540062 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:08.540033    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7n9lz_89e23aa3-969a-40ab-8ed1-8c1b7bb63199/kube-multus-additional-cni-plugins/0.log"
Sep 16 01:15:08.563407 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:08.563382    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7n9lz_89e23aa3-969a-40ab-8ed1-8c1b7bb63199/egress-router-binary-copy/0.log"
Sep 16 01:15:08.586142 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:08.586115    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7n9lz_89e23aa3-969a-40ab-8ed1-8c1b7bb63199/cni-plugins/0.log"
Sep 16 01:15:08.609216 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:08.609181    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7n9lz_89e23aa3-969a-40ab-8ed1-8c1b7bb63199/bond-cni-plugin/0.log"
Sep 16 01:15:08.630999 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:08.630969    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7n9lz_89e23aa3-969a-40ab-8ed1-8c1b7bb63199/routeoverride-cni/0.log"
Sep 16 01:15:08.652907 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:08.652878    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7n9lz_89e23aa3-969a-40ab-8ed1-8c1b7bb63199/whereabouts-cni-bincopy/0.log"
Sep 16 01:15:08.674765 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:08.674734    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7n9lz_89e23aa3-969a-40ab-8ed1-8c1b7bb63199/whereabouts-cni/0.log"
Sep 16 01:15:08.949307 ip-10-0-136-16 kubenswrapper[2563]: I0916 01:15:08.949271    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hbvgv_55345e74-4778-4460-96e8-5bc1d01532fb/kube-multus/0.log"