Jul 27 15:05:44.013600 ip-10-0-143-164 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 15:05:44.433914 ip-10-0-143-164 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 15:05:44.433914 ip-10-0-143-164 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 15:05:44.433914 ip-10-0-143-164 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 15:05:44.433914 ip-10-0-143-164 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 15:05:44.433914 ip-10-0-143-164 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 15:05:44.436439 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.436354    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 15:05:44.441576 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441561    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:05:44.441576 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441577    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441581    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441584    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441586    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441589    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441591    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441596    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441599    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441603    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441606    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441608    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441611    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441614    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441622    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441625    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441628    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441631    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441634    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441637    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:05:44.441643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441640    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441643    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441646    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441649    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441651    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441654    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441657    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441660    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441662    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441664    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441667    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441669    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441671    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441675    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441679    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441681    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441684    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441686    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441688    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:05:44.442144 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441691    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441693    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441696    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441698    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441700    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441703    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441705    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441707    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441710    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441713    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441715    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441717    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441725    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441727    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441731    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441734    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441737    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441739    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441742    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441744    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:05:44.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441747    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441749    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441752    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441754    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441756    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441759    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441761    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441764    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441767    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441770    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441772    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441774    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441776    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441779    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441781    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441783    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441785    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441788    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441790    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441792    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:05:44.443369 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441795    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441836    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441873    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441876    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441879    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441883    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441886    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441889    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441892    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441895    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441898    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441901    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441904    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441906    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441909    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441915    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441917    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441920    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441922    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.441925    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:05:44.443850 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443619    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443628    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443631    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443635    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443637    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443641    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443644    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443647    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443649    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443652    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443655    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443657    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443660    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443662    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443665    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443667    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443670    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443672    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443675    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443678    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:05:44.444307 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443680    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443682    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443686    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443689    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443694    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443698    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443701    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443704    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443707    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443709    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443711    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443715    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443718    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443720    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443723    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443726    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443728    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443731    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443734    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443736    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:05:44.444788 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443738    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443740    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443743    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443745    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443747    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443750    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443754    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443757    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443760    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443762    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443765    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443768    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443770    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443773    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443776    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443779    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443781    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443784    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443786    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443788    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:05:44.445261 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443791    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443793    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443795    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443798    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443802    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443804    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443808    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443810    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443812    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443815    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443818    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443820    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443822    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443825    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443827    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443831    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443834    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443837    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443840    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:05:44.445736 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443842    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443845    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443847    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443849    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443853    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443857    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443860    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443862    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443865    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443868    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443871    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443873    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443875    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443878    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443880    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443882    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443885    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443888    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443891    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:05:44.446185 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.443893    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444276    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444281    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444285    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444289    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444292    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444294    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444297    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444300    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444302    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444305    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444308    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444329    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444334    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444337    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444340    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444342    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444345    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444348    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:05:44.446658 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444350    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444353    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444356    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444359    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444361    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444364    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444367    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444370    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444373    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444375    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444378    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444380    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444384    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444387    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444389    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444392    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444394    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444396    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444399    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444401    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:05:44.447103 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444403    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444405    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444408    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444410    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444412    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444415    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444417    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444419    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444421    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444424    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444426    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444429    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444431    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444433    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444436    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444438    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444441    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444444    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444448    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:05:44.447597 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444451    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444454    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444456    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444459    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444461    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444465    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444469    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444471    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444473    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444476    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444478    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444481    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444483    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444486    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444488    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444490    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444492    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444495    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444497    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444500    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:05:44.448078 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444502    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444504    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444506    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444509    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444511    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444514    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444516    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444519    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444521    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444525    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444528    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444530    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444533    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444535    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444537    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444539    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444542    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444544    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444546    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:05:44.448550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444555    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444558    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.444561    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444636    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444646    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444658    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444664    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444669    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444673    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444677    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444681    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444684    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444686    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444690    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444693    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444696    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444699    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444702    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444705    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444708    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444711    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444715    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444718    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444721    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 15:05:44.448988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444724    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444728    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444731    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444734    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444737    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444740    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444743    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444746    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444748    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444752    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444755    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444759    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444762    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444764    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444767    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444770    2559 flags.go:64] FLAG: --enable-server="true"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444772    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444776    2559 flags.go:64] FLAG: --event-burst="100"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444779    2559 flags.go:64] FLAG: --event-qps="50"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444781    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444785    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444787    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444791    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444794    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444799    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 15:05:44.449590 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444802    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444805    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444808    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444811    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444814    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444817    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444820    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444822    2559 flags.go:64] FLAG: --feature-gates=""
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444826    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444829    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444831    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444834    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444837    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444840    2559 flags.go:64] FLAG: --help="false"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444842    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-143-164.ec2.internal"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444845    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444848    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444851    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444854    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444857    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444860    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444863    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444865    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 15:05:44.450157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444868    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444870    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444874    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444876    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444879    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444881    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444885    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444887    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444891    2559 flags.go:64] FLAG: --lock-file=""
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444894    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444897    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444899    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444904    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444907    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444910    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444912    2559 flags.go:64] FLAG: --logging-format="text"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444915    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444918    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444921    2559 flags.go:64] FLAG: --manifest-url=""
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444923    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444927    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444930    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444934    2559 flags.go:64] FLAG: --max-pods="110"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444937    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444939    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 15:05:44.450747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444942    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444945    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444948    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444951    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444954    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444963    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444966    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444968    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444971    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444974    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444980    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444982    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444985    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444988    2559 flags.go:64] FLAG: --port="10250"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444991    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444994    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dfe4c8e472a18a4c"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.444998    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445000    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445003    2559 flags.go:64] FLAG: --register-node="true"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445006    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445009    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445012    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445015    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445018    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445021    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 15:05:44.451344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445024    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445027    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445029    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445032    2559 flags.go:64] FLAG: --runonce="false"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445035    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445038    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445040    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445043    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445045    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445048    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445052    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445055    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445059    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445061    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445064    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445066    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445069    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445072    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445074    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445079    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445081    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445084    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445094    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445098    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445110    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 15:05:44.452002 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445113    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445116    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445118    2559 flags.go:64] FLAG: --v="2"
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445127    2559 flags.go:64] FLAG: --version="false"
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445131    2559 flags.go:64] FLAG: --vmodule=""
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445134    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.445138    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445252    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445255    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445258    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445261    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445264    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445267    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445269    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445272    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445275    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445277    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445280    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445283    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445287    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445290    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:05:44.452609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445292    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445295    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445297    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445299    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445302    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445304    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445307    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445309    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445328    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445335    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445338    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445340    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445343    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445345    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445348    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445351    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445353    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445355    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445358    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445361    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:05:44.453120 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445363    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445366    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445368    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445371    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445373    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445377    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445381    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445384    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445386    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445389    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445396    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445399    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445402    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445404    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445406    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445409    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445411    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445414    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445416    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:05:44.453609 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445419    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445421    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445425    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445427    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445430    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445432    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445434    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445437    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445439    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445442    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445444    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445447    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445449    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445452    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445454    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445456    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445459    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445461    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445465    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:05:44.454081 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445468    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445471    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445474    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445476    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445480    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445483    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445485    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445487    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445491    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445494    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445497    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445500    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445502    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445505    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445508    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445511    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445514    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445517    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445519    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445522    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:05:44.454541 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445524    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445526    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445529    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445531    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445534    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445536    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.445538    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.446181    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.453423    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.453440    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.454755    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.454766    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454823    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454829    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454832    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:05:44.455003 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454834    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454837    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454840    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454843    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454845    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454849    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454853    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454856    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454860    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454864    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454866    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454869    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454872    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454875    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454877    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454880    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454883    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454886    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454889    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:05:44.455454 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454892    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454894    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454897    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454900    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454902    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454905    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454908    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454911    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454913    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454915    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454918    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454920    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454923    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454925    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454928    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454931    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454934    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454936    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454939    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454941    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:05:44.455889 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454944    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454947    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454949    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454951    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454954    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454956    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454959    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454961    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454964    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454966    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454969    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454971    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454973    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454976    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454978    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454981    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454983    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454986    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454989    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454992    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:05:44.456361 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454994    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.454997    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455000    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455002    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455004    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455007    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455010    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455012    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455015    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455019    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455021    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455024    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455026    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455028    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455031    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455033    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455035    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455038    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455041    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455043    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:05:44.456835 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455046    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455049    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455051    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455053    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455056    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455058    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455061    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455063    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455065    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455068    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455071    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455074    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455076    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455079    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455081    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455084    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:05:44.457301 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455086    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.455091    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455198    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455203    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455206    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455209    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455212    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455215    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455217    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455219    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455223    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455226    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455228    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455231    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:05:44.457679 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455233    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455235    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455238    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455240    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455243    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455245    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455248    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455250    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455252    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455255    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455257    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455260    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455262    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455265    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455267    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455269    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455272    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455274    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455276    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:05:44.458013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455280    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455283    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455286    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455289    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455291    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455294    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455297    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455299    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455302    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455304    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455306    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455309    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455328    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455333    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455337    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455340    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455342    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455345    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455348    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455351    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:05:44.458475 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455354    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455357    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455360    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455363    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455366    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455368    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455371    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455373    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455376    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455378    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455380    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455383    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455385    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455387    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455390    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455392    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455394    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455397    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455399    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455402    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:05:44.458936 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455405    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455407    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455410    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455412    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455414    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455416    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455419    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455421    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455423    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455425    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455428    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455430    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455433    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455435    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455438    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455440    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455443    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455446    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455449    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:05:44.459406 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455451    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455454    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455457    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455459    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455462    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455465    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455467    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455470    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:44.455472    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.455477    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.455583    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.457589    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.458844    2559 server.go:1019] "Starting client certificate rotation"
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.458936    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 15:05:44.459839 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.459006    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 15:05:44.461179 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.461165    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 15:05:44.465360 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.465335    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 15:05:44.472608 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.472588    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 27 15:05:44.474454 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.474442    2559 log.go:25] "Validated CRI v1 image API"
Jul 27 15:05:44.476389 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.476367    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 15:05:44.478980 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.478962    2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c712969e-d544-4a5c-87a0-148bdcabf774:/dev/nvme0n1p3 d88c35c4-1313-4e63-aace-98f2d64e1cc4:/dev/nvme0n1p4]
Jul 27 15:05:44.479032 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.478980    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 15:05:44.483867 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.483766    2559 manager.go:216] Machine: {Timestamp:2026-07-27 15:05:44.482454971 +0000 UTC m=+0.347032828 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3189033 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f8589e513d699e068d0f55bb803ec SystemUUID:ec2f8589-e513-d699-e068-d0f55bb803ec BootID:c1ddd6ad-2b8b-4329-9784-0dcdec41511d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:70:6a:ed:58:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:70:6a:ed:58:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:68:2e:08:66:6d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 15:05:44.483867 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.483863    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 15:05:44.483964 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.483929    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 15:05:44.487249 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.487224    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 15:05:44.487407 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.487252    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-164.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 15:05:44.487998 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.487988    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 15:05:44.488033 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.488000    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 15:05:44.488033 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.488009    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 15:05:44.488771 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.488754    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 15:05:44.488994 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.488983    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 15:05:44.489880 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.489870    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 15:05:44.491759 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.491747    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 15:05:44.491880 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.491870    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 15:05:44.491909 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.491904    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 15:05:44.491935 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.491922    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 15:05:44.491935 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.491934    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 15:05:44.491991 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.491943    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 27 15:05:44.491991 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.491952    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 15:05:44.492295 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.492284    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 15:05:44.492352 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.492303    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 15:05:44.496081 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.496064    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 15:05:44.497725 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.497713    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 15:05:44.497776 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.497742    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 15:05:44.499161 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.499149    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 15:05:44.499221 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.499188    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 15:05:44.499221 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.499195    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 15:05:44.499221 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.499203    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 15:05:44.499221 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.499214    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 15:05:44.499221 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.499220    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 15:05:44.499385 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.499228    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 15:05:44.499385 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.499233    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 15:05:44.499385 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.499240    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 15:05:44.499385 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.499245    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 15:05:44.499385 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.499262    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 15:05:44.499385 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.499267    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 15:05:44.500122 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.500111    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 15:05:44.500122 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.500122    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 15:05:44.502131 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.502110    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-164.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 15:05:44.502180 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.502134    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 15:05:44.502265 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.502250    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 15:05:44.503291 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.503279    2559 server.go:1268] "Started kubelet"
Jul 27 15:05:44.503483 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.503373    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 15:05:44.503483 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.503403    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 15:05:44.503483 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.503476    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 15:05:44.504218 ip-10-0-143-164 systemd[1]: Started Kubernetes Kubelet.
Jul 27 15:05:44.505135 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.504929    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 15:05:44.510847 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.510116    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 15:05:44.510847 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.510244    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 15:05:44.513294 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.512233    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-164.ec2.internal.18c62de07daae27f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-164.ec2.internal,UID:ip-10-0-143-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-164.ec2.internal,},FirstTimestamp:2026-07-27 15:05:44.503255679 +0000 UTC m=+0.367833538,LastTimestamp:2026-07-27 15:05:44.503255679 +0000 UTC m=+0.367833538,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-164.ec2.internal,}"
Jul 27 15:05:44.514981 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.514954    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 15:05:44.514981 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.514966    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 15:05:44.515126 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.515044    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:44.515532 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.515511    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 15:05:44.515629 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.515613    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 15:05:44.515629 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.515627    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 15:05:44.515828 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.515717    2559 factory.go:55] Registering systemd factory
Jul 27 15:05:44.515828 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.515730    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 27 15:05:44.515828 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.515745    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 15:05:44.515828 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.515753    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 15:05:44.516245 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.515908    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j46lv"
Jul 27 15:05:44.516245 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.516135    2559 factory.go:153] Registering CRI-O factory
Jul 27 15:05:44.516245 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.516147    2559 factory.go:223] Registration of the crio container factory successfully
Jul 27 15:05:44.516465 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.516251    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 15:05:44.516465 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.516275    2559 factory.go:103] Registering Raw factory
Jul 27 15:05:44.516465 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.516292    2559 manager.go:1196] Started watching for new ooms in manager
Jul 27 15:05:44.516593 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.516588    2559 manager.go:349] Starting recovery of all containers
Jul 27 15:05:44.523625 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.523486    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j46lv"
Jul 27 15:05:44.525733 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.525587    2559 manager.go:354] Recovery completed
Jul 27 15:05:44.527133 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.527104    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 15:05:44.527216 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.527126    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 15:05:44.529771 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.529758    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:05:44.531509 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.531495    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:05:44.531566 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.531520    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:05:44.531566 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.531533    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:05:44.531987 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.531974    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 15:05:44.531987 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.531986    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 15:05:44.532100 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.532000    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 15:05:44.532100 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.532049    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:05:44.532732 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.532711    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:05:44.532770 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.532738    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:05:44.532770 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.532749    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:05:44.533542 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.533527    2559 policy_none.go:49] "None policy: Start"
Jul 27 15:05:44.533542 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.533543    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 15:05:44.533645 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.533552    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 15:05:44.534539 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.534529    2559 policy_none.go:47] "Start"
Jul 27 15:05:44.577864 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.577847    2559 manager.go:337] "Starting Device Plugin manager"
Jul 27 15:05:44.577971 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.577877    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 15:05:44.577971 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.577886    2559 server.go:87] "Starting device plugin registration server"
Jul 27 15:05:44.578129 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.578118    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 15:05:44.578160 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.578133    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 15:05:44.578247 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.578226    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 15:05:44.578370 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.578332    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 15:05:44.578370 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.578342    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 15:05:44.578817 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.578800    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 15:05:44.578879 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.578848    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:44.678571 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.678530    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:05:44.679589 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.679575    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:05:44.679642 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.679604    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:05:44.679642 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.679615    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:05:44.679703 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.679644    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-164.ec2.internal"
Jul 27 15:05:44.687138 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.687097    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-164.ec2.internal"
Jul 27 15:05:44.687138 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.687120    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-164.ec2.internal\": node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:44.694401 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.694377    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:44.704256 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.704230    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 15:05:44.705591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.705570    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 15:05:44.705671 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.705602    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 15:05:44.705671 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.705622    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 15:05:44.705671 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.705651    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 15:05:44.707022 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.706999    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:05:44.794508 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.794449    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:44.806636 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.806609    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal"]
Jul 27 15:05:44.806694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.806679    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:05:44.807763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.807743    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:05:44.807868 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.807777    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:05:44.807868 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.807794    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:05:44.809007 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.808992    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:05:44.809147 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.809130    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:44.809194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.809166    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:05:44.811964 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.811941    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:05:44.812068 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.811976    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:05:44.812068 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.811989    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:05:44.812068 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.811999    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:05:44.812068 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.812020    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:05:44.812068 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.812034    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:05:44.813246 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.813233    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:44.813300 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.813259    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:05:44.814287 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.814273    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:05:44.814373 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.814299    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:05:44.814373 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.814326    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:05:44.844108 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.844079    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-164.ec2.internal\" not found" node="ip-10-0-143-164.ec2.internal"
Jul 27 15:05:44.848355 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.848340    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-164.ec2.internal\" not found" node="ip-10-0-143-164.ec2.internal"
Jul 27 15:05:44.895125 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.895093    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:44.916493 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.916464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b8a60cdf8b1d315ea61b277dedead6a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-164.ec2.internal\" (UID: \"9b8a60cdf8b1d315ea61b277dedead6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:44.916614 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.916500    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d0c1ff884bdd9496706e8ac4b4131e01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal\" (UID: \"d0c1ff884bdd9496706e8ac4b4131e01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:44.916614 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:44.916529    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0c1ff884bdd9496706e8ac4b4131e01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal\" (UID: \"d0c1ff884bdd9496706e8ac4b4131e01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:44.995935 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:44.995861    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:45.017154 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.017128    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d0c1ff884bdd9496706e8ac4b4131e01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal\" (UID: \"d0c1ff884bdd9496706e8ac4b4131e01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:45.017221 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.017165    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0c1ff884bdd9496706e8ac4b4131e01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal\" (UID: \"d0c1ff884bdd9496706e8ac4b4131e01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:45.017221 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.017179    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b8a60cdf8b1d315ea61b277dedead6a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-164.ec2.internal\" (UID: \"9b8a60cdf8b1d315ea61b277dedead6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:45.017221 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.017194    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d0c1ff884bdd9496706e8ac4b4131e01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal\" (UID: \"d0c1ff884bdd9496706e8ac4b4131e01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:45.017354 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.017224    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b8a60cdf8b1d315ea61b277dedead6a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-164.ec2.internal\" (UID: \"9b8a60cdf8b1d315ea61b277dedead6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:45.017354 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.017232    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0c1ff884bdd9496706e8ac4b4131e01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal\" (UID: \"d0c1ff884bdd9496706e8ac4b4131e01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:45.096261 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:45.096243    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:45.146759 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.146736    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:45.151657 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.151640    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:45.197042 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:45.197014    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:45.297545 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:45.297463    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:45.397971 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:45.397933    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:45.410526 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.410504    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:05:45.458238 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.458203    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 15:05:45.458742 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.458383    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 15:05:45.458742 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.458383    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 15:05:45.498636 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:45.498611    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:45.528774 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.528733    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 15:00:44 +0000 UTC" deadline="2028-02-22 07:42:49.388055378 +0000 UTC"
Jul 27 15:05:45.528774 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.528769    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13792h37m3.85928965s"
Jul 27 15:05:45.599816 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:45.599786    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:45.700529 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:45.700493    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:45.733738 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:45.733692    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c1ff884bdd9496706e8ac4b4131e01.slice/crio-b71c6ed0ee3ecf0d79c8c4cbb2bb055973fb175701ad03b6498a6ed60bff5c29 WatchSource:0}: Error finding container b71c6ed0ee3ecf0d79c8c4cbb2bb055973fb175701ad03b6498a6ed60bff5c29: Status 404 returned error can't find the container with id b71c6ed0ee3ecf0d79c8c4cbb2bb055973fb175701ad03b6498a6ed60bff5c29
Jul 27 15:05:45.734106 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:45.734085    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8a60cdf8b1d315ea61b277dedead6a.slice/crio-d0d67afa1433fee4c508306d86142cc2c84967df56e6b832228def2de1d39b6a WatchSource:0}: Error finding container d0d67afa1433fee4c508306d86142cc2c84967df56e6b832228def2de1d39b6a: Status 404 returned error can't find the container with id d0d67afa1433fee4c508306d86142cc2c84967df56e6b832228def2de1d39b6a
Jul 27 15:05:45.738109 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.738091    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 15:05:45.800793 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:45.800765    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:45.901822 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:45.901771    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found"
Jul 27 15:05:45.957830 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.957806    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:05:45.999118 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:45.999093    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:05:46.015870 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.015845    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:46.026150 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.026130    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 15:05:46.028673 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.028660    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal"
Jul 27 15:05:46.038673 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.038656    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 15:05:46.474997 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.474971    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:05:46.493143 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.493122    2559 apiserver.go:52] "Watching apiserver"
Jul 27 15:05:46.505542 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.505504    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 15:05:46.507764 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.507738    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal","openshift-dns/node-resolver-z7jm2","openshift-image-registry/node-ca-9w9v7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal","openshift-multus/multus-9fhlm","openshift-multus/multus-additional-cni-plugins-mp4j8","openshift-multus/network-metrics-daemon-5vv4s","openshift-network-operator/iptables-alerter-xp9fs","kube-system/global-pull-secret-syncer-5rjcj","kube-system/konnectivity-agent-b8dzk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd","openshift-cluster-node-tuning-operator/tuned-g7bx6","openshift-network-diagnostics/network-check-target-jtzks","openshift-ovn-kubernetes/ovnkube-node-kllht"]
Jul 27 15:05:46.509349 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.509310    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.510756 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.510735    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.511970 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.511919    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:46.512087 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:46.512004    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:05:46.512279 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.512252    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 15:05:46.512378 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.512300    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 15:05:46.512571 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.512555    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 15:05:46.512644 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.512607    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 15:05:46.512701 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.512610    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-chjkj\""
Jul 27 15:05:46.513250 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.513233    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.514747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.514718    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 15:05:46.514854 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.514767    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b8dzk"
Jul 27 15:05:46.514946 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.514927    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 15:05:46.515009 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.514954    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rwmd4\""
Jul 27 15:05:46.515077 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.515006    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 15:05:46.515385 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.515366    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 15:05:46.515477 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.515383    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 15:05:46.515477 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.515399    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 15:05:46.515651 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.515370    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 15:05:46.516435 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.516123    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:46.516435 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:46.516198    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:05:46.516435 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.516208    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 15:05:46.516435 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.516244    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 15:05:46.516435 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.516347    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g4xvv\""
Jul 27 15:05:46.517208 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.517190    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 15:05:46.517524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.517503    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 15:05:46.517606 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.517504    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-plp5z\""
Jul 27 15:05:46.517973 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.517762    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xp9fs"
Jul 27 15:05:46.519488 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.519465    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:46.519588 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:46.519536    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:05:46.519845 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.519827    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 15:05:46.520131 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.520112    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 15:05:46.520536 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.520517    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gbpvp\""
Jul 27 15:05:46.520636 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.520554    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:05:46.520815 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.520791    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.522269 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.522248    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.523075 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.523056    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 15:05:46.523476 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.523455    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sz6gt\""
Jul 27 15:05:46.523581 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.523515    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 15:05:46.523822 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.523799    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9w9v7"
Jul 27 15:05:46.524240 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.524229    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 15:05:46.524774 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.524758    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gphkj\""
Jul 27 15:05:46.524862 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.524831    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 15:05:46.524972 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.524936    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:05:46.525221 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.525295 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzkjz\" (UniqueName: \"kubernetes.io/projected/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-kube-api-access-lzkjz\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.525295 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/509524ea-252e-4068-9426-33f81a298f39-multus-daemon-config\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.525295 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525267    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-cni-bin\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.525295 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525277    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z7jm2"
Jul 27 15:05:46.525295 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2qwq\" (UniqueName: \"kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq\") pod \"network-check-target-jtzks\" (UID: \"78c9654d-657e-4a4c-838a-625d9c7a5a79\") " pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:46.525530 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-multus-socket-dir-parent\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.525530 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-run-multus-certs\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.525530 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525354    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-slash\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.525530 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-var-lib-openvswitch\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.525530 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525383    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-etc-openvswitch\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.525530 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-run-ovn-kubernetes\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.525793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-cnibin\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.525793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525572    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:46.525793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6xn5\" (UniqueName: \"kubernetes.io/projected/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-kube-api-access-q6xn5\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:46.525793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-multus-cni-dir\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.525793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525732    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-var-lib-cni-multus\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.525793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-multus-conf-dir\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.525793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525790    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-etc-kubernetes\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.526096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-systemd-units\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.526096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525831    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-os-release\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.526096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.526096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525878    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-system-cni-dir\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.526096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525913    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-run-k8s-cni-cncf-io\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.526096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525940    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-run-netns\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.526096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-run-netns\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.526096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.525992    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.526096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526026    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69aca711-2e82-44e2-bc84-bef248d6bed1-ovnkube-config\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.526096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526066    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-system-cni-dir\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.526096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bedd3dda-9383-4cb1-86b5-56cb2089bc64-agent-certs\") pod \"konnectivity-agent-b8dzk\" (UID: \"bedd3dda-9383-4cb1-86b5-56cb2089bc64\") " pod="kube-system/konnectivity-agent-b8dzk"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526122    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526120    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-cnibin\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526166    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-var-lib-cni-bin\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-run-systemd\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526242    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69aca711-2e82-44e2-bc84-bef248d6bed1-env-overrides\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69aca711-2e82-44e2-bc84-bef248d6bed1-ovn-node-metrics-cert\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526319    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-os-release\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526383    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-hostroot\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526407    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjbkc\" (UniqueName: \"kubernetes.io/projected/509524ea-252e-4068-9426-33f81a298f39-kube-api-access-jjbkc\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526438    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-run-ovn\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526460    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-log-socket\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69aca711-2e82-44e2-bc84-bef248d6bed1-ovnkube-script-lib\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwrjs\" (UniqueName: \"kubernetes.io/projected/69aca711-2e82-44e2-bc84-bef248d6bed1-kube-api-access-mwrjs\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526566    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bedd3dda-9383-4cb1-86b5-56cb2089bc64-konnectivity-ca\") pod \"konnectivity-agent-b8dzk\" (UID: \"bedd3dda-9383-4cb1-86b5-56cb2089bc64\") " pod="kube-system/konnectivity-agent-b8dzk"
Jul 27 15:05:46.526591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526593    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 15:05:46.527289 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526607    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vwsgk\""
Jul 27 15:05:46.527289 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509524ea-252e-4068-9426-33f81a298f39-cni-binary-copy\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.527289 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526655    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-kubelet\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.527289 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526680    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-cni-netd\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.527289 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.527289 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526727    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-var-lib-kubelet\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.527289 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526751    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-run-openvswitch\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.527289 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526774    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-node-log\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.527289 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.526799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.527858 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.527840    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 15:05:46.527927 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.527854    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 15:05:46.527977 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.527860    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mnxpm\""
Jul 27 15:05:46.528636 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.528379    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 15:05:46.555511 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.555486    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-htgs5"
Jul 27 15:05:46.561475 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.561452    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-htgs5"
Jul 27 15:05:46.616533 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.616509    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 15:05:46.627470 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627449    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-log-socket\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.627562 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwrjs\" (UniqueName: \"kubernetes.io/projected/69aca711-2e82-44e2-bc84-bef248d6bed1-kube-api-access-mwrjs\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.627562 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627495    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-sys\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.627562 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-cni-netd\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.627730 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627583    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-cni-netd\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.627730 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627583    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-log-socket\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.627730 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627605    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-sysconfig\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.627730 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-kubernetes\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.627730 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/248f3f2d-01bf-4af5-91fa-7fe07ef36dd5-iptables-alerter-script\") pod \"iptables-alerter-xp9fs\" (UID: \"248f3f2d-01bf-4af5-91fa-7fe07ef36dd5\") " pod="openshift-network-operator/iptables-alerter-xp9fs"
Jul 27 15:05:46.627730 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627686    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-socket-dir\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.628029 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627743    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.628029 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627775    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzkjz\" (UniqueName: \"kubernetes.io/projected/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-kube-api-access-lzkjz\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.628029 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627802    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-etc-selinux\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.628029 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627841    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-multus-socket-dir-parent\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.628029 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627866    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-slash\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.628029 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-var-lib-openvswitch\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.628029 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627913    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-etc-openvswitch\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.628029 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627937    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-run-ovn-kubernetes\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.628029 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627963    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69aca711-2e82-44e2-bc84-bef248d6bed1-ovn-node-metrics-cert\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.628029 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.627987    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-cnibin\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.628029 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6xn5\" (UniqueName: \"kubernetes.io/projected/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-kube-api-access-q6xn5\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-multus-cni-dir\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628062    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-var-lib-cni-multus\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-multus-conf-dir\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628107    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-etc-kubernetes\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-lib-modules\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628166    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5r2m\" (UniqueName: \"kubernetes.io/projected/3c38f52d-338f-4a06-a385-3276421472ce-kube-api-access-v5r2m\") pod \"node-resolver-z7jm2\" (UID: \"3c38f52d-338f-4a06-a385-3276421472ce\") " pod="openshift-dns/node-resolver-z7jm2"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628214    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-multus-socket-dir-parent\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-run-k8s-cni-cncf-io\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-run-k8s-cni-cncf-io\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628263    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-run-netns\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628297    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-run-netns\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628296    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-var-lib-kubelet\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77ww6\" (UniqueName: \"kubernetes.io/projected/77d678a6-d982-43fc-b273-49ed6544109a-kube-api-access-77ww6\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-system-cni-dir\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bedd3dda-9383-4cb1-86b5-56cb2089bc64-agent-certs\") pod \"konnectivity-agent-b8dzk\" (UID: \"bedd3dda-9383-4cb1-86b5-56cb2089bc64\") " pod="kube-system/konnectivity-agent-b8dzk"
Jul 27 15:05:46.628466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628439    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-var-lib-cni-bin\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-run-systemd\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628535    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-multus-conf-dir\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-etc-kubernetes\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-var-lib-openvswitch\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-etc-openvswitch\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628702    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628767    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-system-cni-dir\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628799    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-run-ovn-kubernetes\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-multus-cni-dir\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628855    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-cnibin\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628860    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-var-lib-cni-multus\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628881    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-slash\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628910    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-var-lib-cni-bin\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mpld\" (UniqueName: \"kubernetes.io/projected/248f3f2d-01bf-4af5-91fa-7fe07ef36dd5-kube-api-access-6mpld\") pod \"iptables-alerter-xp9fs\" (UID: \"248f3f2d-01bf-4af5-91fa-7fe07ef36dd5\") " pod="openshift-network-operator/iptables-alerter-xp9fs"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-os-release\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628980    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-hostroot\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.629097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjbkc\" (UniqueName: \"kubernetes.io/projected/509524ea-252e-4068-9426-33f81a298f39-kube-api-access-jjbkc\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57-serviceca\") pod \"node-ca-9w9v7\" (UID: \"5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57\") " pod="openshift-image-registry/node-ca-9w9v7"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bedd3dda-9383-4cb1-86b5-56cb2089bc64-konnectivity-ca\") pod \"konnectivity-agent-b8dzk\" (UID: \"bedd3dda-9383-4cb1-86b5-56cb2089bc64\") " pod="kube-system/konnectivity-agent-b8dzk"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.628539    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-run-systemd\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509524ea-252e-4068-9426-33f81a298f39-cni-binary-copy\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629066    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629101    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-kubelet\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629131    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77d678a6-d982-43fc-b273-49ed6544109a-etc-tuned\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629174    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f15adc1-27eb-40d4-98d0-ea2f32614a58-kubelet-config\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f15adc1-27eb-40d4-98d0-ea2f32614a58-dbus\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629252    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-var-lib-kubelet\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-run-openvswitch\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-node-log\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629330    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-modprobe-d\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-systemd\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57-host\") pod \"node-ca-9w9v7\" (UID: \"5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57\") " pod="openshift-image-registry/node-ca-9w9v7"
Jul 27 15:05:46.629932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629478    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509524ea-252e-4068-9426-33f81a298f39-cni-binary-copy\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629491    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/509524ea-252e-4068-9426-33f81a298f39-multus-daemon-config\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-cni-bin\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-host\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77d678a6-d982-43fc-b273-49ed6544109a-tmp\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629587    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-registration-dir\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629608    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-sys-fs\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qwq\" (UniqueName: \"kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq\") pod \"network-check-target-jtzks\" (UID: \"78c9654d-657e-4a4c-838a-625d9c7a5a79\") " pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-run-multus-certs\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-device-dir\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629694    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69aca711-2e82-44e2-bc84-bef248d6bed1-ovnkube-script-lib\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629737    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-systemd-units\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629760    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-run-netns\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.630930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69aca711-2e82-44e2-bc84-bef248d6bed1-ovnkube-config\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629824    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-sysctl-d\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629843    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c38f52d-338f-4a06-a385-3276421472ce-hosts-file\") pod \"node-resolver-z7jm2\" (UID: \"3c38f52d-338f-4a06-a385-3276421472ce\") " pod="openshift-dns/node-resolver-z7jm2"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-os-release\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-system-cni-dir\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629914    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69aca711-2e82-44e2-bc84-bef248d6bed1-env-overrides\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629928    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/509524ea-252e-4068-9426-33f81a298f39-multus-daemon-config\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-run\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629962    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt72f\" (UniqueName: \"kubernetes.io/projected/5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57-kube-api-access-qt72f\") pod \"node-ca-9w9v7\" (UID: \"5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57\") " pod="openshift-image-registry/node-ca-9w9v7"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629987    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c38f52d-338f-4a06-a385-3276421472ce-tmp-dir\") pod \"node-resolver-z7jm2\" (UID: \"3c38f52d-338f-4a06-a385-3276421472ce\") " pod="openshift-dns/node-resolver-z7jm2"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.629987    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-kubelet\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.630025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78g4k\" (UniqueName: \"kubernetes.io/projected/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-kube-api-access-78g4k\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.630127    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-run-netns\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.630197    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-hostroot\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.630164    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-os-release\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.630355    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.630900    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bedd3dda-9383-4cb1-86b5-56cb2089bc64-konnectivity-ca\") pod \"konnectivity-agent-b8dzk\" (UID: \"bedd3dda-9383-4cb1-86b5-56cb2089bc64\") " pod="kube-system/konnectivity-agent-b8dzk"
Jul 27 15:05:46.631836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.630910    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69aca711-2e82-44e2-bc84-bef248d6bed1-ovnkube-config\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.630937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-host-cni-bin\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.630967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.630989    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-cnibin\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631005    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-sysctl-conf\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631005    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-os-release\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/248f3f2d-01bf-4af5-91fa-7fe07ef36dd5-host-slash\") pod \"iptables-alerter-xp9fs\" (UID: \"248f3f2d-01bf-4af5-91fa-7fe07ef36dd5\") " pod="openshift-network-operator/iptables-alerter-xp9fs"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631037    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-run-ovn\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631062    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-system-cni-dir\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631086    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-run-ovn\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631429    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631462    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-var-lib-kubelet\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631468    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69aca711-2e82-44e2-bc84-bef248d6bed1-env-overrides\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631496    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-run-openvswitch\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631527    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-host-run-multus-certs\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:46.631606    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:46.631664    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs podName:0ec80f44-9dda-4e50-ab28-bf61b499eb0b nodeName:}" failed. No retries permitted until 2026-07-27 15:05:47.131646175 +0000 UTC m=+2.996224043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs") pod "network-metrics-daemon-5vv4s" (UID: "0ec80f44-9dda-4e50-ab28-bf61b499eb0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:05:46.632694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631692    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-systemd-units\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.633328 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.631838    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69aca711-2e82-44e2-bc84-bef248d6bed1-node-log\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.633328 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.632074    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.633328 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.632128    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509524ea-252e-4068-9426-33f81a298f39-cnibin\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.633328 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.632352    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69aca711-2e82-44e2-bc84-bef248d6bed1-ovnkube-script-lib\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.633328 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.633257    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69aca711-2e82-44e2-bc84-bef248d6bed1-ovn-node-metrics-cert\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.633530 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.633334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bedd3dda-9383-4cb1-86b5-56cb2089bc64-agent-certs\") pod \"konnectivity-agent-b8dzk\" (UID: \"bedd3dda-9383-4cb1-86b5-56cb2089bc64\") " pod="kube-system/konnectivity-agent-b8dzk"
Jul 27 15:05:46.637046 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.637022    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzkjz\" (UniqueName: \"kubernetes.io/projected/ba429ab7-bc35-4e30-9dcf-cf87fe20e90b-kube-api-access-lzkjz\") pod \"multus-additional-cni-plugins-mp4j8\" (UID: \"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b\") " pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.637261 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.637226    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwrjs\" (UniqueName: \"kubernetes.io/projected/69aca711-2e82-44e2-bc84-bef248d6bed1-kube-api-access-mwrjs\") pod \"ovnkube-node-kllht\" (UID: \"69aca711-2e82-44e2-bc84-bef248d6bed1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.637899 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.637877    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6xn5\" (UniqueName: \"kubernetes.io/projected/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-kube-api-access-q6xn5\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:46.638542 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:46.638526    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:05:46.638617 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:46.638548    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:05:46.638617 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:46.638574    2559 projected.go:196] Error preparing data for projected volume kube-api-access-w2qwq for pod openshift-network-diagnostics/network-check-target-jtzks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:05:46.638689 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:46.638637    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq podName:78c9654d-657e-4a4c-838a-625d9c7a5a79 nodeName:}" failed. No retries permitted until 2026-07-27 15:05:47.138620644 +0000 UTC m=+3.003198495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w2qwq" (UniqueName: "kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq") pod "network-check-target-jtzks" (UID: "78c9654d-657e-4a4c-838a-625d9c7a5a79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:05:46.643091 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.643064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjbkc\" (UniqueName: \"kubernetes.io/projected/509524ea-252e-4068-9426-33f81a298f39-kube-api-access-jjbkc\") pod \"multus-9fhlm\" (UID: \"509524ea-252e-4068-9426-33f81a298f39\") " pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.712156 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.712102    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" event={"ID":"d0c1ff884bdd9496706e8ac4b4131e01","Type":"ContainerStarted","Data":"b71c6ed0ee3ecf0d79c8c4cbb2bb055973fb175701ad03b6498a6ed60bff5c29"}
Jul 27 15:05:46.713614 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.713582    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal" event={"ID":"9b8a60cdf8b1d315ea61b277dedead6a","Type":"ContainerStarted","Data":"d0d67afa1433fee4c508306d86142cc2c84967df56e6b832228def2de1d39b6a"}
Jul 27 15:05:46.731303 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731230    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-lib-modules\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.731303 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5r2m\" (UniqueName: \"kubernetes.io/projected/3c38f52d-338f-4a06-a385-3276421472ce-kube-api-access-v5r2m\") pod \"node-resolver-z7jm2\" (UID: \"3c38f52d-338f-4a06-a385-3276421472ce\") " pod="openshift-dns/node-resolver-z7jm2"
Jul 27 15:05:46.731303 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731284    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-var-lib-kubelet\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.731583 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731361    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77ww6\" (UniqueName: \"kubernetes.io/projected/77d678a6-d982-43fc-b273-49ed6544109a-kube-api-access-77ww6\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.731583 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-lib-modules\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.731583 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731515    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-var-lib-kubelet\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.731583 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mpld\" (UniqueName: \"kubernetes.io/projected/248f3f2d-01bf-4af5-91fa-7fe07ef36dd5-kube-api-access-6mpld\") pod \"iptables-alerter-xp9fs\" (UID: \"248f3f2d-01bf-4af5-91fa-7fe07ef36dd5\") " pod="openshift-network-operator/iptables-alerter-xp9fs"
Jul 27 15:05:46.731583 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57-serviceca\") pod \"node-ca-9w9v7\" (UID: \"5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57\") " pod="openshift-image-registry/node-ca-9w9v7"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77d678a6-d982-43fc-b273-49ed6544109a-etc-tuned\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f15adc1-27eb-40d4-98d0-ea2f32614a58-kubelet-config\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731640    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f15adc1-27eb-40d4-98d0-ea2f32614a58-dbus\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731669    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-modprobe-d\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-systemd\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57-host\") pod \"node-ca-9w9v7\" (UID: \"5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57\") " pod="openshift-image-registry/node-ca-9w9v7"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731738    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-host\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731789    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77d678a6-d982-43fc-b273-49ed6544109a-tmp\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731814    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-registration-dir\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-sys-fs\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731853    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-modprobe-d\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.731879 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731876    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-device-dir\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f15adc1-27eb-40d4-98d0-ea2f32614a58-kubelet-config\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-sysctl-d\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731933    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-systemd\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731952    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c38f52d-338f-4a06-a385-3276421472ce-hosts-file\") pod \"node-resolver-z7jm2\" (UID: \"3c38f52d-338f-4a06-a385-3276421472ce\") " pod="openshift-dns/node-resolver-z7jm2"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.731995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-run\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732002    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57-host\") pod \"node-ca-9w9v7\" (UID: \"5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57\") " pod="openshift-image-registry/node-ca-9w9v7"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt72f\" (UniqueName: \"kubernetes.io/projected/5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57-kube-api-access-qt72f\") pod \"node-ca-9w9v7\" (UID: \"5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57\") " pod="openshift-image-registry/node-ca-9w9v7"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732051    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c38f52d-338f-4a06-a385-3276421472ce-tmp-dir\") pod \"node-resolver-z7jm2\" (UID: \"3c38f52d-338f-4a06-a385-3276421472ce\") " pod="openshift-dns/node-resolver-z7jm2"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732056    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732005    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f15adc1-27eb-40d4-98d0-ea2f32614a58-dbus\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732059    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-sys-fs\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78g4k\" (UniqueName: \"kubernetes.io/projected/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-kube-api-access-78g4k\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732060    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-device-dir\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732095    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-host\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732114    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732143    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-sysctl-conf\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-registration-dir\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.732524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732006    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57-serviceca\") pod \"node-ca-9w9v7\" (UID: \"5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57\") " pod="openshift-image-registry/node-ca-9w9v7"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732165    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-sysctl-d\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732167    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/248f3f2d-01bf-4af5-91fa-7fe07ef36dd5-host-slash\") pod \"iptables-alerter-xp9fs\" (UID: \"248f3f2d-01bf-4af5-91fa-7fe07ef36dd5\") " pod="openshift-network-operator/iptables-alerter-xp9fs"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732201    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-sys\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-run\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732220    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/248f3f2d-01bf-4af5-91fa-7fe07ef36dd5-host-slash\") pod \"iptables-alerter-xp9fs\" (UID: \"248f3f2d-01bf-4af5-91fa-7fe07ef36dd5\") " pod="openshift-network-operator/iptables-alerter-xp9fs"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732222    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-sysconfig\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732261    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-sysconfig\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732268    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-sys\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732289    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-kubernetes\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:46.732377    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:46.732459    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret podName:2f15adc1-27eb-40d4-98d0-ea2f32614a58 nodeName:}" failed. No retries permitted until 2026-07-27 15:05:47.232441202 +0000 UTC m=+3.097019050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret") pod "global-pull-secret-syncer-5rjcj" (UID: "2f15adc1-27eb-40d4-98d0-ea2f32614a58") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/248f3f2d-01bf-4af5-91fa-7fe07ef36dd5-iptables-alerter-script\") pod \"iptables-alerter-xp9fs\" (UID: \"248f3f2d-01bf-4af5-91fa-7fe07ef36dd5\") " pod="openshift-network-operator/iptables-alerter-xp9fs"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-socket-dir\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732504    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-kubernetes\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-etc-selinux\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c38f52d-338f-4a06-a385-3276421472ce-hosts-file\") pod \"node-resolver-z7jm2\" (UID: \"3c38f52d-338f-4a06-a385-3276421472ce\") " pod="openshift-dns/node-resolver-z7jm2"
Jul 27 15:05:46.733194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732560    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c38f52d-338f-4a06-a385-3276421472ce-tmp-dir\") pod \"node-resolver-z7jm2\" (UID: \"3c38f52d-338f-4a06-a385-3276421472ce\") " pod="openshift-dns/node-resolver-z7jm2"
Jul 27 15:05:46.733968 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732579    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77d678a6-d982-43fc-b273-49ed6544109a-etc-sysctl-conf\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.733968 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732612    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-socket-dir\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.733968 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.732641    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-etc-selinux\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.733968 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.733730    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/248f3f2d-01bf-4af5-91fa-7fe07ef36dd5-iptables-alerter-script\") pod \"iptables-alerter-xp9fs\" (UID: \"248f3f2d-01bf-4af5-91fa-7fe07ef36dd5\") " pod="openshift-network-operator/iptables-alerter-xp9fs"
Jul 27 15:05:46.734415 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.734386    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77d678a6-d982-43fc-b273-49ed6544109a-etc-tuned\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.734534 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.734508    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77d678a6-d982-43fc-b273-49ed6544109a-tmp\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.741480 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.741348    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5r2m\" (UniqueName: \"kubernetes.io/projected/3c38f52d-338f-4a06-a385-3276421472ce-kube-api-access-v5r2m\") pod \"node-resolver-z7jm2\" (UID: \"3c38f52d-338f-4a06-a385-3276421472ce\") " pod="openshift-dns/node-resolver-z7jm2"
Jul 27 15:05:46.742381 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.742355    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mpld\" (UniqueName: \"kubernetes.io/projected/248f3f2d-01bf-4af5-91fa-7fe07ef36dd5-kube-api-access-6mpld\") pod \"iptables-alerter-xp9fs\" (UID: \"248f3f2d-01bf-4af5-91fa-7fe07ef36dd5\") " pod="openshift-network-operator/iptables-alerter-xp9fs"
Jul 27 15:05:46.742901 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.742880    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78g4k\" (UniqueName: \"kubernetes.io/projected/751c17d2-b0a7-4ae9-a191-22828a2cfbd1-kube-api-access-78g4k\") pod \"aws-ebs-csi-driver-node-nwhsd\" (UID: \"751c17d2-b0a7-4ae9-a191-22828a2cfbd1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.743485 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.743464    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt72f\" (UniqueName: \"kubernetes.io/projected/5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57-kube-api-access-qt72f\") pod \"node-ca-9w9v7\" (UID: \"5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57\") " pod="openshift-image-registry/node-ca-9w9v7"
Jul 27 15:05:46.743567 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.743465    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77ww6\" (UniqueName: \"kubernetes.io/projected/77d678a6-d982-43fc-b273-49ed6544109a-kube-api-access-77ww6\") pod \"tuned-g7bx6\" (UID: \"77d678a6-d982-43fc-b273-49ed6544109a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.823197 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.823145    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9fhlm"
Jul 27 15:05:46.832849 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.832819    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:05:46.833477 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:46.833447    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509524ea_252e_4068_9426_33f81a298f39.slice/crio-795d9d163ed6078f0785ec12a607b9bd005f32eb365a538bf3f30e4c4ffe97c9 WatchSource:0}: Error finding container 795d9d163ed6078f0785ec12a607b9bd005f32eb365a538bf3f30e4c4ffe97c9: Status 404 returned error can't find the container with id 795d9d163ed6078f0785ec12a607b9bd005f32eb365a538bf3f30e4c4ffe97c9
Jul 27 15:05:46.840823 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.840797    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mp4j8"
Jul 27 15:05:46.843506 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:46.843482    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69aca711_2e82_44e2_bc84_bef248d6bed1.slice/crio-45d4d558dd0e55b4c9ab2ad6444cacc0a75bad043f290842b48b4cb1f3e8d190 WatchSource:0}: Error finding container 45d4d558dd0e55b4c9ab2ad6444cacc0a75bad043f290842b48b4cb1f3e8d190: Status 404 returned error can't find the container with id 45d4d558dd0e55b4c9ab2ad6444cacc0a75bad043f290842b48b4cb1f3e8d190
Jul 27 15:05:46.846486 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.846451    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b8dzk"
Jul 27 15:05:46.850119 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:46.850084    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba429ab7_bc35_4e30_9dcf_cf87fe20e90b.slice/crio-be360dbea51c4ba55b8c923e04127894fe19ac5ca3a499935fe1e8ff09a3c791 WatchSource:0}: Error finding container be360dbea51c4ba55b8c923e04127894fe19ac5ca3a499935fe1e8ff09a3c791: Status 404 returned error can't find the container with id be360dbea51c4ba55b8c923e04127894fe19ac5ca3a499935fe1e8ff09a3c791
Jul 27 15:05:46.855569 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.855538    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xp9fs"
Jul 27 15:05:46.855726 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:46.855701    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbedd3dda_9383_4cb1_86b5_56cb2089bc64.slice/crio-e134b4c56cf13dd0e13cb8356b948c5601e03ca90eab16b1c2cc06ed1c9e1a70 WatchSource:0}: Error finding container e134b4c56cf13dd0e13cb8356b948c5601e03ca90eab16b1c2cc06ed1c9e1a70: Status 404 returned error can't find the container with id e134b4c56cf13dd0e13cb8356b948c5601e03ca90eab16b1c2cc06ed1c9e1a70
Jul 27 15:05:46.862253 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.862193    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd"
Jul 27 15:05:46.865085 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:46.865063    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248f3f2d_01bf_4af5_91fa_7fe07ef36dd5.slice/crio-5c191028c81a3b934992726f02fe626e58325d571a375d4e7a8e66f892063264 WatchSource:0}: Error finding container 5c191028c81a3b934992726f02fe626e58325d571a375d4e7a8e66f892063264: Status 404 returned error can't find the container with id 5c191028c81a3b934992726f02fe626e58325d571a375d4e7a8e66f892063264
Jul 27 15:05:46.868264 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.868244    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g7bx6"
Jul 27 15:05:46.871855 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:46.871821    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751c17d2_b0a7_4ae9_a191_22828a2cfbd1.slice/crio-612c35f4f83d47ea3bf18a0f30a58ddd701f80c076bc2c254ac55b5dfcd3bde9 WatchSource:0}: Error finding container 612c35f4f83d47ea3bf18a0f30a58ddd701f80c076bc2c254ac55b5dfcd3bde9: Status 404 returned error can't find the container with id 612c35f4f83d47ea3bf18a0f30a58ddd701f80c076bc2c254ac55b5dfcd3bde9
Jul 27 15:05:46.874851 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.874661    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9w9v7"
Jul 27 15:05:46.877311 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:46.877291    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d678a6_d982_43fc_b273_49ed6544109a.slice/crio-67ecebdb120db4819ff6187a9437168b8f8a8cb2c0ccd0001326d010ca2cb409 WatchSource:0}: Error finding container 67ecebdb120db4819ff6187a9437168b8f8a8cb2c0ccd0001326d010ca2cb409: Status 404 returned error can't find the container with id 67ecebdb120db4819ff6187a9437168b8f8a8cb2c0ccd0001326d010ca2cb409
Jul 27 15:05:46.881812 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:46.881788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z7jm2"
Jul 27 15:05:46.883895 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:46.883873    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d3d8faf_d3dc_4f04_b9e4_6e8bd98a5a57.slice/crio-dca608923149d6a3a1f24a76224f3753a29f6af5e8e68fe4798e539edaa10559 WatchSource:0}: Error finding container dca608923149d6a3a1f24a76224f3753a29f6af5e8e68fe4798e539edaa10559: Status 404 returned error can't find the container with id dca608923149d6a3a1f24a76224f3753a29f6af5e8e68fe4798e539edaa10559
Jul 27 15:05:47.136070 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.135972    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:47.136238 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:47.136119    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:05:47.136238 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:47.136181    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs podName:0ec80f44-9dda-4e50-ab28-bf61b499eb0b nodeName:}" failed. No retries permitted until 2026-07-27 15:05:48.13615997 +0000 UTC m=+4.000737820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs") pod "network-metrics-daemon-5vv4s" (UID: "0ec80f44-9dda-4e50-ab28-bf61b499eb0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:05:47.236596 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.236568    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qwq\" (UniqueName: \"kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq\") pod \"network-check-target-jtzks\" (UID: \"78c9654d-657e-4a4c-838a-625d9c7a5a79\") " pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:47.236754 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.236612    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:47.236754 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:47.236709    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:05:47.236754 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:47.236751    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret podName:2f15adc1-27eb-40d4-98d0-ea2f32614a58 nodeName:}" failed. No retries permitted until 2026-07-27 15:05:48.236737891 +0000 UTC m=+4.101315737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret") pod "global-pull-secret-syncer-5rjcj" (UID: "2f15adc1-27eb-40d4-98d0-ea2f32614a58") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:05:47.236909 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:47.236819    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:05:47.236909 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:47.236832    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:05:47.236909 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:47.236845    2559 projected.go:196] Error preparing data for projected volume kube-api-access-w2qwq for pod openshift-network-diagnostics/network-check-target-jtzks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:05:47.236909 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:47.236882    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq podName:78c9654d-657e-4a4c-838a-625d9c7a5a79 nodeName:}" failed. No retries permitted until 2026-07-27 15:05:48.23687009 +0000 UTC m=+4.101447940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2qwq" (UniqueName: "kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq") pod "network-check-target-jtzks" (UID: "78c9654d-657e-4a4c-838a-625d9c7a5a79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:05:47.358009 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.357978    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:05:47.563871 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.563829    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 15:00:46 +0000 UTC" deadline="2028-01-10 09:59:43.432205015 +0000 UTC"
Jul 27 15:05:47.563871 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.563868    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12762h53m55.868342247s"
Jul 27 15:05:47.706146 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.706105    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:47.706306 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:47.706249    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:05:47.706408 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.706331    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:47.706467 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:47.706447    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:05:47.716538 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.716506    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xp9fs" event={"ID":"248f3f2d-01bf-4af5-91fa-7fe07ef36dd5","Type":"ContainerStarted","Data":"5c191028c81a3b934992726f02fe626e58325d571a375d4e7a8e66f892063264"}
Jul 27 15:05:47.717906 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.717884    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b8dzk" event={"ID":"bedd3dda-9383-4cb1-86b5-56cb2089bc64","Type":"ContainerStarted","Data":"e134b4c56cf13dd0e13cb8356b948c5601e03ca90eab16b1c2cc06ed1c9e1a70"}
Jul 27 15:05:47.719335 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.719306    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kllht" event={"ID":"69aca711-2e82-44e2-bc84-bef248d6bed1","Type":"ContainerStarted","Data":"45d4d558dd0e55b4c9ab2ad6444cacc0a75bad043f290842b48b4cb1f3e8d190"}
Jul 27 15:05:47.720951 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.720925    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9fhlm" event={"ID":"509524ea-252e-4068-9426-33f81a298f39","Type":"ContainerStarted","Data":"795d9d163ed6078f0785ec12a607b9bd005f32eb365a538bf3f30e4c4ffe97c9"}
Jul 27 15:05:47.722927 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.722905    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9w9v7" event={"ID":"5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57","Type":"ContainerStarted","Data":"dca608923149d6a3a1f24a76224f3753a29f6af5e8e68fe4798e539edaa10559"}
Jul 27 15:05:47.724700 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.724433    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g7bx6" event={"ID":"77d678a6-d982-43fc-b273-49ed6544109a","Type":"ContainerStarted","Data":"67ecebdb120db4819ff6187a9437168b8f8a8cb2c0ccd0001326d010ca2cb409"}
Jul 27 15:05:47.725725 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.725704    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp4j8" event={"ID":"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b","Type":"ContainerStarted","Data":"be360dbea51c4ba55b8c923e04127894fe19ac5ca3a499935fe1e8ff09a3c791"}
Jul 27 15:05:47.727204 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:47.727179    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd" event={"ID":"751c17d2-b0a7-4ae9-a191-22828a2cfbd1","Type":"ContainerStarted","Data":"612c35f4f83d47ea3bf18a0f30a58ddd701f80c076bc2c254ac55b5dfcd3bde9"}
Jul 27 15:05:48.145050 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:48.145012    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:48.145283 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:48.145183    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:05:48.145283 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:48.145264    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs podName:0ec80f44-9dda-4e50-ab28-bf61b499eb0b nodeName:}" failed. No retries permitted until 2026-07-27 15:05:50.145245079 +0000 UTC m=+6.009822928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs") pod "network-metrics-daemon-5vv4s" (UID: "0ec80f44-9dda-4e50-ab28-bf61b499eb0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:05:48.246103 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:48.246037    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qwq\" (UniqueName: \"kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq\") pod \"network-check-target-jtzks\" (UID: \"78c9654d-657e-4a4c-838a-625d9c7a5a79\") " pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:48.246103 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:48.246109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:48.246341 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:48.246236    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:05:48.246341 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:48.246299    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret podName:2f15adc1-27eb-40d4-98d0-ea2f32614a58 nodeName:}" failed. No retries permitted until 2026-07-27 15:05:50.246281251 +0000 UTC m=+6.110859097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret") pod "global-pull-secret-syncer-5rjcj" (UID: "2f15adc1-27eb-40d4-98d0-ea2f32614a58") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:05:48.246659 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:48.246518    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:05:48.246659 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:48.246541    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:05:48.246659 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:48.246556    2559 projected.go:196] Error preparing data for projected volume kube-api-access-w2qwq for pod openshift-network-diagnostics/network-check-target-jtzks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:05:48.246659 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:48.246619    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq podName:78c9654d-657e-4a4c-838a-625d9c7a5a79 nodeName:}" failed. No retries permitted until 2026-07-27 15:05:50.246603141 +0000 UTC m=+6.111181008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2qwq" (UniqueName: "kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq") pod "network-check-target-jtzks" (UID: "78c9654d-657e-4a4c-838a-625d9c7a5a79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:05:48.333585 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:05:48.333457    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c38f52d_338f_4a06_a385_3276421472ce.slice/crio-576ce59baeb0ceadafe649f3247388bd1169bd4a04ed51f6dda09e9e1ceca303 WatchSource:0}: Error finding container 576ce59baeb0ceadafe649f3247388bd1169bd4a04ed51f6dda09e9e1ceca303: Status 404 returned error can't find the container with id 576ce59baeb0ceadafe649f3247388bd1169bd4a04ed51f6dda09e9e1ceca303
Jul 27 15:05:48.564952 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:48.564883    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 15:00:46 +0000 UTC" deadline="2028-03-06 12:50:14.389548159 +0000 UTC"
Jul 27 15:05:48.564952 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:48.564950    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14109h44m25.824602679s"
Jul 27 15:05:48.708493 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:48.708457    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:48.708644 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:48.708598    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:05:48.731646 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:48.731609    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z7jm2" event={"ID":"3c38f52d-338f-4a06-a385-3276421472ce","Type":"ContainerStarted","Data":"576ce59baeb0ceadafe649f3247388bd1169bd4a04ed51f6dda09e9e1ceca303"}
Jul 27 15:05:49.706186 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:49.706137    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:49.706662 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:49.706280    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:05:49.706723 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:49.706669    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:49.706778 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:49.706755    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:05:50.167433 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:50.166844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:50.167433 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:50.167020    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:05:50.167433 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:50.167086    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs podName:0ec80f44-9dda-4e50-ab28-bf61b499eb0b nodeName:}" failed. No retries permitted until 2026-07-27 15:05:54.167067044 +0000 UTC m=+10.031644898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs") pod "network-metrics-daemon-5vv4s" (UID: "0ec80f44-9dda-4e50-ab28-bf61b499eb0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:05:50.268563 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:50.267811    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qwq\" (UniqueName: \"kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq\") pod \"network-check-target-jtzks\" (UID: \"78c9654d-657e-4a4c-838a-625d9c7a5a79\") " pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:50.268563 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:50.267877    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:50.268563 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:50.268014    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:05:50.268563 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:50.268073    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret podName:2f15adc1-27eb-40d4-98d0-ea2f32614a58 nodeName:}" failed. No retries permitted until 2026-07-27 15:05:54.26805638 +0000 UTC m=+10.132634226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret") pod "global-pull-secret-syncer-5rjcj" (UID: "2f15adc1-27eb-40d4-98d0-ea2f32614a58") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:05:50.268563 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:50.268430    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:05:50.268563 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:50.268448    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:05:50.268563 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:50.268462    2559 projected.go:196] Error preparing data for projected volume kube-api-access-w2qwq for pod openshift-network-diagnostics/network-check-target-jtzks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:05:50.268563 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:50.268494    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq podName:78c9654d-657e-4a4c-838a-625d9c7a5a79 nodeName:}" failed. No retries permitted until 2026-07-27 15:05:54.26848515 +0000 UTC m=+10.133062994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2qwq" (UniqueName: "kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq") pod "network-check-target-jtzks" (UID: "78c9654d-657e-4a4c-838a-625d9c7a5a79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:05:50.708956 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:50.708924    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:50.709418 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:50.709071    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:05:51.706328 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:51.706283    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:51.706499 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:51.706427    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:05:51.706809 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:51.706789    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:51.706913 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:51.706894    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:05:52.707671 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:52.707417    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:52.708143 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:52.707789    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:05:53.706746 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:53.706713    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:53.706943 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:53.706861    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:05:53.706943 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:53.706907    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:53.707054 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:53.707037    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:05:54.202743 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:54.202708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:54.203213 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:54.202853    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:05:54.203213 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:54.202918    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs podName:0ec80f44-9dda-4e50-ab28-bf61b499eb0b nodeName:}" failed. No retries permitted until 2026-07-27 15:06:02.202898119 +0000 UTC m=+18.067475965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs") pod "network-metrics-daemon-5vv4s" (UID: "0ec80f44-9dda-4e50-ab28-bf61b499eb0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:05:54.303521 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:54.303469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qwq\" (UniqueName: \"kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq\") pod \"network-check-target-jtzks\" (UID: \"78c9654d-657e-4a4c-838a-625d9c7a5a79\") " pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:54.303521 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:54.303557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:54.303777 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:54.303688    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:05:54.303777 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:54.303748    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret podName:2f15adc1-27eb-40d4-98d0-ea2f32614a58 nodeName:}" failed. No retries permitted until 2026-07-27 15:06:02.303729222 +0000 UTC m=+18.168307076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret") pod "global-pull-secret-syncer-5rjcj" (UID: "2f15adc1-27eb-40d4-98d0-ea2f32614a58") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:05:54.304034 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:54.304006    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:05:54.304034 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:54.304031    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:05:54.304165 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:54.304044    2559 projected.go:196] Error preparing data for projected volume kube-api-access-w2qwq for pod openshift-network-diagnostics/network-check-target-jtzks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:05:54.304165 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:54.304114    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq podName:78c9654d-657e-4a4c-838a-625d9c7a5a79 nodeName:}" failed. No retries permitted until 2026-07-27 15:06:02.304099549 +0000 UTC m=+18.168677397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2qwq" (UniqueName: "kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq") pod "network-check-target-jtzks" (UID: "78c9654d-657e-4a4c-838a-625d9c7a5a79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:05:54.706631 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:54.706605    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:54.706793 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:54.706698    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:05:55.706340 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:55.706291    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:55.706771 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:55.706449    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:05:55.706771 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:55.706510    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:55.706771 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:55.706612    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:05:56.706906 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:56.706876    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:56.707354 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:56.707029    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:05:57.706867 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:57.706833    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:57.707036 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:57.706952    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:05:57.707306 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:57.707237    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:57.707366 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:57.707307    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:05:58.706203 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:58.706172    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:05:58.706376 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:58.706283    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:05:59.706447 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:59.706416    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:05:59.706447 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:05:59.706453    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:05:59.706878 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:59.706534    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:05:59.706878 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:05:59.706674    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:06:00.706595 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:00.706565    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:00.707007 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:00.706695    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:06:01.706201 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:01.706168    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:01.706201 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:01.706200    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:01.706485 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:01.706296    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:06:01.706485 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:01.706415    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:06:02.269030 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:02.268998    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:02.269408 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:02.269131    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:06:02.269408 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:02.269188    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs podName:0ec80f44-9dda-4e50-ab28-bf61b499eb0b nodeName:}" failed. No retries permitted until 2026-07-27 15:06:18.269170432 +0000 UTC m=+34.133748290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs") pod "network-metrics-daemon-5vv4s" (UID: "0ec80f44-9dda-4e50-ab28-bf61b499eb0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:06:02.370003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:02.369969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:02.370173 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:02.370060    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qwq\" (UniqueName: \"kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq\") pod \"network-check-target-jtzks\" (UID: \"78c9654d-657e-4a4c-838a-625d9c7a5a79\") " pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:02.370173 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:02.370094    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:06:02.370173 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:02.370158    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret podName:2f15adc1-27eb-40d4-98d0-ea2f32614a58 nodeName:}" failed. No retries permitted until 2026-07-27 15:06:18.370143304 +0000 UTC m=+34.234721149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret") pod "global-pull-secret-syncer-5rjcj" (UID: "2f15adc1-27eb-40d4-98d0-ea2f32614a58") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:06:02.370293 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:02.370174    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:06:02.370293 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:02.370187    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:06:02.370293 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:02.370196    2559 projected.go:196] Error preparing data for projected volume kube-api-access-w2qwq for pod openshift-network-diagnostics/network-check-target-jtzks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:06:02.370293 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:02.370234    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq podName:78c9654d-657e-4a4c-838a-625d9c7a5a79 nodeName:}" failed. No retries permitted until 2026-07-27 15:06:18.370220327 +0000 UTC m=+34.234798173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2qwq" (UniqueName: "kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq") pod "network-check-target-jtzks" (UID: "78c9654d-657e-4a4c-838a-625d9c7a5a79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:06:02.706214 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:02.706188    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:02.706400 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:02.706291    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:06:03.706629 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:03.706604    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:03.707073 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:03.706605    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:03.707073 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:03.706719    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:06:03.707073 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:03.706821    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:06:04.706671 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:04.706643    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:04.707025 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:04.706745    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:06:05.706230 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:05.706201    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:05.706230 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:05.706227    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:05.706438 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:05.706298    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:06:05.706438 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:05.706391    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:06:05.773479 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:05.773450    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9fhlm" event={"ID":"509524ea-252e-4068-9426-33f81a298f39","Type":"ContainerStarted","Data":"3ec6e25f2ed81f43527997345338676ed92ec14b7aea36e1a32a34b26aad4a37"}
Jul 27 15:06:05.780055 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:05.779989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal" event={"ID":"9b8a60cdf8b1d315ea61b277dedead6a","Type":"ContainerStarted","Data":"660cd1b7d851f6e9ac8b12ec2d3f30319767e876a61a726acaf63b1010ef7a6c"}
Jul 27 15:06:05.785599 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:05.785574    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g7bx6" event={"ID":"77d678a6-d982-43fc-b273-49ed6544109a","Type":"ContainerStarted","Data":"22875aaf5f5ae7576760cdc8abab72e540af148056fb757551fd128a19189fa0"}
Jul 27 15:06:05.793751 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:05.793699    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9fhlm" podStartSLOduration=3.380432944 podStartE2EDuration="21.793682992s" totalImagesPullingTime="18.413250048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:05.792794515 +0000 UTC m=+21.657372383" watchObservedRunningTime="2026-07-27 15:06:05.793682992 +0000 UTC m=+21.658260859"
Jul 27 15:06:05.831634 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:05.831546    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g7bx6" podStartSLOduration=2.510552142 podStartE2EDuration="20.83130909s" totalImagesPullingTime="18.320756948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:05.814281899 +0000 UTC m=+21.678859767" watchObservedRunningTime="2026-07-27 15:06:05.83130909 +0000 UTC m=+21.695886957"
Jul 27 15:06:05.832122 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:05.832086    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal" podStartSLOduration=19.832069882 podStartE2EDuration="19.832069882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:05:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:05.830820479 +0000 UTC m=+21.695398345" watchObservedRunningTime="2026-07-27 15:06:05.832069882 +0000 UTC m=+21.696647751"
Jul 27 15:06:06.706890 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.706523    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:06.707021 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:06.706998    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:06:06.788857 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.788833    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9w9v7" event={"ID":"5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57","Type":"ContainerStarted","Data":"9ededac52b5ef7ff8cb56e891f2688462918e797991b7c659f91a06376a0da1d"}
Jul 27 15:06:06.790190 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.790171    2559 generic.go:356] "Generic (PLEG): container finished" podID="ba429ab7-bc35-4e30-9dcf-cf87fe20e90b" containerID="ec46b589c322c5d2b94eebb37177d32021b3e290688e6560bf31843c79ca25d6" exitCode=0
Jul 27 15:06:06.790261 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.790234    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp4j8" event={"ID":"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b","Type":"ContainerDied","Data":"ec46b589c322c5d2b94eebb37177d32021b3e290688e6560bf31843c79ca25d6"}
Jul 27 15:06:06.791705 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.791687    2559 generic.go:356] "Generic (PLEG): container finished" podID="d0c1ff884bdd9496706e8ac4b4131e01" containerID="704f30d2cb90d16012c83b0c7b5932c4de02a27ea536af12ed7b33983301f832" exitCode=0
Jul 27 15:06:06.791787 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.791761    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" event={"ID":"d0c1ff884bdd9496706e8ac4b4131e01","Type":"ContainerDied","Data":"704f30d2cb90d16012c83b0c7b5932c4de02a27ea536af12ed7b33983301f832"}
Jul 27 15:06:06.793282 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.793257    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd" event={"ID":"751c17d2-b0a7-4ae9-a191-22828a2cfbd1","Type":"ContainerStarted","Data":"fa98633c6de661900115f0436c049da2ab2cd1369a39fc78af0d7cf184d16d6c"}
Jul 27 15:06:06.796431 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.794936    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xp9fs" event={"ID":"248f3f2d-01bf-4af5-91fa-7fe07ef36dd5","Type":"ContainerStarted","Data":"36ee57f46acbe4e91bb5211d2af1738eb696c1514fafec56b7203c28298297a6"}
Jul 27 15:06:06.797713 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.797694    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b8dzk" event={"ID":"bedd3dda-9383-4cb1-86b5-56cb2089bc64","Type":"ContainerStarted","Data":"4a2bf3751c9dbdc4ac2f0ad2f8e643065fd8e8a70b598f1c62688d3b205256f5"}
Jul 27 15:06:06.800556 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.800533    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kllht" event={"ID":"69aca711-2e82-44e2-bc84-bef248d6bed1","Type":"ContainerStarted","Data":"9cdff4c0fd5c34cd076a715888821c44b60365e511e5423e8b393a818abffc2f"}
Jul 27 15:06:06.800656 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.800602    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kllht" event={"ID":"69aca711-2e82-44e2-bc84-bef248d6bed1","Type":"ContainerStarted","Data":"c83ba45442c1e30fbf5b6d17732609156a07997d34d9c0108c6eaba0683f6da0"}
Jul 27 15:06:06.800656 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.800649    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kllht" event={"ID":"69aca711-2e82-44e2-bc84-bef248d6bed1","Type":"ContainerStarted","Data":"676b9fdc59b9622567197291ff8d6ac0c69e9919faaf02f5cee05a21a3b58dac"}
Jul 27 15:06:06.800742 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.800693    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kllht" event={"ID":"69aca711-2e82-44e2-bc84-bef248d6bed1","Type":"ContainerStarted","Data":"5754417c51b12390d187a2f35b31fba141d0beb91e8648c135373e801886821e"}
Jul 27 15:06:06.800742 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.800739    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kllht" event={"ID":"69aca711-2e82-44e2-bc84-bef248d6bed1","Type":"ContainerStarted","Data":"8ea8287327056dd9ea14e40e4d92c6d787cdb22e7426e63cfaf8ad77825958d3"}
Jul 27 15:06:06.800825 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.800785    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kllht" event={"ID":"69aca711-2e82-44e2-bc84-bef248d6bed1","Type":"ContainerStarted","Data":"45bbaf07b56b9c5a8359f1570b4e43469047c701113b56568cbea916bd2022b1"}
Jul 27 15:06:06.802028 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.802004    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z7jm2" event={"ID":"3c38f52d-338f-4a06-a385-3276421472ce","Type":"ContainerStarted","Data":"f76d08f3bf034e21a1fd20ae8f1de1cd5ac0a770a53877e40fb20f78330544fd"}
Jul 27 15:06:06.806873 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.806840    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9w9v7" podStartSLOduration=12.712243805 podStartE2EDuration="21.806829606s" totalImagesPullingTime="9.094585801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:06.806714886 +0000 UTC m=+22.671292751" watchObservedRunningTime="2026-07-27 15:06:06.806829606 +0000 UTC m=+22.671407472"
Jul 27 15:06:06.825617 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.825579    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xp9fs" podStartSLOduration=3.492542103 podStartE2EDuration="21.825563491s" totalImagesPullingTime="18.333021388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:06.825466024 +0000 UTC m=+22.690043891" watchObservedRunningTime="2026-07-27 15:06:06.825563491 +0000 UTC m=+22.690141358"
Jul 27 15:06:06.841727 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.841695    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z7jm2" podStartSLOduration=5.309860525 podStartE2EDuration="21.841685245s" totalImagesPullingTime="16.53182472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:06.841598671 +0000 UTC m=+22.706176550" watchObservedRunningTime="2026-07-27 15:06:06.841685245 +0000 UTC m=+22.706263109"
Jul 27 15:06:06.906079 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:06.906014    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b8dzk" podStartSLOduration=7.792298453 podStartE2EDuration="21.906001833s" totalImagesPullingTime="14.11370338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:06.905947727 +0000 UTC m=+22.770525593" watchObservedRunningTime="2026-07-27 15:06:06.906001833 +0000 UTC m=+22.770579699"
Jul 27 15:06:07.706382 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:07.706354    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:07.706536 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:07.706363    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:07.706536 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:07.706446    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:06:07.706536 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:07.706513    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:06:07.806193 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:07.806166    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" event={"ID":"d0c1ff884bdd9496706e8ac4b4131e01","Type":"ContainerStarted","Data":"9c5a005dbb7560b8049a56f30f1ce3c17d5390a4a284bd5ac3f4f0f80d23c72b"}
Jul 27 15:06:07.824864 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:07.824818    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" podStartSLOduration=21.824800936 podStartE2EDuration="21.824800936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:05:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:07.824713624 +0000 UTC m=+23.689291488" watchObservedRunningTime="2026-07-27 15:06:07.824800936 +0000 UTC m=+23.689378802"
Jul 27 15:06:08.706468 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:08.706436    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:08.706617 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:08.706571    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:06:08.811839 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:08.811808    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kllht" event={"ID":"69aca711-2e82-44e2-bc84-bef248d6bed1","Type":"ContainerStarted","Data":"ae4308d19d0c464d323425b71cbe909e5574b2b8b4f5e136a0fd2c258c32f232"}
Jul 27 15:06:09.068445 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:09.068376    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b8dzk"
Jul 27 15:06:09.569145 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:09.568994    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 15:06:09.594027 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:09.593938    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T15:06:09.569008991Z","UUID":"af7becb3-2444-412a-8c1d-d9d7f63b3347","Handler":null,"Name":"","Endpoint":""}
Jul 27 15:06:09.595462 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:09.595439    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 15:06:09.595564 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:09.595485    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 15:06:09.706595 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:09.706523    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:09.706714 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:09.706636    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:06:09.706965 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:09.706943    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:09.707078 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:09.707031    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:06:09.816198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:09.816164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd" event={"ID":"751c17d2-b0a7-4ae9-a191-22828a2cfbd1","Type":"ContainerStarted","Data":"05a8eafb50c1b7eeae195be8e794caba93bf523095381a7d4027249a6d29f7e8"}
Jul 27 15:06:10.297352 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:10.297304    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b8dzk"
Jul 27 15:06:10.297909 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:10.297887    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b8dzk"
Jul 27 15:06:10.708662 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:10.706840    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:10.708662 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:10.706981    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:06:10.818468 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:10.818442    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b8dzk"
Jul 27 15:06:11.705994 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:11.705822    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:11.706090 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:11.705832    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:11.706090 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:11.706074    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:06:11.706215 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:11.706193    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:06:11.823619 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:11.823584    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kllht" event={"ID":"69aca711-2e82-44e2-bc84-bef248d6bed1","Type":"ContainerStarted","Data":"d3b07c7be3df310b56559426dda40a440b097305b979f86b1d3e9cbf01a16a63"}
Jul 27 15:06:11.824358 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:11.823806    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:06:11.825700 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:11.825680    2559 generic.go:356] "Generic (PLEG): container finished" podID="ba429ab7-bc35-4e30-9dcf-cf87fe20e90b" containerID="6d1c48a443bc2bb8d7d2eee85a2ae772b537ad6b49ef0065643cab51b639153d" exitCode=0
Jul 27 15:06:11.825781 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:11.825727    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp4j8" event={"ID":"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b","Type":"ContainerDied","Data":"6d1c48a443bc2bb8d7d2eee85a2ae772b537ad6b49ef0065643cab51b639153d"}
Jul 27 15:06:11.838253 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:11.838237    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:06:11.859948 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:11.859910    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kllht" podStartSLOduration=8.919719394 podStartE2EDuration="27.859898739s" totalImagesPullingTime="18.940179345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:11.859543721 +0000 UTC m=+27.724121589" watchObservedRunningTime="2026-07-27 15:06:11.859898739 +0000 UTC m=+27.724476605"
Jul 27 15:06:12.706616 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:12.706561    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:12.706785 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:12.706653    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:06:12.827987 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:12.827964    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:06:12.828238 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:12.828026    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:06:12.841916 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:12.841893    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:06:13.706348 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:13.706309    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:13.706434 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:13.706417    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:06:13.706490 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:13.706478    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:13.706593 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:13.706575    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:06:13.831158 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:13.831131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd" event={"ID":"751c17d2-b0a7-4ae9-a191-22828a2cfbd1","Type":"ContainerStarted","Data":"2781e2579c9dd6a86a76d0cad165db60ec0355b6e6fd70991a4102458fa7f8ac"}
Jul 27 15:06:13.833005 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:13.832985    2559 generic.go:356] "Generic (PLEG): container finished" podID="ba429ab7-bc35-4e30-9dcf-cf87fe20e90b" containerID="77329c6eb8c3eb3aba8e129fa69461471625c5545ce5a0a2ec4f7e0a1ae1faf8" exitCode=0
Jul 27 15:06:13.833077 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:13.833060    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp4j8" event={"ID":"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b","Type":"ContainerDied","Data":"77329c6eb8c3eb3aba8e129fa69461471625c5545ce5a0a2ec4f7e0a1ae1faf8"}
Jul 27 15:06:14.708996 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:14.708822    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:14.709122 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:14.709103    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:06:14.837068 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:14.836987    2559 generic.go:356] "Generic (PLEG): container finished" podID="ba429ab7-bc35-4e30-9dcf-cf87fe20e90b" containerID="749b0692abd37c8e42ef7b75ed7361cbdb6dda8065d012e4e1039f3e9504fab3" exitCode=0
Jul 27 15:06:14.837431 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:14.837067    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp4j8" event={"ID":"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b","Type":"ContainerDied","Data":"749b0692abd37c8e42ef7b75ed7361cbdb6dda8065d012e4e1039f3e9504fab3"}
Jul 27 15:06:14.892968 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:14.892922    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwhsd" podStartSLOduration=8.252069596 podStartE2EDuration="29.89290638s" totalImagesPullingTime="21.640836784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:05:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:14.892628917 +0000 UTC m=+30.757206762" watchObservedRunningTime="2026-07-27 15:06:14.89290638 +0000 UTC m=+30.757484247"
Jul 27 15:06:15.706182 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:15.706153    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:15.706182 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:15.706184    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:15.706417 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:15.706266    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:06:15.706417 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:15.706390    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:06:16.270656 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:16.270615    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jtzks"]
Jul 27 15:06:16.271112 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:16.270726    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:16.271112 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:16.270828    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:06:16.274586 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:16.274556    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5vv4s"]
Jul 27 15:06:16.274731 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:16.274619    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5rjcj"]
Jul 27 15:06:16.274731 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:16.274676    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:16.274838 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:16.274771    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:06:16.274887 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:16.274843    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:16.274936 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:16.274922    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:06:17.705804 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:17.705777    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:17.705804 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:17.705798    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:17.706158 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:17.705778    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:17.706158 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:17.705861    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5rjcj" podUID="2f15adc1-27eb-40d4-98d0-ea2f32614a58"
Jul 27 15:06:17.706158 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:17.705957    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vv4s" podUID="0ec80f44-9dda-4e50-ab28-bf61b499eb0b"
Jul 27 15:06:17.706158 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:17.706007    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtzks" podUID="78c9654d-657e-4a4c-838a-625d9c7a5a79"
Jul 27 15:06:18.292289 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:18.292221    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:18.292459 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:18.292368    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:06:18.292459 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:18.292425    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs podName:0ec80f44-9dda-4e50-ab28-bf61b499eb0b nodeName:}" failed. No retries permitted until 2026-07-27 15:06:50.292410492 +0000 UTC m=+66.156988336 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs") pod "network-metrics-daemon-5vv4s" (UID: "0ec80f44-9dda-4e50-ab28-bf61b499eb0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:06:18.392781 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:18.392756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qwq\" (UniqueName: \"kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq\") pod \"network-check-target-jtzks\" (UID: \"78c9654d-657e-4a4c-838a-625d9c7a5a79\") " pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:18.392903 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:18.392803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:18.392903 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:18.392893    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:06:18.393011 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:18.392912    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:06:18.393011 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:18.392920    2559 projected.go:196] Error preparing data for projected volume kube-api-access-w2qwq for pod openshift-network-diagnostics/network-check-target-jtzks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:06:18.393011 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:18.392937    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:06:18.393011 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:18.392960    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq podName:78c9654d-657e-4a4c-838a-625d9c7a5a79 nodeName:}" failed. No retries permitted until 2026-07-27 15:06:50.392948778 +0000 UTC m=+66.257526622 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2qwq" (UniqueName: "kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq") pod "network-check-target-jtzks" (UID: "78c9654d-657e-4a4c-838a-625d9c7a5a79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:06:18.393011 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:06:18.392998    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret podName:2f15adc1-27eb-40d4-98d0-ea2f32614a58 nodeName:}" failed. No retries permitted until 2026-07-27 15:06:50.392969543 +0000 UTC m=+66.257547406 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret") pod "global-pull-secret-syncer-5rjcj" (UID: "2f15adc1-27eb-40d4-98d0-ea2f32614a58") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:06:19.472356 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.472330    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeReady"
Jul 27 15:06:19.472792 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.472442    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 15:06:19.517416 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.517390    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69749f9fc8-zvp5v"]
Jul 27 15:06:19.519321 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.519299    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.521973 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.521946    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mw646\""
Jul 27 15:06:19.522084 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.521995    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 15:06:19.522145 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.522090    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 15:06:19.522199 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.522158    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 15:06:19.529745 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.529725    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 15:06:19.531984 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.531958    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hknd7"]
Jul 27 15:06:19.533908 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.533889    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.538430 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.538381    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69749f9fc8-zvp5v"]
Jul 27 15:06:19.538723 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.538580    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 15:06:19.538723 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.538593    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zc6mm\""
Jul 27 15:06:19.538723 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.538643    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 15:06:19.538909 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.538893    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 15:06:19.538986 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.538898    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pdfx8"]
Jul 27 15:06:19.540155 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.540135    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 15:06:19.541076 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.541046    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pdfx8"
Jul 27 15:06:19.545016 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.544996    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 15:06:19.545121 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.545030    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2c97b\""
Jul 27 15:06:19.545121 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.545075    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 15:06:19.545238 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.545152    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 15:06:19.546914 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.546761    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hknd7"]
Jul 27 15:06:19.555766 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.555747    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pdfx8"]
Jul 27 15:06:19.601283 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.601255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-registry-tls\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.601407 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.601342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-trusted-ca\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.601407 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.601373    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-image-registry-private-configuration\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.601407 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.601397    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-registry-certificates\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.601564 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.601423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-ca-trust-extracted\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.601564 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.601547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb8wc\" (UniqueName: \"kubernetes.io/projected/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-kube-api-access-cb8wc\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.601669 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.601608    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-bound-sa-token\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.601669 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.601640    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-installation-pull-secrets\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.630494 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.630471    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fsnvq"]
Jul 27 15:06:19.633286 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.633269    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.635682 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.635664    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 15:06:19.635777 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.635725    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 15:06:19.635777 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.635772    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-spr6f\""
Jul 27 15:06:19.645887 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.644276    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fsnvq"]
Jul 27 15:06:19.702483 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb8wc\" (UniqueName: \"kubernetes.io/projected/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-kube-api-access-cb8wc\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.702594 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-bound-sa-token\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.702594 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702531    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/886d40c5-29b2-4b59-934c-7f65021ca978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.702594 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-installation-pull-secrets\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.702594 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702592    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-registry-tls\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.702793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702614    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/886d40c5-29b2-4b59-934c-7f65021ca978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.702793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702653    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6j5\" (UniqueName: \"kubernetes.io/projected/763a6fcc-a76b-48b2-94fd-e941083b9ec5-kube-api-access-cp6j5\") pod \"ingress-canary-pdfx8\" (UID: \"763a6fcc-a76b-48b2-94fd-e941083b9ec5\") " pod="openshift-ingress-canary/ingress-canary-pdfx8"
Jul 27 15:06:19.702793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-trusted-ca\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.702793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702690    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/886d40c5-29b2-4b59-934c-7f65021ca978-crio-socket\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.702793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702707    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-image-registry-private-configuration\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.702793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702727    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-registry-certificates\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.702793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/886d40c5-29b2-4b59-934c-7f65021ca978-data-volume\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.702793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-ca-trust-extracted\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.702793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702794    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj6zt\" (UniqueName: \"kubernetes.io/projected/886d40c5-29b2-4b59-934c-7f65021ca978-kube-api-access-mj6zt\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.703166 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.702811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/763a6fcc-a76b-48b2-94fd-e941083b9ec5-cert\") pod \"ingress-canary-pdfx8\" (UID: \"763a6fcc-a76b-48b2-94fd-e941083b9ec5\") " pod="openshift-ingress-canary/ingress-canary-pdfx8"
Jul 27 15:06:19.703559 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.703536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-trusted-ca\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.703703 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.703665    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-ca-trust-extracted\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.704048 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.704009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-registry-certificates\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.705957 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.705928    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:19.706064 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.706042    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:19.707050 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.707009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-installation-pull-secrets\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.707136 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.707116    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-registry-tls\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.707370 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.707357    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:19.707410 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.707369    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-image-registry-private-configuration\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.708637 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.708622    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 15:06:19.708710 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.708635    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkhzc\""
Jul 27 15:06:19.708765 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.708752    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 15:06:19.709744 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.709723    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 15:06:19.709834 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.709822    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 15:06:19.709975 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.709959    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2bzfc\""
Jul 27 15:06:19.714901 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.714882    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-bound-sa-token\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.715118 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.715100    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb8wc\" (UniqueName: \"kubernetes.io/projected/1bddbbe6-38b7-43d0-86c7-5325c3bddc50-kube-api-access-cb8wc\") pod \"image-registry-69749f9fc8-zvp5v\" (UID: \"1bddbbe6-38b7-43d0-86c7-5325c3bddc50\") " pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.803482 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/886d40c5-29b2-4b59-934c-7f65021ca978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.803584 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803509    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6j5\" (UniqueName: \"kubernetes.io/projected/763a6fcc-a76b-48b2-94fd-e941083b9ec5-kube-api-access-cp6j5\") pod \"ingress-canary-pdfx8\" (UID: \"763a6fcc-a76b-48b2-94fd-e941083b9ec5\") " pod="openshift-ingress-canary/ingress-canary-pdfx8"
Jul 27 15:06:19.803584 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803527    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c23491c4-1cba-4e6d-8c33-68a952e9c9f6-tmp-dir\") pod \"dns-default-fsnvq\" (UID: \"c23491c4-1cba-4e6d-8c33-68a952e9c9f6\") " pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.803693 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/886d40c5-29b2-4b59-934c-7f65021ca978-crio-socket\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.803693 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/886d40c5-29b2-4b59-934c-7f65021ca978-data-volume\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.803693 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c23491c4-1cba-4e6d-8c33-68a952e9c9f6-config-volume\") pod \"dns-default-fsnvq\" (UID: \"c23491c4-1cba-4e6d-8c33-68a952e9c9f6\") " pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.803693 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803664    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c23491c4-1cba-4e6d-8c33-68a952e9c9f6-metrics-tls\") pod \"dns-default-fsnvq\" (UID: \"c23491c4-1cba-4e6d-8c33-68a952e9c9f6\") " pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.803693 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6zt\" (UniqueName: \"kubernetes.io/projected/886d40c5-29b2-4b59-934c-7f65021ca978-kube-api-access-mj6zt\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.803923 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803737    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/763a6fcc-a76b-48b2-94fd-e941083b9ec5-cert\") pod \"ingress-canary-pdfx8\" (UID: \"763a6fcc-a76b-48b2-94fd-e941083b9ec5\") " pod="openshift-ingress-canary/ingress-canary-pdfx8"
Jul 27 15:06:19.803923 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8q25\" (UniqueName: \"kubernetes.io/projected/c23491c4-1cba-4e6d-8c33-68a952e9c9f6-kube-api-access-n8q25\") pod \"dns-default-fsnvq\" (UID: \"c23491c4-1cba-4e6d-8c33-68a952e9c9f6\") " pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.803923 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/886d40c5-29b2-4b59-934c-7f65021ca978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.803923 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/886d40c5-29b2-4b59-934c-7f65021ca978-crio-socket\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.804122 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.803938    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/886d40c5-29b2-4b59-934c-7f65021ca978-data-volume\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.804122 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.804046    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/886d40c5-29b2-4b59-934c-7f65021ca978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.805876 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.805857    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/763a6fcc-a76b-48b2-94fd-e941083b9ec5-cert\") pod \"ingress-canary-pdfx8\" (UID: \"763a6fcc-a76b-48b2-94fd-e941083b9ec5\") " pod="openshift-ingress-canary/ingress-canary-pdfx8"
Jul 27 15:06:19.805970 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.805954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/886d40c5-29b2-4b59-934c-7f65021ca978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.813631 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.813601    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj6zt\" (UniqueName: \"kubernetes.io/projected/886d40c5-29b2-4b59-934c-7f65021ca978-kube-api-access-mj6zt\") pod \"insights-runtime-extractor-hknd7\" (UID: \"886d40c5-29b2-4b59-934c-7f65021ca978\") " pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.814136 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.814117    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6j5\" (UniqueName: \"kubernetes.io/projected/763a6fcc-a76b-48b2-94fd-e941083b9ec5-kube-api-access-cp6j5\") pod \"ingress-canary-pdfx8\" (UID: \"763a6fcc-a76b-48b2-94fd-e941083b9ec5\") " pod="openshift-ingress-canary/ingress-canary-pdfx8"
Jul 27 15:06:19.831114 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.831097    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:19.844625 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.844610    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hknd7"
Jul 27 15:06:19.852668 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.852652    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pdfx8"
Jul 27 15:06:19.905357 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.904725    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c23491c4-1cba-4e6d-8c33-68a952e9c9f6-tmp-dir\") pod \"dns-default-fsnvq\" (UID: \"c23491c4-1cba-4e6d-8c33-68a952e9c9f6\") " pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.905357 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.904778    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c23491c4-1cba-4e6d-8c33-68a952e9c9f6-config-volume\") pod \"dns-default-fsnvq\" (UID: \"c23491c4-1cba-4e6d-8c33-68a952e9c9f6\") " pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.905357 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.904802    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c23491c4-1cba-4e6d-8c33-68a952e9c9f6-metrics-tls\") pod \"dns-default-fsnvq\" (UID: \"c23491c4-1cba-4e6d-8c33-68a952e9c9f6\") " pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.905357 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.904834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8q25\" (UniqueName: \"kubernetes.io/projected/c23491c4-1cba-4e6d-8c33-68a952e9c9f6-kube-api-access-n8q25\") pod \"dns-default-fsnvq\" (UID: \"c23491c4-1cba-4e6d-8c33-68a952e9c9f6\") " pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.905357 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.905305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c23491c4-1cba-4e6d-8c33-68a952e9c9f6-tmp-dir\") pod \"dns-default-fsnvq\" (UID: \"c23491c4-1cba-4e6d-8c33-68a952e9c9f6\") " pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.905607 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.905431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c23491c4-1cba-4e6d-8c33-68a952e9c9f6-config-volume\") pod \"dns-default-fsnvq\" (UID: \"c23491c4-1cba-4e6d-8c33-68a952e9c9f6\") " pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.908153 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.908130    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c23491c4-1cba-4e6d-8c33-68a952e9c9f6-metrics-tls\") pod \"dns-default-fsnvq\" (UID: \"c23491c4-1cba-4e6d-8c33-68a952e9c9f6\") " pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.913871 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.913848    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8q25\" (UniqueName: \"kubernetes.io/projected/c23491c4-1cba-4e6d-8c33-68a952e9c9f6-kube-api-access-n8q25\") pod \"dns-default-fsnvq\" (UID: \"c23491c4-1cba-4e6d-8c33-68a952e9c9f6\") " pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:19.944675 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:19.944652    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:20.072341 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:20.072048    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pdfx8"]
Jul 27 15:06:20.075556 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:06:20.075516    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763a6fcc_a76b_48b2_94fd_e941083b9ec5.slice/crio-df36014b367e6dd42987743d81e65fe1a97cd85f245537d0d16e2f4c47262703 WatchSource:0}: Error finding container df36014b367e6dd42987743d81e65fe1a97cd85f245537d0d16e2f4c47262703: Status 404 returned error can't find the container with id df36014b367e6dd42987743d81e65fe1a97cd85f245537d0d16e2f4c47262703
Jul 27 15:06:20.077634 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:20.077558    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hknd7"]
Jul 27 15:06:20.082257 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:06:20.082233    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886d40c5_29b2_4b59_934c_7f65021ca978.slice/crio-237a7b4cf24d73b31534c65bdbd795ae1f7d3894bc38cc01b6fb115ab1765289 WatchSource:0}: Error finding container 237a7b4cf24d73b31534c65bdbd795ae1f7d3894bc38cc01b6fb115ab1765289: Status 404 returned error can't find the container with id 237a7b4cf24d73b31534c65bdbd795ae1f7d3894bc38cc01b6fb115ab1765289
Jul 27 15:06:20.083877 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:20.083857    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69749f9fc8-zvp5v"]
Jul 27 15:06:20.088608 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:06:20.088588    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bddbbe6_38b7_43d0_86c7_5325c3bddc50.slice/crio-bdf90690fb9c180231af9bbe7777cfda1b5a259c646a8877152244c2df7a7bb5 WatchSource:0}: Error finding container bdf90690fb9c180231af9bbe7777cfda1b5a259c646a8877152244c2df7a7bb5: Status 404 returned error can't find the container with id bdf90690fb9c180231af9bbe7777cfda1b5a259c646a8877152244c2df7a7bb5
Jul 27 15:06:20.126801 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:20.126778    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fsnvq"]
Jul 27 15:06:20.131643 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:06:20.131613    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23491c4_1cba_4e6d_8c33_68a952e9c9f6.slice/crio-c6b7c0e45ec65f74c3578f3ce0fe2c0715cf91992f6a8d06a6291e0e20d2ab33 WatchSource:0}: Error finding container c6b7c0e45ec65f74c3578f3ce0fe2c0715cf91992f6a8d06a6291e0e20d2ab33: Status 404 returned error can't find the container with id c6b7c0e45ec65f74c3578f3ce0fe2c0715cf91992f6a8d06a6291e0e20d2ab33
Jul 27 15:06:20.852397 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:20.852304    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fsnvq" event={"ID":"c23491c4-1cba-4e6d-8c33-68a952e9c9f6","Type":"ContainerStarted","Data":"c6b7c0e45ec65f74c3578f3ce0fe2c0715cf91992f6a8d06a6291e0e20d2ab33"}
Jul 27 15:06:20.854086 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:20.854051    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pdfx8" event={"ID":"763a6fcc-a76b-48b2-94fd-e941083b9ec5","Type":"ContainerStarted","Data":"df36014b367e6dd42987743d81e65fe1a97cd85f245537d0d16e2f4c47262703"}
Jul 27 15:06:20.855450 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:20.855424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hknd7" event={"ID":"886d40c5-29b2-4b59-934c-7f65021ca978","Type":"ContainerStarted","Data":"237a7b4cf24d73b31534c65bdbd795ae1f7d3894bc38cc01b6fb115ab1765289"}
Jul 27 15:06:20.858570 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:20.857705    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v" event={"ID":"1bddbbe6-38b7-43d0-86c7-5325c3bddc50","Type":"ContainerStarted","Data":"d5b048d2d6e46dbfd6b9854a8bcf6a20c9d9bfae94ef42c53370f227e1a44e4e"}
Jul 27 15:06:20.858570 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:20.857748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v" event={"ID":"1bddbbe6-38b7-43d0-86c7-5325c3bddc50","Type":"ContainerStarted","Data":"bdf90690fb9c180231af9bbe7777cfda1b5a259c646a8877152244c2df7a7bb5"}
Jul 27 15:06:20.858570 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:20.858527    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:20.891812 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:20.891580    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v" podStartSLOduration=6.891562945 podStartE2EDuration="6.891562945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:06:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:20.889742671 +0000 UTC m=+36.754320536" watchObservedRunningTime="2026-07-27 15:06:20.891562945 +0000 UTC m=+36.756140813"
Jul 27 15:06:28.247868 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.247570    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-txtcn"]
Jul 27 15:06:28.273485 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.273447    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"]
Jul 27 15:06:28.273612 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.273592    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.276120 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.276024    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 15:06:28.277638 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.277516    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vw8rk\""
Jul 27 15:06:28.277638 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.277527    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 15:06:28.277638 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.277559    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 15:06:28.277638 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.277522    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 15:06:28.277828 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.277646    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 15:06:28.277914 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.277898    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 15:06:28.287687 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.287658    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"]
Jul 27 15:06:28.287793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.287754    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.290128 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.290106    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 15:06:28.290235 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.290214    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 15:06:28.290552 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.290538    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ztn6x\""
Jul 27 15:06:28.290769 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.290757    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 15:06:28.373402 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.373374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f3174ad-4bca-4de7-bd65-43645ba80120-root\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.373517 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.373470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-accelerators-collector-config\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.373517 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.373499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpghm\" (UniqueName: \"kubernetes.io/projected/8f3174ad-4bca-4de7-bd65-43645ba80120-kube-api-access-gpghm\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.373620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.373517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-textfile\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.373620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.373592    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-tls\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.373713 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.373618    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-wtmp\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.373713 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.373698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f3174ad-4bca-4de7-bd65-43645ba80120-sys\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.373828 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.373730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f3174ad-4bca-4de7-bd65-43645ba80120-metrics-client-ca\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.373828 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.373756    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.474096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474073    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f3174ad-4bca-4de7-bd65-43645ba80120-root\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.474220 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474132    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01a105ac-7909-496d-9f6c-ff1e034017e9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.474220 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/01a105ac-7909-496d-9f6c-ff1e034017e9-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.474220 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474172    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a105ac-7909-496d-9f6c-ff1e034017e9-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.474220 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474190    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f3174ad-4bca-4de7-bd65-43645ba80120-root\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.474220 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-accelerators-collector-config\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.474507 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474246    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/01a105ac-7909-496d-9f6c-ff1e034017e9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.474507 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474302    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpghm\" (UniqueName: \"kubernetes.io/projected/8f3174ad-4bca-4de7-bd65-43645ba80120-kube-api-access-gpghm\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.474507 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474360    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-textfile\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.474507 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474403    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kksn5\" (UniqueName: \"kubernetes.io/projected/01a105ac-7909-496d-9f6c-ff1e034017e9-kube-api-access-kksn5\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.474507 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-tls\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.474507 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-wtmp\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.474775 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f3174ad-4bca-4de7-bd65-43645ba80120-sys\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.474775 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474550    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f3174ad-4bca-4de7-bd65-43645ba80120-metrics-client-ca\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.474775 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.474775 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474604    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a105ac-7909-496d-9f6c-ff1e034017e9-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.474775 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474693    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f3174ad-4bca-4de7-bd65-43645ba80120-sys\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.474775 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-accelerators-collector-config\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.475035 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474865    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-wtmp\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.475035 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.474973    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-textfile\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.475208 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.475187    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f3174ad-4bca-4de7-bd65-43645ba80120-metrics-client-ca\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.477613 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.477574    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.477722 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.477704    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f3174ad-4bca-4de7-bd65-43645ba80120-node-exporter-tls\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.482328 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.482291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpghm\" (UniqueName: \"kubernetes.io/projected/8f3174ad-4bca-4de7-bd65-43645ba80120-kube-api-access-gpghm\") pod \"node-exporter-txtcn\" (UID: \"8f3174ad-4bca-4de7-bd65-43645ba80120\") " pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.575444 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.575424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kksn5\" (UniqueName: \"kubernetes.io/projected/01a105ac-7909-496d-9f6c-ff1e034017e9-kube-api-access-kksn5\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.575537 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.575483    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a105ac-7909-496d-9f6c-ff1e034017e9-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.575537 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.575530    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01a105ac-7909-496d-9f6c-ff1e034017e9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.575640 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.575548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/01a105ac-7909-496d-9f6c-ff1e034017e9-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.575640 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.575563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a105ac-7909-496d-9f6c-ff1e034017e9-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.575640 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.575585    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/01a105ac-7909-496d-9f6c-ff1e034017e9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.575950 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.575926    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/01a105ac-7909-496d-9f6c-ff1e034017e9-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.576235 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.576149    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a105ac-7909-496d-9f6c-ff1e034017e9-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.576235 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.576200    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/01a105ac-7909-496d-9f6c-ff1e034017e9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.577718 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.577696    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a105ac-7909-496d-9f6c-ff1e034017e9-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.577846 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.577830    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01a105ac-7909-496d-9f6c-ff1e034017e9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.583268 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.583252    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kksn5\" (UniqueName: \"kubernetes.io/projected/01a105ac-7909-496d-9f6c-ff1e034017e9-kube-api-access-kksn5\") pod \"kube-state-metrics-56d9f944b4-ss4lr\" (UID: \"01a105ac-7909-496d-9f6c-ff1e034017e9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.585140 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.585125    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-txtcn"
Jul 27 15:06:28.612013 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:06:28.611992    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f3174ad_4bca_4de7_bd65_43645ba80120.slice/crio-0e26b43f09df9f66564501ae642762732e098631cd958fe512c1b55fa987795d WatchSource:0}: Error finding container 0e26b43f09df9f66564501ae642762732e098631cd958fe512c1b55fa987795d: Status 404 returned error can't find the container with id 0e26b43f09df9f66564501ae642762732e098631cd958fe512c1b55fa987795d
Jul 27 15:06:28.661041 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.661018    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"
Jul 27 15:06:28.814718 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.814696    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr"]
Jul 27 15:06:28.818027 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:06:28.817997    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a105ac_7909_496d_9f6c_ff1e034017e9.slice/crio-0c0d7f698d7a60ecf9f469d275273df1332383fe4acdc3d429483165a6cb5822 WatchSource:0}: Error finding container 0c0d7f698d7a60ecf9f469d275273df1332383fe4acdc3d429483165a6cb5822: Status 404 returned error can't find the container with id 0c0d7f698d7a60ecf9f469d275273df1332383fe4acdc3d429483165a6cb5822
Jul 27 15:06:28.880775 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.880348    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pdfx8" event={"ID":"763a6fcc-a76b-48b2-94fd-e941083b9ec5","Type":"ContainerStarted","Data":"788d34711e04658cb67a23a50f51d819dd7fadcbad0757aedfe367580cfac87e"}
Jul 27 15:06:28.882536 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.882509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hknd7" event={"ID":"886d40c5-29b2-4b59-934c-7f65021ca978","Type":"ContainerStarted","Data":"6d4e776a895a474ee8ca10a5c53c922af8d61caf4eae29fcd643ac46122c65e5"}
Jul 27 15:06:28.884435 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.884359    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fsnvq" event={"ID":"c23491c4-1cba-4e6d-8c33-68a952e9c9f6","Type":"ContainerStarted","Data":"e8ba9ef94289dd0cbfbd92d891711ee0cc813a8bdd9ed426118d4e81ed80cb60"}
Jul 27 15:06:28.884435 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.884404    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fsnvq" event={"ID":"c23491c4-1cba-4e6d-8c33-68a952e9c9f6","Type":"ContainerStarted","Data":"7c64d5d1032158a5e2efdb1f4554b569035ac138bcfb7307c7678565029b4018"}
Jul 27 15:06:28.884595 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.884507    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:28.886485 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.886453    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr" event={"ID":"01a105ac-7909-496d-9f6c-ff1e034017e9","Type":"ContainerStarted","Data":"0c0d7f698d7a60ecf9f469d275273df1332383fe4acdc3d429483165a6cb5822"}
Jul 27 15:06:28.887970 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.887946    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-txtcn" event={"ID":"8f3174ad-4bca-4de7-bd65-43645ba80120","Type":"ContainerStarted","Data":"0e26b43f09df9f66564501ae642762732e098631cd958fe512c1b55fa987795d"}
Jul 27 15:06:28.890761 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.890737    2559 generic.go:356] "Generic (PLEG): container finished" podID="ba429ab7-bc35-4e30-9dcf-cf87fe20e90b" containerID="50dc310c03c2edab92bbe38413b9b9a54590c0ca8ef4a8202ac731c8924404d3" exitCode=0
Jul 27 15:06:28.890858 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.890769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp4j8" event={"ID":"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b","Type":"ContainerDied","Data":"50dc310c03c2edab92bbe38413b9b9a54590c0ca8ef4a8202ac731c8924404d3"}
Jul 27 15:06:28.923542 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.923496    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pdfx8" podStartSLOduration=1.937231402 podStartE2EDuration="9.923484771s" totalImagesPullingTime="7.986253369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:28.898151493 +0000 UTC m=+44.762729363" watchObservedRunningTime="2026-07-27 15:06:28.923484771 +0000 UTC m=+44.788062636"
Jul 27 15:06:28.942256 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:28.941375    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fsnvq" podStartSLOduration=2.015706744 podStartE2EDuration="9.941359492s" totalImagesPullingTime="7.925652748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:28.941159848 +0000 UTC m=+44.805737713" watchObservedRunningTime="2026-07-27 15:06:28.941359492 +0000 UTC m=+44.805937360"
Jul 27 15:06:29.900443 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:29.898706    2559 generic.go:356] "Generic (PLEG): container finished" podID="ba429ab7-bc35-4e30-9dcf-cf87fe20e90b" containerID="a59377808c7125908e92fab49e5649f99d92a7b6d681a41cf6346e5104bbeef4" exitCode=0
Jul 27 15:06:29.900443 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:29.899847    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp4j8" event={"ID":"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b","Type":"ContainerDied","Data":"a59377808c7125908e92fab49e5649f99d92a7b6d681a41cf6346e5104bbeef4"}
Jul 27 15:06:31.278787 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.278755    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6845f496fc-6cflc"]
Jul 27 15:06:31.404428 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.404393    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6845f496fc-6cflc"]
Jul 27 15:06:31.404605 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.404518    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.407366 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.407347    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 15:06:31.407587 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.407561    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 15:06:31.408037 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.408021    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 15:06:31.408109 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.408096    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 15:06:31.408263 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.408239    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1ulafhn8f6h8k\""
Jul 27 15:06:31.408307 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.408295    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gnz8v\""
Jul 27 15:06:31.408511 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.408490    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 15:06:31.498361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.498001    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf29fde-926b-486b-89f1-8d968b8e351d-metrics-client-ca\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.498361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.498047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltzzx\" (UniqueName: \"kubernetes.io/projected/1cf29fde-926b-486b-89f1-8d968b8e351d-kube-api-access-ltzzx\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.498361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.498081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-tls\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.498361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.498100    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-grpc-tls\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.498361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.498156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.498361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.498182    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.498361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.498255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.498361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.498287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.599067 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.598999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf29fde-926b-486b-89f1-8d968b8e351d-metrics-client-ca\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.599067 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.599049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltzzx\" (UniqueName: \"kubernetes.io/projected/1cf29fde-926b-486b-89f1-8d968b8e351d-kube-api-access-ltzzx\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.599243 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.599085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-tls\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.599243 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.599105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-grpc-tls\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.599243 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.599182    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.599243 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.599216    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.599485 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.599246    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.599485 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.599290    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.599859 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.599774    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf29fde-926b-486b-89f1-8d968b8e351d-metrics-client-ca\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.602310 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.602287    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-tls\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.602429 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.602306    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.602429 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.602399    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-grpc-tls\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.602748 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.602717    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.602785 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.602759    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.602785 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.602774    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1cf29fde-926b-486b-89f1-8d968b8e351d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.609162 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.609126    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltzzx\" (UniqueName: \"kubernetes.io/projected/1cf29fde-926b-486b-89f1-8d968b8e351d-kube-api-access-ltzzx\") pod \"thanos-querier-6845f496fc-6cflc\" (UID: \"1cf29fde-926b-486b-89f1-8d968b8e351d\") " pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:31.715747 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:31.715716    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:33.090268 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:33.090006    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6845f496fc-6cflc"]
Jul 27 15:06:33.152530 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:06:33.152496    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf29fde_926b_486b_89f1_8d968b8e351d.slice/crio-6d6966ec59329e92df97b1ed34b81350e6f6a17c89dba5e1e3bc9fe9371f68cc WatchSource:0}: Error finding container 6d6966ec59329e92df97b1ed34b81350e6f6a17c89dba5e1e3bc9fe9371f68cc: Status 404 returned error can't find the container with id 6d6966ec59329e92df97b1ed34b81350e6f6a17c89dba5e1e3bc9fe9371f68cc
Jul 27 15:06:33.910093 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:33.910060    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc" event={"ID":"1cf29fde-926b-486b-89f1-8d968b8e351d","Type":"ContainerStarted","Data":"6d6966ec59329e92df97b1ed34b81350e6f6a17c89dba5e1e3bc9fe9371f68cc"}
Jul 27 15:06:33.912045 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:33.912014    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr" event={"ID":"01a105ac-7909-496d-9f6c-ff1e034017e9","Type":"ContainerStarted","Data":"0c8501645b48d205ec8ceb3a59e34599c3c49b86f754e42c50b8ab56ca608efd"}
Jul 27 15:06:33.912165 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:33.912070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr" event={"ID":"01a105ac-7909-496d-9f6c-ff1e034017e9","Type":"ContainerStarted","Data":"3e0ed06166c05a6adce48c0358a48a8b03dd8a9dcbae050ec41ecd50c2c509cb"}
Jul 27 15:06:33.912165 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:33.912100    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr" event={"ID":"01a105ac-7909-496d-9f6c-ff1e034017e9","Type":"ContainerStarted","Data":"97a1de5d2a99574972a5a0eea39e85711e4f8ece253561e87e3c132422193cae"}
Jul 27 15:06:33.913442 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:33.913419    2559 generic.go:356] "Generic (PLEG): container finished" podID="8f3174ad-4bca-4de7-bd65-43645ba80120" containerID="86be6950d7d20380691cf5e11b5e26c17cbaf10fe2248c030d0180b1becb0f23" exitCode=0
Jul 27 15:06:33.913559 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:33.913494    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-txtcn" event={"ID":"8f3174ad-4bca-4de7-bd65-43645ba80120","Type":"ContainerDied","Data":"86be6950d7d20380691cf5e11b5e26c17cbaf10fe2248c030d0180b1becb0f23"}
Jul 27 15:06:33.917030 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:33.917007    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp4j8" event={"ID":"ba429ab7-bc35-4e30-9dcf-cf87fe20e90b","Type":"ContainerStarted","Data":"bacd7624fce6fbef48d696481f6027fb9020728a54957b1c7815a96a1090c03b"}
Jul 27 15:06:33.918644 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:33.918624    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hknd7" event={"ID":"886d40c5-29b2-4b59-934c-7f65021ca978","Type":"ContainerStarted","Data":"fd3579fdbed58b49c803e19815a15718f5ca05a6762b935ecd01d8f74ce34268"}
Jul 27 15:06:33.941269 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:33.941228    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ss4lr" podStartSLOduration=1.828412139 podStartE2EDuration="5.941210776s" totalImagesPullingTime="4.112798637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:33.93944186 +0000 UTC m=+49.804019726" watchObservedRunningTime="2026-07-27 15:06:33.941210776 +0000 UTC m=+49.805788643"
Jul 27 15:06:33.971913 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:33.971878    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mp4j8" podStartSLOduration=20.342307624 podStartE2EDuration="49.971865139s" totalImagesPullingTime="29.629557515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:05:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:33.971553652 +0000 UTC m=+49.836131517" watchObservedRunningTime="2026-07-27 15:06:33.971865139 +0000 UTC m=+49.836443038"
Jul 27 15:06:34.924631 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:34.924590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-txtcn" event={"ID":"8f3174ad-4bca-4de7-bd65-43645ba80120","Type":"ContainerStarted","Data":"1c70ac9f0a15567dbc66ddadd760d9accc69b76e8f3a5c19c40633a774283307"}
Jul 27 15:06:34.925022 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:34.924660    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-txtcn" event={"ID":"8f3174ad-4bca-4de7-bd65-43645ba80120","Type":"ContainerStarted","Data":"d79a2b2c5505a38a4916678f2847f44a91e65f1fa07bb216f366c6b211a51cc7"}
Jul 27 15:06:34.949988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:34.949938    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-txtcn" podStartSLOduration=2.687900096 podStartE2EDuration="6.949924803s" totalImagesPullingTime="4.167715371s" totalInitContainerRuntime="94.309336ms" isStatefulPod=true podCreationTimestamp="2026-07-27 15:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:34.94846969 +0000 UTC m=+50.813047559" watchObservedRunningTime="2026-07-27 15:06:34.949924803 +0000 UTC m=+50.814502648"
Jul 27 15:06:37.936452 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:37.936410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hknd7" event={"ID":"886d40c5-29b2-4b59-934c-7f65021ca978","Type":"ContainerStarted","Data":"f996601230cbcadf3ede979f13c9795810fd110fc517edec1792d0f7d1549713"}
Jul 27 15:06:37.956892 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:37.956846    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hknd7" podStartSLOduration=2.231089865 podStartE2EDuration="18.956832062s" totalImagesPullingTime="16.725742197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:06:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:37.955582042 +0000 UTC m=+53.820159909" watchObservedRunningTime="2026-07-27 15:06:37.956832062 +0000 UTC m=+53.821409928"
Jul 27 15:06:38.901967 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:38.901910    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fsnvq"
Jul 27 15:06:38.941509 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:38.941481    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc" event={"ID":"1cf29fde-926b-486b-89f1-8d968b8e351d","Type":"ContainerStarted","Data":"d25b79232a7c0facf47e3dd0e39a430f9671aa011a9a1ba1bd0778e4a77f3f6c"}
Jul 27 15:06:38.941880 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:38.941551    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc" event={"ID":"1cf29fde-926b-486b-89f1-8d968b8e351d","Type":"ContainerStarted","Data":"4368d550caedd10c33fff55e9f69c251a99f4720edc676148acb3556f10e94a9"}
Jul 27 15:06:38.941880 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:38.941592    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc" event={"ID":"1cf29fde-926b-486b-89f1-8d968b8e351d","Type":"ContainerStarted","Data":"a7d05051f76e5ca2815a6b82f6680c5030b3cabc96486ee9109816f63272c197"}
Jul 27 15:06:42.867908 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:42.867880    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69749f9fc8-zvp5v"
Jul 27 15:06:42.955768 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:42.955734    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc" event={"ID":"1cf29fde-926b-486b-89f1-8d968b8e351d","Type":"ContainerStarted","Data":"5a26762a9ebd363221a743fa468b603b96a426a64bd5a95cf98d945239a32900"}
Jul 27 15:06:42.955913 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:42.955804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc" event={"ID":"1cf29fde-926b-486b-89f1-8d968b8e351d","Type":"ContainerStarted","Data":"dbcb544f70c8a1ae77e803e545cdee27f2c79ab80783d5a0fe0164549c1b8774"}
Jul 27 15:06:42.955913 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:42.955831    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc" event={"ID":"1cf29fde-926b-486b-89f1-8d968b8e351d","Type":"ContainerStarted","Data":"6a5dfa5fffc885e0ef3d802eb3205c6e1ccf4eaad4ce7baf9c307ca6b6105d9b"}
Jul 27 15:06:42.955913 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:42.955898    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:42.987894 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:42.987847    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc" podStartSLOduration=3.118256113 podStartE2EDuration="11.987831403s" totalImagesPullingTime="8.86957529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:06:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:42.986105246 +0000 UTC m=+58.850683111" watchObservedRunningTime="2026-07-27 15:06:42.987831403 +0000 UTC m=+58.852409268"
Jul 27 15:06:43.965201 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:43.965174    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6845f496fc-6cflc"
Jul 27 15:06:44.847793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:44.847768    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kllht"
Jul 27 15:06:50.329417 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.329384    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:50.332636 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.332618    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 15:06:50.342272 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.342248    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec80f44-9dda-4e50-ab28-bf61b499eb0b-metrics-certs\") pod \"network-metrics-daemon-5vv4s\" (UID: \"0ec80f44-9dda-4e50-ab28-bf61b499eb0b\") " pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:50.429665 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.429643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qwq\" (UniqueName: \"kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq\") pod \"network-check-target-jtzks\" (UID: \"78c9654d-657e-4a4c-838a-625d9c7a5a79\") " pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:50.429750 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.429684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:50.434201 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.434185    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 15:06:50.434243 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.434187    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 15:06:50.442834 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.442811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f15adc1-27eb-40d4-98d0-ea2f32614a58-original-pull-secret\") pod \"global-pull-secret-syncer-5rjcj\" (UID: \"2f15adc1-27eb-40d4-98d0-ea2f32614a58\") " pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:50.443603 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.443587    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 15:06:50.453621 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.453605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2qwq\" (UniqueName: \"kubernetes.io/projected/78c9654d-657e-4a4c-838a-625d9c7a5a79-kube-api-access-w2qwq\") pod \"network-check-target-jtzks\" (UID: \"78c9654d-657e-4a4c-838a-625d9c7a5a79\") " pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:50.636922 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.636852    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkhzc\""
Jul 27 15:06:50.641610 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.641596    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5rjcj"
Jul 27 15:06:50.644726 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.644711    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vv4s"
Jul 27 15:06:50.649013 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.648987    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2bzfc\""
Jul 27 15:06:50.656608 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.656585    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:50.799889 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.799861    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5rjcj"]
Jul 27 15:06:50.803514 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:06:50.803486    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f15adc1_27eb_40d4_98d0_ea2f32614a58.slice/crio-518ccf4b669229afa91938c11fec267b40bdaee8270817df2844ca3081a34bde WatchSource:0}: Error finding container 518ccf4b669229afa91938c11fec267b40bdaee8270817df2844ca3081a34bde: Status 404 returned error can't find the container with id 518ccf4b669229afa91938c11fec267b40bdaee8270817df2844ca3081a34bde
Jul 27 15:06:50.982671 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:50.982642    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5rjcj" event={"ID":"2f15adc1-27eb-40d4-98d0-ea2f32614a58","Type":"ContainerStarted","Data":"518ccf4b669229afa91938c11fec267b40bdaee8270817df2844ca3081a34bde"}
Jul 27 15:06:51.020306 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:51.020270    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jtzks"]
Jul 27 15:06:51.022820 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:06:51.022795    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c9654d_657e_4a4c_838a_625d9c7a5a79.slice/crio-24c1edbb9d4057caeafc41065ccbfed2bd07ff9b62d71cb1c4e2895b4d88b901 WatchSource:0}: Error finding container 24c1edbb9d4057caeafc41065ccbfed2bd07ff9b62d71cb1c4e2895b4d88b901: Status 404 returned error can't find the container with id 24c1edbb9d4057caeafc41065ccbfed2bd07ff9b62d71cb1c4e2895b4d88b901
Jul 27 15:06:51.027053 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:51.027021    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5vv4s"]
Jul 27 15:06:51.031267 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:06:51.031248    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec80f44_9dda_4e50_ab28_bf61b499eb0b.slice/crio-9d19d064c62ac9c38457759e9f0a1a2bda42047ab9d5a686e17bce35f2b6e3f8 WatchSource:0}: Error finding container 9d19d064c62ac9c38457759e9f0a1a2bda42047ab9d5a686e17bce35f2b6e3f8: Status 404 returned error can't find the container with id 9d19d064c62ac9c38457759e9f0a1a2bda42047ab9d5a686e17bce35f2b6e3f8
Jul 27 15:06:51.987349 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:51.987298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jtzks" event={"ID":"78c9654d-657e-4a4c-838a-625d9c7a5a79","Type":"ContainerStarted","Data":"24c1edbb9d4057caeafc41065ccbfed2bd07ff9b62d71cb1c4e2895b4d88b901"}
Jul 27 15:06:51.988525 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:51.988496    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vv4s" event={"ID":"0ec80f44-9dda-4e50-ab28-bf61b499eb0b","Type":"ContainerStarted","Data":"9d19d064c62ac9c38457759e9f0a1a2bda42047ab9d5a686e17bce35f2b6e3f8"}
Jul 27 15:06:52.995291 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:52.995256    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vv4s" event={"ID":"0ec80f44-9dda-4e50-ab28-bf61b499eb0b","Type":"ContainerStarted","Data":"fdcb2370a9ee09059509dbffbab38f50d1315fcae8c87b0caaaa4f743aaac930"}
Jul 27 15:06:52.995720 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:52.995309    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vv4s" event={"ID":"0ec80f44-9dda-4e50-ab28-bf61b499eb0b","Type":"ContainerStarted","Data":"cf00a91c172d25d20e8bb739fdb97934e2e45783e28bfb723cfac8f01c7de0d8"}
Jul 27 15:06:53.015154 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:53.015106    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5vv4s" podStartSLOduration=67.042773094 podStartE2EDuration="1m8.015088807s" totalImagesPullingTime="972.315713ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:53.014433458 +0000 UTC m=+68.879011336" watchObservedRunningTime="2026-07-27 15:06:53.015088807 +0000 UTC m=+68.879666674"
Jul 27 15:06:56.008215 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:56.008170    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jtzks" event={"ID":"78c9654d-657e-4a4c-838a-625d9c7a5a79","Type":"ContainerStarted","Data":"117bf2518f8ad91d18e131a4756d8ba4eec3df04fc26b6658bbcd0177bc193b6"}
Jul 27 15:06:56.008666 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:56.008239    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:06:56.009659 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:56.009632    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5rjcj" event={"ID":"2f15adc1-27eb-40d4-98d0-ea2f32614a58","Type":"ContainerStarted","Data":"ebeda7a90d5fb557025363f9bd110a52640fe3dc81c602fd9816ef849e47b9ce"}
Jul 27 15:06:56.026259 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:56.026172    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jtzks" podStartSLOduration=67.287615228 podStartE2EDuration="1m12.026159056s" totalImagesPullingTime="4.738543828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:56.025007764 +0000 UTC m=+71.889585657" watchObservedRunningTime="2026-07-27 15:06:56.026159056 +0000 UTC m=+71.890736921"
Jul 27 15:06:56.039871 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:06:56.039824    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5rjcj" podStartSLOduration=66.069610821 podStartE2EDuration="1m11.03981174s" totalImagesPullingTime="4.970200919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:06:56.039142307 +0000 UTC m=+71.903720173" watchObservedRunningTime="2026-07-27 15:06:56.03981174 +0000 UTC m=+71.904389604"
Jul 27 15:07:27.015228 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:27.015201    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jtzks"
Jul 27 15:07:50.846932 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.846898    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 15:07:50.849697 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.849674    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.852516 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.852492    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 15:07:50.852516 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.852505    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 15:07:50.852716 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.852510    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jg9r5\""
Jul 27 15:07:50.852716 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.852556    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 15:07:50.852716 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.852611    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 15:07:50.852860 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.852817    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 15:07:50.852912 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.852883    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 15:07:50.852963 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.852912    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 15:07:50.852963 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.852922    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 15:07:50.858085 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.858069    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 15:07:50.865982 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.865964    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 15:07:50.921521 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921492    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.921648 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921527    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.921648 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921557    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.921648 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921580    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.921648 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921610    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.921648 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921627    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.921804 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.921804 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921704    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.921804 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921721    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-web-config\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.921804 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921751    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.921804 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921780    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhxlx\" (UniqueName: \"kubernetes.io/projected/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-kube-api-access-lhxlx\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.921943 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921807    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:50.921943 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:50.921827    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-config-out\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022329 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022297    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022424 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022424 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022424 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022424 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022414    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-web-config\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022467    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhxlx\" (UniqueName: \"kubernetes.io/projected/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-kube-api-access-lhxlx\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022491    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-config-out\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022551    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022945 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022640    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.022945 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.022687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.023396 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.023375    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.023838 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.023774    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.025684 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.025638    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.025825 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.025804    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.026222 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.026199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.026306 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.026281    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-web-config\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.026441 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.026421    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.026493 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.026479    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.026647 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.026604    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.026738 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.026722    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.027356 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.027341    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-config-out\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.032428 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.032410    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhxlx\" (UniqueName: \"kubernetes.io/projected/b3c48aa6-ef4d-40eb-9e5b-930d45d81b58-kube-api-access-lhxlx\") pod \"alertmanager-main-0\" (UID: \"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.158754 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.158712    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 15:07:51.314445 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:51.314420    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 15:07:51.315729 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:07:51.315701    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c48aa6_ef4d_40eb_9e5b_930d45d81b58.slice/crio-447cbaa23509fbf4ba4dbfe8c17525897977baef9142af2d1d2fb749e5b77847 WatchSource:0}: Error finding container 447cbaa23509fbf4ba4dbfe8c17525897977baef9142af2d1d2fb749e5b77847: Status 404 returned error can't find the container with id 447cbaa23509fbf4ba4dbfe8c17525897977baef9142af2d1d2fb749e5b77847
Jul 27 15:07:52.188052 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:52.188012    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58","Type":"ContainerStarted","Data":"447cbaa23509fbf4ba4dbfe8c17525897977baef9142af2d1d2fb749e5b77847"}
Jul 27 15:07:53.194095 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:53.194061    2559 generic.go:356] "Generic (PLEG): container finished" podID="b3c48aa6-ef4d-40eb-9e5b-930d45d81b58" containerID="6235adb4c862c734684f8a2b31e42967b2757b70767b952dbbf508e63f805fe6" exitCode=0
Jul 27 15:07:53.194493 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:53.194096    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58","Type":"ContainerDied","Data":"6235adb4c862c734684f8a2b31e42967b2757b70767b952dbbf508e63f805fe6"}
Jul 27 15:07:55.204796 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:55.204772    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58","Type":"ContainerStarted","Data":"71c5e77bbf12c509a6ba71a8ba9a3efe80399d29864641a2c6d0377c1ee51e77"}
Jul 27 15:07:55.205125 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:55.204860    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58","Type":"ContainerStarted","Data":"4772ad3eb5cf44a2b15d52ef44af82315d1be8781e393ff7190a36355e413f93"}
Jul 27 15:07:55.205125 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:55.204888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58","Type":"ContainerStarted","Data":"6d7641530ad3f4bfc5095c3c03797dc10f11a76265adf833480c5617b2e473f1"}
Jul 27 15:07:55.205125 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:55.204922    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58","Type":"ContainerStarted","Data":"87fb8f67ed925064d064cbafe45392e8efffd3a8a2abaf97fa5ebaa8e22b1a8b"}
Jul 27 15:07:55.205125 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:55.204956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58","Type":"ContainerStarted","Data":"193bbae7c7d2515c3782d3500bb772ec31078b7ac7640a72f4f424e48df49de7"}
Jul 27 15:07:56.210788 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:56.210761    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c48aa6-ef4d-40eb-9e5b-930d45d81b58","Type":"ContainerStarted","Data":"58a6232aa670e3fd5abc670038f522f27cdb47fb4c01e1c8e634c7f02c7b7889"}
Jul 27 15:07:56.247560 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:07:56.247518    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.5692747259999997 podStartE2EDuration="6.247505238s" totalImagesPullingTime="2.66234246s" totalInitContainerRuntime="15.888052ms" isStatefulPod=false podCreationTimestamp="2026-07-27 15:07:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:07:56.247087949 +0000 UTC m=+132.111665814" watchObservedRunningTime="2026-07-27 15:07:56.247505238 +0000 UTC m=+132.112083111"
Jul 27 15:10:38.784239 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:38.784209    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"]
Jul 27 15:10:38.786207 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:38.786191    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:38.788904 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:38.788878    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 15:10:38.789026 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:38.788909    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 15:10:38.790052 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:38.790033    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gbs8s\""
Jul 27 15:10:38.795795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:38.795777    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"]
Jul 27 15:10:38.908567 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:38.908547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fpm2\" (UniqueName: \"kubernetes.io/projected/d58a86dc-eb00-4090-aedf-8d2da62afb07-kube-api-access-4fpm2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b\" (UID: \"d58a86dc-eb00-4090-aedf-8d2da62afb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:38.908670 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:38.908578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58a86dc-eb00-4090-aedf-8d2da62afb07-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b\" (UID: \"d58a86dc-eb00-4090-aedf-8d2da62afb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:38.908670 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:38.908627    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58a86dc-eb00-4090-aedf-8d2da62afb07-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b\" (UID: \"d58a86dc-eb00-4090-aedf-8d2da62afb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:39.009478 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:39.009446    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fpm2\" (UniqueName: \"kubernetes.io/projected/d58a86dc-eb00-4090-aedf-8d2da62afb07-kube-api-access-4fpm2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b\" (UID: \"d58a86dc-eb00-4090-aedf-8d2da62afb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:39.009568 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:39.009487    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58a86dc-eb00-4090-aedf-8d2da62afb07-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b\" (UID: \"d58a86dc-eb00-4090-aedf-8d2da62afb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:39.009568 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:39.009512    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58a86dc-eb00-4090-aedf-8d2da62afb07-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b\" (UID: \"d58a86dc-eb00-4090-aedf-8d2da62afb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:39.009777 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:39.009764    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58a86dc-eb00-4090-aedf-8d2da62afb07-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b\" (UID: \"d58a86dc-eb00-4090-aedf-8d2da62afb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:39.009828 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:39.009813    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58a86dc-eb00-4090-aedf-8d2da62afb07-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b\" (UID: \"d58a86dc-eb00-4090-aedf-8d2da62afb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:39.018163 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:39.018144    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fpm2\" (UniqueName: \"kubernetes.io/projected/d58a86dc-eb00-4090-aedf-8d2da62afb07-kube-api-access-4fpm2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b\" (UID: \"d58a86dc-eb00-4090-aedf-8d2da62afb07\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:39.094850 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:39.094804    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:39.213393 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:39.213367    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"]
Jul 27 15:10:39.216373 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:10:39.216348    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58a86dc_eb00_4090_aedf_8d2da62afb07.slice/crio-b307f151cf7f405b62816e41bd6cdf243f7f72882fe0b5b11fa0eb880e3c7122 WatchSource:0}: Error finding container b307f151cf7f405b62816e41bd6cdf243f7f72882fe0b5b11fa0eb880e3c7122: Status 404 returned error can't find the container with id b307f151cf7f405b62816e41bd6cdf243f7f72882fe0b5b11fa0eb880e3c7122
Jul 27 15:10:39.705089 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:39.705062    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b" event={"ID":"d58a86dc-eb00-4090-aedf-8d2da62afb07","Type":"ContainerStarted","Data":"b307f151cf7f405b62816e41bd6cdf243f7f72882fe0b5b11fa0eb880e3c7122"}
Jul 27 15:10:45.206560 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:45.206536    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 15:10:45.728653 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:45.728622    2559 generic.go:356] "Generic (PLEG): container finished" podID="d58a86dc-eb00-4090-aedf-8d2da62afb07" containerID="e50149f4ff78d6827e2cf5035d6348f14312f17cf89530271f9f0fcb3e27ecef" exitCode=0
Jul 27 15:10:45.728762 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:45.728711    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b" event={"ID":"d58a86dc-eb00-4090-aedf-8d2da62afb07","Type":"ContainerDied","Data":"e50149f4ff78d6827e2cf5035d6348f14312f17cf89530271f9f0fcb3e27ecef"}
Jul 27 15:10:48.740960 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:48.740924    2559 generic.go:356] "Generic (PLEG): container finished" podID="d58a86dc-eb00-4090-aedf-8d2da62afb07" containerID="ed05db1c628a7749620d3667a55ec249fcdc0e7a0f95536d14e51a9e0e6ae386" exitCode=0
Jul 27 15:10:48.741336 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:48.740976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b" event={"ID":"d58a86dc-eb00-4090-aedf-8d2da62afb07","Type":"ContainerDied","Data":"ed05db1c628a7749620d3667a55ec249fcdc0e7a0f95536d14e51a9e0e6ae386"}
Jul 27 15:10:48.741922 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:48.741907    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 15:10:54.765972 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:54.765886    2559 generic.go:356] "Generic (PLEG): container finished" podID="d58a86dc-eb00-4090-aedf-8d2da62afb07" containerID="d29811099545c131aebb40efad2e37782d264507551eac953d84b2563ec84b79" exitCode=0
Jul 27 15:10:54.766306 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:54.765963    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b" event={"ID":"d58a86dc-eb00-4090-aedf-8d2da62afb07","Type":"ContainerDied","Data":"d29811099545c131aebb40efad2e37782d264507551eac953d84b2563ec84b79"}
Jul 27 15:10:55.890268 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:55.890246    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:56.044187 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:56.044089    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58a86dc-eb00-4090-aedf-8d2da62afb07-bundle\") pod \"d58a86dc-eb00-4090-aedf-8d2da62afb07\" (UID: \"d58a86dc-eb00-4090-aedf-8d2da62afb07\") "
Jul 27 15:10:56.044187 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:56.044140    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fpm2\" (UniqueName: \"kubernetes.io/projected/d58a86dc-eb00-4090-aedf-8d2da62afb07-kube-api-access-4fpm2\") pod \"d58a86dc-eb00-4090-aedf-8d2da62afb07\" (UID: \"d58a86dc-eb00-4090-aedf-8d2da62afb07\") "
Jul 27 15:10:56.044460 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:56.044208    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58a86dc-eb00-4090-aedf-8d2da62afb07-util\") pod \"d58a86dc-eb00-4090-aedf-8d2da62afb07\" (UID: \"d58a86dc-eb00-4090-aedf-8d2da62afb07\") "
Jul 27 15:10:56.044847 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:56.044820    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d58a86dc-eb00-4090-aedf-8d2da62afb07-bundle" (OuterVolumeSpecName: "bundle") pod "d58a86dc-eb00-4090-aedf-8d2da62afb07" (UID: "d58a86dc-eb00-4090-aedf-8d2da62afb07"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:10:56.046493 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:56.046466    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d58a86dc-eb00-4090-aedf-8d2da62afb07-kube-api-access-4fpm2" (OuterVolumeSpecName: "kube-api-access-4fpm2") pod "d58a86dc-eb00-4090-aedf-8d2da62afb07" (UID: "d58a86dc-eb00-4090-aedf-8d2da62afb07"). InnerVolumeSpecName "kube-api-access-4fpm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:10:56.048131 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:56.048101    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d58a86dc-eb00-4090-aedf-8d2da62afb07-util" (OuterVolumeSpecName: "util") pod "d58a86dc-eb00-4090-aedf-8d2da62afb07" (UID: "d58a86dc-eb00-4090-aedf-8d2da62afb07"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:10:56.145258 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:56.145217    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58a86dc-eb00-4090-aedf-8d2da62afb07-bundle\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:10:56.145258 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:56.145253    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fpm2\" (UniqueName: \"kubernetes.io/projected/d58a86dc-eb00-4090-aedf-8d2da62afb07-kube-api-access-4fpm2\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:10:56.145258 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:56.145265    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58a86dc-eb00-4090-aedf-8d2da62afb07-util\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:10:56.774894 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:56.774859    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b" event={"ID":"d58a86dc-eb00-4090-aedf-8d2da62afb07","Type":"ContainerDied","Data":"b307f151cf7f405b62816e41bd6cdf243f7f72882fe0b5b11fa0eb880e3c7122"}
Jul 27 15:10:56.774894 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:56.774896    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lh66b"
Jul 27 15:10:56.775082 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:10:56.774904    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b307f151cf7f405b62816e41bd6cdf243f7f72882fe0b5b11fa0eb880e3c7122"
Jul 27 15:11:01.749846 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.749811    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp"]
Jul 27 15:11:01.750207 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.750063    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d58a86dc-eb00-4090-aedf-8d2da62afb07" containerName="extract"
Jul 27 15:11:01.750207 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.750073    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d58a86dc-eb00-4090-aedf-8d2da62afb07" containerName="extract"
Jul 27 15:11:01.750207 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.750091    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d58a86dc-eb00-4090-aedf-8d2da62afb07" containerName="util"
Jul 27 15:11:01.750207 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.750095    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d58a86dc-eb00-4090-aedf-8d2da62afb07" containerName="util"
Jul 27 15:11:01.750207 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.750100    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d58a86dc-eb00-4090-aedf-8d2da62afb07" containerName="pull"
Jul 27 15:11:01.750207 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.750105    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d58a86dc-eb00-4090-aedf-8d2da62afb07" containerName="pull"
Jul 27 15:11:01.750207 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.750146    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d58a86dc-eb00-4090-aedf-8d2da62afb07" containerName="extract"
Jul 27 15:11:01.793509 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.793481    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp"]
Jul 27 15:11:01.793664 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.793575    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp"
Jul 27 15:11:01.796839 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.796816    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 15:11:01.796979 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.796882    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:11:01.797189 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.797167    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-45fq9\""
Jul 27 15:11:01.884660 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.884628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j76pq\" (UniqueName: \"kubernetes.io/projected/d193188a-563e-4676-a518-adf96afe9d51-kube-api-access-j76pq\") pod \"cert-manager-operator-controller-manager-55c444bf86-w85xp\" (UID: \"d193188a-563e-4676-a518-adf96afe9d51\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp"
Jul 27 15:11:01.884824 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.884698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d193188a-563e-4676-a518-adf96afe9d51-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-w85xp\" (UID: \"d193188a-563e-4676-a518-adf96afe9d51\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp"
Jul 27 15:11:01.985443 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.985405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d193188a-563e-4676-a518-adf96afe9d51-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-w85xp\" (UID: \"d193188a-563e-4676-a518-adf96afe9d51\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp"
Jul 27 15:11:01.985615 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.985454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j76pq\" (UniqueName: \"kubernetes.io/projected/d193188a-563e-4676-a518-adf96afe9d51-kube-api-access-j76pq\") pod \"cert-manager-operator-controller-manager-55c444bf86-w85xp\" (UID: \"d193188a-563e-4676-a518-adf96afe9d51\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp"
Jul 27 15:11:01.985846 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.985830    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d193188a-563e-4676-a518-adf96afe9d51-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-w85xp\" (UID: \"d193188a-563e-4676-a518-adf96afe9d51\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp"
Jul 27 15:11:01.994599 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:01.994575    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j76pq\" (UniqueName: \"kubernetes.io/projected/d193188a-563e-4676-a518-adf96afe9d51-kube-api-access-j76pq\") pod \"cert-manager-operator-controller-manager-55c444bf86-w85xp\" (UID: \"d193188a-563e-4676-a518-adf96afe9d51\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp"
Jul 27 15:11:02.102845 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:02.102749    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp"
Jul 27 15:11:02.247968 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:02.247937    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp"]
Jul 27 15:11:02.251353 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:11:02.251301    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd193188a_563e_4676_a518_adf96afe9d51.slice/crio-78f9b44c9fadf9ff40c9e373aa8b11c602cb89cb4b0ea07e5378ccd002e18a71 WatchSource:0}: Error finding container 78f9b44c9fadf9ff40c9e373aa8b11c602cb89cb4b0ea07e5378ccd002e18a71: Status 404 returned error can't find the container with id 78f9b44c9fadf9ff40c9e373aa8b11c602cb89cb4b0ea07e5378ccd002e18a71
Jul 27 15:11:02.796755 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:02.796722    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp" event={"ID":"d193188a-563e-4676-a518-adf96afe9d51","Type":"ContainerStarted","Data":"78f9b44c9fadf9ff40c9e373aa8b11c602cb89cb4b0ea07e5378ccd002e18a71"}
Jul 27 15:11:04.807177 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:04.807089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp" event={"ID":"d193188a-563e-4676-a518-adf96afe9d51","Type":"ContainerStarted","Data":"5ca05b8d0db7707630aa45b1e55d454292f5efb31057f9c083f6118ce5d5b162"}
Jul 27 15:11:04.830958 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:04.830906    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w85xp" podStartSLOduration=1.651632 podStartE2EDuration="3.830890654s" totalImagesPullingTime="2.179258654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:11:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:11:04.829008493 +0000 UTC m=+320.693586360" watchObservedRunningTime="2026-07-27 15:11:04.830890654 +0000 UTC m=+320.695468520"
Jul 27 15:11:06.007876 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.007843    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"]
Jul 27 15:11:06.022077 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.022041    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"]
Jul 27 15:11:06.022232 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.022163    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:06.024801 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.024775    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 15:11:06.024801 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.024796    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gbs8s\""
Jul 27 15:11:06.025929 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.025914    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 15:11:06.118562 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.118528    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/095b3f5c-899d-4a25-833f-65363e851f67-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t\" (UID: \"095b3f5c-899d-4a25-833f-65363e851f67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:06.118713 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.118612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm9z5\" (UniqueName: \"kubernetes.io/projected/095b3f5c-899d-4a25-833f-65363e851f67-kube-api-access-wm9z5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t\" (UID: \"095b3f5c-899d-4a25-833f-65363e851f67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:06.118764 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.118714    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/095b3f5c-899d-4a25-833f-65363e851f67-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t\" (UID: \"095b3f5c-899d-4a25-833f-65363e851f67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:06.219492 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.219463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/095b3f5c-899d-4a25-833f-65363e851f67-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t\" (UID: \"095b3f5c-899d-4a25-833f-65363e851f67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:06.219658 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.219519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm9z5\" (UniqueName: \"kubernetes.io/projected/095b3f5c-899d-4a25-833f-65363e851f67-kube-api-access-wm9z5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t\" (UID: \"095b3f5c-899d-4a25-833f-65363e851f67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:06.219658 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.219570    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/095b3f5c-899d-4a25-833f-65363e851f67-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t\" (UID: \"095b3f5c-899d-4a25-833f-65363e851f67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:06.219895 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.219875    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/095b3f5c-899d-4a25-833f-65363e851f67-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t\" (UID: \"095b3f5c-899d-4a25-833f-65363e851f67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:06.219960 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.219883    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/095b3f5c-899d-4a25-833f-65363e851f67-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t\" (UID: \"095b3f5c-899d-4a25-833f-65363e851f67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:06.229647 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.229622    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm9z5\" (UniqueName: \"kubernetes.io/projected/095b3f5c-899d-4a25-833f-65363e851f67-kube-api-access-wm9z5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t\" (UID: \"095b3f5c-899d-4a25-833f-65363e851f67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:06.331696 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.331610    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:06.332068 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.332050    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4msqw"]
Jul 27 15:11:06.365272 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.365246    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4msqw"]
Jul 27 15:11:06.365405 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.365374    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw"
Jul 27 15:11:06.368030 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.368006    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-j8sm5\""
Jul 27 15:11:06.368030 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.368014    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 15:11:06.368171 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.368080    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 15:11:06.490621 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.490588    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"]
Jul 27 15:11:06.493741 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:11:06.493713    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095b3f5c_899d_4a25_833f_65363e851f67.slice/crio-2b6930bca1838432ef1d65e969eb56c38eb067ac2329d163e96217da4df3de19 WatchSource:0}: Error finding container 2b6930bca1838432ef1d65e969eb56c38eb067ac2329d163e96217da4df3de19: Status 404 returned error can't find the container with id 2b6930bca1838432ef1d65e969eb56c38eb067ac2329d163e96217da4df3de19
Jul 27 15:11:06.522052 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.522029    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f203e363-81ea-44d1-aea0-e72bd3b4b5c5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4msqw\" (UID: \"f203e363-81ea-44d1-aea0-e72bd3b4b5c5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw"
Jul 27 15:11:06.522162 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.522075    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfxl9\" (UniqueName: \"kubernetes.io/projected/f203e363-81ea-44d1-aea0-e72bd3b4b5c5-kube-api-access-mfxl9\") pod \"cert-manager-webhook-6486ffd997-4msqw\" (UID: \"f203e363-81ea-44d1-aea0-e72bd3b4b5c5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw"
Jul 27 15:11:06.623185 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.623156    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfxl9\" (UniqueName: \"kubernetes.io/projected/f203e363-81ea-44d1-aea0-e72bd3b4b5c5-kube-api-access-mfxl9\") pod \"cert-manager-webhook-6486ffd997-4msqw\" (UID: \"f203e363-81ea-44d1-aea0-e72bd3b4b5c5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw"
Jul 27 15:11:06.623354 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.623247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f203e363-81ea-44d1-aea0-e72bd3b4b5c5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4msqw\" (UID: \"f203e363-81ea-44d1-aea0-e72bd3b4b5c5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw"
Jul 27 15:11:06.633679 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.633656    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f203e363-81ea-44d1-aea0-e72bd3b4b5c5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4msqw\" (UID: \"f203e363-81ea-44d1-aea0-e72bd3b4b5c5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw"
Jul 27 15:11:06.633812 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.633795    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfxl9\" (UniqueName: \"kubernetes.io/projected/f203e363-81ea-44d1-aea0-e72bd3b4b5c5-kube-api-access-mfxl9\") pod \"cert-manager-webhook-6486ffd997-4msqw\" (UID: \"f203e363-81ea-44d1-aea0-e72bd3b4b5c5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw"
Jul 27 15:11:06.693772 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.693742    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw"
Jul 27 15:11:06.817042 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.817013    2559 generic.go:356] "Generic (PLEG): container finished" podID="095b3f5c-899d-4a25-833f-65363e851f67" containerID="62b73e6991b99c075c489376f88eba2d6de0a5da369f87b3d95a45e4a28ed1c8" exitCode=0
Jul 27 15:11:06.817203 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.817068    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t" event={"ID":"095b3f5c-899d-4a25-833f-65363e851f67","Type":"ContainerDied","Data":"62b73e6991b99c075c489376f88eba2d6de0a5da369f87b3d95a45e4a28ed1c8"}
Jul 27 15:11:06.817203 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.817132    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t" event={"ID":"095b3f5c-899d-4a25-833f-65363e851f67","Type":"ContainerStarted","Data":"2b6930bca1838432ef1d65e969eb56c38eb067ac2329d163e96217da4df3de19"}
Jul 27 15:11:06.831926 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:06.831901    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4msqw"]
Jul 27 15:11:07.822578 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:07.822541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw" event={"ID":"f203e363-81ea-44d1-aea0-e72bd3b4b5c5","Type":"ContainerStarted","Data":"03cd966c5855534594f1356c8ae612914954a041402b5a8f464204924d2aba09"}
Jul 27 15:11:10.842456 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:10.842418    2559 generic.go:356] "Generic (PLEG): container finished" podID="095b3f5c-899d-4a25-833f-65363e851f67" containerID="d33edbd7cb9de4f1bacdac93cb10b5044f9ad3ad45e31933be41354e232325a8" exitCode=0
Jul 27 15:11:10.842985 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:10.842493    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t" event={"ID":"095b3f5c-899d-4a25-833f-65363e851f67","Type":"ContainerDied","Data":"d33edbd7cb9de4f1bacdac93cb10b5044f9ad3ad45e31933be41354e232325a8"}
Jul 27 15:11:10.843977 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:10.843955    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw" event={"ID":"f203e363-81ea-44d1-aea0-e72bd3b4b5c5","Type":"ContainerStarted","Data":"620f4d71ebe971e64046c9cec2547202c3d6291a77286b01c314a87e14394b6a"}
Jul 27 15:11:10.844111 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:10.844098    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw"
Jul 27 15:11:10.883904 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:10.883860    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw" podStartSLOduration=1.5124755589999999 podStartE2EDuration="4.883844347s" totalImagesPullingTime="3.371368788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:11:10.882303785 +0000 UTC m=+326.746881662" watchObservedRunningTime="2026-07-27 15:11:10.883844347 +0000 UTC m=+326.748422212"
Jul 27 15:11:11.849790 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:11.849758    2559 generic.go:356] "Generic (PLEG): container finished" podID="095b3f5c-899d-4a25-833f-65363e851f67" containerID="e9b67ca4985fe522c8e08eeaa8aea0f766a832e95af1bddc2e727e5509a2e6ed" exitCode=0
Jul 27 15:11:11.850182 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:11.849815    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t" event={"ID":"095b3f5c-899d-4a25-833f-65363e851f67","Type":"ContainerDied","Data":"e9b67ca4985fe522c8e08eeaa8aea0f766a832e95af1bddc2e727e5509a2e6ed"}
Jul 27 15:11:12.978395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:12.978370    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:13.077588 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:13.077557    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/095b3f5c-899d-4a25-833f-65363e851f67-util\") pod \"095b3f5c-899d-4a25-833f-65363e851f67\" (UID: \"095b3f5c-899d-4a25-833f-65363e851f67\") "
Jul 27 15:11:13.081777 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:13.081749    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/095b3f5c-899d-4a25-833f-65363e851f67-util" (OuterVolumeSpecName: "util") pod "095b3f5c-899d-4a25-833f-65363e851f67" (UID: "095b3f5c-899d-4a25-833f-65363e851f67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:11:13.178243 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:13.178215    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/095b3f5c-899d-4a25-833f-65363e851f67-bundle\") pod \"095b3f5c-899d-4a25-833f-65363e851f67\" (UID: \"095b3f5c-899d-4a25-833f-65363e851f67\") "
Jul 27 15:11:13.178419 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:13.178251    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm9z5\" (UniqueName: \"kubernetes.io/projected/095b3f5c-899d-4a25-833f-65363e851f67-kube-api-access-wm9z5\") pod \"095b3f5c-899d-4a25-833f-65363e851f67\" (UID: \"095b3f5c-899d-4a25-833f-65363e851f67\") "
Jul 27 15:11:13.178511 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:13.178493    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/095b3f5c-899d-4a25-833f-65363e851f67-util\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:11:13.178593 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:13.178571    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/095b3f5c-899d-4a25-833f-65363e851f67-bundle" (OuterVolumeSpecName: "bundle") pod "095b3f5c-899d-4a25-833f-65363e851f67" (UID: "095b3f5c-899d-4a25-833f-65363e851f67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:11:13.180479 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:13.180448    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/095b3f5c-899d-4a25-833f-65363e851f67-kube-api-access-wm9z5" (OuterVolumeSpecName: "kube-api-access-wm9z5") pod "095b3f5c-899d-4a25-833f-65363e851f67" (UID: "095b3f5c-899d-4a25-833f-65363e851f67"). InnerVolumeSpecName "kube-api-access-wm9z5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:11:13.278898 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:13.278866    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/095b3f5c-899d-4a25-833f-65363e851f67-bundle\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:11:13.278898 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:13.278892    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm9z5\" (UniqueName: \"kubernetes.io/projected/095b3f5c-899d-4a25-833f-65363e851f67-kube-api-access-wm9z5\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:11:13.859164 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:13.859128    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t" event={"ID":"095b3f5c-899d-4a25-833f-65363e851f67","Type":"ContainerDied","Data":"2b6930bca1838432ef1d65e969eb56c38eb067ac2329d163e96217da4df3de19"}
Jul 27 15:11:13.859351 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:13.859170    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2t59t"
Jul 27 15:11:13.859351 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:13.859176    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b6930bca1838432ef1d65e969eb56c38eb067ac2329d163e96217da4df3de19"
Jul 27 15:11:16.852413 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:16.852380    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4msqw"
Jul 27 15:11:16.906844 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:16.906813    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k4csj"]
Jul 27 15:11:16.907084 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:16.907071    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="095b3f5c-899d-4a25-833f-65363e851f67" containerName="extract"
Jul 27 15:11:16.907084 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:16.907084    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="095b3f5c-899d-4a25-833f-65363e851f67" containerName="extract"
Jul 27 15:11:16.907198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:16.907103    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="095b3f5c-899d-4a25-833f-65363e851f67" containerName="pull"
Jul 27 15:11:16.907198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:16.907108    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="095b3f5c-899d-4a25-833f-65363e851f67" containerName="pull"
Jul 27 15:11:16.907198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:16.907117    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="095b3f5c-899d-4a25-833f-65363e851f67" containerName="util"
Jul 27 15:11:16.907198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:16.907122    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="095b3f5c-899d-4a25-833f-65363e851f67" containerName="util"
Jul 27 15:11:16.907198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:16.907161    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="095b3f5c-899d-4a25-833f-65363e851f67" containerName="extract"
Jul 27 15:11:16.909153 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:16.909133    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-k4csj"
Jul 27 15:11:16.911558 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:16.911536    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vmcsb\""
Jul 27 15:11:16.925097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:16.925044    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k4csj"]
Jul 27 15:11:17.005714 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:17.005676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cb94523-dff3-4cd1-a978-4a91c533d72d-bound-sa-token\") pod \"cert-manager-55b4d954d5-k4csj\" (UID: \"5cb94523-dff3-4cd1-a978-4a91c533d72d\") " pod="cert-manager/cert-manager-55b4d954d5-k4csj"
Jul 27 15:11:17.005714 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:17.005715    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzb8t\" (UniqueName: \"kubernetes.io/projected/5cb94523-dff3-4cd1-a978-4a91c533d72d-kube-api-access-tzb8t\") pod \"cert-manager-55b4d954d5-k4csj\" (UID: \"5cb94523-dff3-4cd1-a978-4a91c533d72d\") " pod="cert-manager/cert-manager-55b4d954d5-k4csj"
Jul 27 15:11:17.106835 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:17.106748    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cb94523-dff3-4cd1-a978-4a91c533d72d-bound-sa-token\") pod \"cert-manager-55b4d954d5-k4csj\" (UID: \"5cb94523-dff3-4cd1-a978-4a91c533d72d\") " pod="cert-manager/cert-manager-55b4d954d5-k4csj"
Jul 27 15:11:17.106835 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:17.106789    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzb8t\" (UniqueName: \"kubernetes.io/projected/5cb94523-dff3-4cd1-a978-4a91c533d72d-kube-api-access-tzb8t\") pod \"cert-manager-55b4d954d5-k4csj\" (UID: \"5cb94523-dff3-4cd1-a978-4a91c533d72d\") " pod="cert-manager/cert-manager-55b4d954d5-k4csj"
Jul 27 15:11:17.116357 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:17.116307    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cb94523-dff3-4cd1-a978-4a91c533d72d-bound-sa-token\") pod \"cert-manager-55b4d954d5-k4csj\" (UID: \"5cb94523-dff3-4cd1-a978-4a91c533d72d\") " pod="cert-manager/cert-manager-55b4d954d5-k4csj"
Jul 27 15:11:17.116357 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:17.116339    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzb8t\" (UniqueName: \"kubernetes.io/projected/5cb94523-dff3-4cd1-a978-4a91c533d72d-kube-api-access-tzb8t\") pod \"cert-manager-55b4d954d5-k4csj\" (UID: \"5cb94523-dff3-4cd1-a978-4a91c533d72d\") " pod="cert-manager/cert-manager-55b4d954d5-k4csj"
Jul 27 15:11:17.218171 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:17.218136    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-k4csj"
Jul 27 15:11:17.352788 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:17.352761    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k4csj"]
Jul 27 15:11:17.355169 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:11:17.355141    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cb94523_dff3_4cd1_a978_4a91c533d72d.slice/crio-3de6968b14a6e31eaeea67fa34f18c0bbe8a106db6dbb4e4dc89dbec9aadb569 WatchSource:0}: Error finding container 3de6968b14a6e31eaeea67fa34f18c0bbe8a106db6dbb4e4dc89dbec9aadb569: Status 404 returned error can't find the container with id 3de6968b14a6e31eaeea67fa34f18c0bbe8a106db6dbb4e4dc89dbec9aadb569
Jul 27 15:11:17.878943 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:17.878895    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-k4csj" event={"ID":"5cb94523-dff3-4cd1-a978-4a91c533d72d","Type":"ContainerStarted","Data":"92fc574c128524d0a02ca2db0ab46158f107b26aa71630dfbcc7aa60e7053090"}
Jul 27 15:11:17.878943 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:17.878942    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-k4csj" event={"ID":"5cb94523-dff3-4cd1-a978-4a91c533d72d","Type":"ContainerStarted","Data":"3de6968b14a6e31eaeea67fa34f18c0bbe8a106db6dbb4e4dc89dbec9aadb569"}
Jul 27 15:11:17.894543 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:17.894483    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-k4csj" podStartSLOduration=1.89446233 podStartE2EDuration="1.89446233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:11:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:11:17.894068685 +0000 UTC m=+333.758646551" watchObservedRunningTime="2026-07-27 15:11:17.89446233 +0000 UTC m=+333.759040196"
Jul 27 15:11:23.820359 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:23.820308    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5"]
Jul 27 15:11:23.822885 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:23.822869    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5"
Jul 27 15:11:23.825609 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:23.825589    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gm8w7\""
Jul 27 15:11:23.826797 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:23.826780    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 15:11:23.826914 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:23.826888    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:11:23.834392 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:23.834367    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5"]
Jul 27 15:11:23.849110 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:23.849079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm964\" (UniqueName: \"kubernetes.io/projected/d84cfc40-e0c6-4f77-b43a-6050cc277592-kube-api-access-mm964\") pod \"openshift-lws-operator-fd8ccff4c-m4fs5\" (UID: \"d84cfc40-e0c6-4f77-b43a-6050cc277592\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5"
Jul 27 15:11:23.849253 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:23.849117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d84cfc40-e0c6-4f77-b43a-6050cc277592-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m4fs5\" (UID: \"d84cfc40-e0c6-4f77-b43a-6050cc277592\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5"
Jul 27 15:11:23.949694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:23.949655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm964\" (UniqueName: \"kubernetes.io/projected/d84cfc40-e0c6-4f77-b43a-6050cc277592-kube-api-access-mm964\") pod \"openshift-lws-operator-fd8ccff4c-m4fs5\" (UID: \"d84cfc40-e0c6-4f77-b43a-6050cc277592\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5"
Jul 27 15:11:23.949694 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:23.949701    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d84cfc40-e0c6-4f77-b43a-6050cc277592-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m4fs5\" (UID: \"d84cfc40-e0c6-4f77-b43a-6050cc277592\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5"
Jul 27 15:11:23.950127 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:23.950105    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d84cfc40-e0c6-4f77-b43a-6050cc277592-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m4fs5\" (UID: \"d84cfc40-e0c6-4f77-b43a-6050cc277592\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5"
Jul 27 15:11:23.958558 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:23.958533    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm964\" (UniqueName: \"kubernetes.io/projected/d84cfc40-e0c6-4f77-b43a-6050cc277592-kube-api-access-mm964\") pod \"openshift-lws-operator-fd8ccff4c-m4fs5\" (UID: \"d84cfc40-e0c6-4f77-b43a-6050cc277592\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5"
Jul 27 15:11:24.132117 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:24.132022    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5"
Jul 27 15:11:24.292560 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:24.292440    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5"]
Jul 27 15:11:24.294639 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:11:24.294592    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd84cfc40_e0c6_4f77_b43a_6050cc277592.slice/crio-b25dfba2a1acec7c0e480c1a02409ddbaaf2eaf084f491ad162697dc24ce3e9c WatchSource:0}: Error finding container b25dfba2a1acec7c0e480c1a02409ddbaaf2eaf084f491ad162697dc24ce3e9c: Status 404 returned error can't find the container with id b25dfba2a1acec7c0e480c1a02409ddbaaf2eaf084f491ad162697dc24ce3e9c
Jul 27 15:11:24.910007 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:24.909973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5" event={"ID":"d84cfc40-e0c6-4f77-b43a-6050cc277592","Type":"ContainerStarted","Data":"b25dfba2a1acec7c0e480c1a02409ddbaaf2eaf084f491ad162697dc24ce3e9c"}
Jul 27 15:11:26.920537 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:26.920496    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5" event={"ID":"d84cfc40-e0c6-4f77-b43a-6050cc277592","Type":"ContainerStarted","Data":"ee3c3db09e6f0b8cd4f529ebfbe48e7d489d879973a519db8d27838a225f6e75"}
Jul 27 15:11:26.938714 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:26.938649    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fs5" podStartSLOduration=2.065599089 podStartE2EDuration="3.938629428s" totalImagesPullingTime="1.873030339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:11:26.938204646 +0000 UTC m=+342.802782513" watchObservedRunningTime="2026-07-27 15:11:26.938629428 +0000 UTC m=+342.803207295"
Jul 27 15:11:31.717772 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.717735    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"]
Jul 27 15:11:31.720507 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.720486    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:31.723430 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.723410    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gbs8s\""
Jul 27 15:11:31.723551 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.723410    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 15:11:31.723551 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.723412    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 15:11:31.731077 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.731053    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"]
Jul 27 15:11:31.809755 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.809718    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87b1b530-937e-4edc-8cf8-58f87f969c4e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g\" (UID: \"87b1b530-937e-4edc-8cf8-58f87f969c4e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:31.809918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.809774    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns5m4\" (UniqueName: \"kubernetes.io/projected/87b1b530-937e-4edc-8cf8-58f87f969c4e-kube-api-access-ns5m4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g\" (UID: \"87b1b530-937e-4edc-8cf8-58f87f969c4e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:31.809918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.809839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87b1b530-937e-4edc-8cf8-58f87f969c4e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g\" (UID: \"87b1b530-937e-4edc-8cf8-58f87f969c4e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:31.911113 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.911077    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87b1b530-937e-4edc-8cf8-58f87f969c4e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g\" (UID: \"87b1b530-937e-4edc-8cf8-58f87f969c4e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:31.911302 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.911127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87b1b530-937e-4edc-8cf8-58f87f969c4e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g\" (UID: \"87b1b530-937e-4edc-8cf8-58f87f969c4e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:31.911302 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.911173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns5m4\" (UniqueName: \"kubernetes.io/projected/87b1b530-937e-4edc-8cf8-58f87f969c4e-kube-api-access-ns5m4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g\" (UID: \"87b1b530-937e-4edc-8cf8-58f87f969c4e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:31.911529 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.911506    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87b1b530-937e-4edc-8cf8-58f87f969c4e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g\" (UID: \"87b1b530-937e-4edc-8cf8-58f87f969c4e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:31.911529 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.911511    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87b1b530-937e-4edc-8cf8-58f87f969c4e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g\" (UID: \"87b1b530-937e-4edc-8cf8-58f87f969c4e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:31.922175 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:31.922146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns5m4\" (UniqueName: \"kubernetes.io/projected/87b1b530-937e-4edc-8cf8-58f87f969c4e-kube-api-access-ns5m4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g\" (UID: \"87b1b530-937e-4edc-8cf8-58f87f969c4e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:32.029218 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:32.029148    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:32.159613 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:32.159590    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"]
Jul 27 15:11:32.161996 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:11:32.161967    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b1b530_937e_4edc_8cf8_58f87f969c4e.slice/crio-b7dedf81c3348c6a8971074f9acf12629c8343fba9ec204fab1631b4c06e4221 WatchSource:0}: Error finding container b7dedf81c3348c6a8971074f9acf12629c8343fba9ec204fab1631b4c06e4221: Status 404 returned error can't find the container with id b7dedf81c3348c6a8971074f9acf12629c8343fba9ec204fab1631b4c06e4221
Jul 27 15:11:32.946118 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:32.946082    2559 generic.go:356] "Generic (PLEG): container finished" podID="87b1b530-937e-4edc-8cf8-58f87f969c4e" containerID="54e59b5720dcc01e38930c8a553a4274bf2011b4922d27d61be3d132ae4444c0" exitCode=0
Jul 27 15:11:32.946536 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:32.946126    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g" event={"ID":"87b1b530-937e-4edc-8cf8-58f87f969c4e","Type":"ContainerDied","Data":"54e59b5720dcc01e38930c8a553a4274bf2011b4922d27d61be3d132ae4444c0"}
Jul 27 15:11:32.946536 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:32.946170    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g" event={"ID":"87b1b530-937e-4edc-8cf8-58f87f969c4e","Type":"ContainerStarted","Data":"b7dedf81c3348c6a8971074f9acf12629c8343fba9ec204fab1631b4c06e4221"}
Jul 27 15:11:33.952516 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:33.952463    2559 generic.go:356] "Generic (PLEG): container finished" podID="87b1b530-937e-4edc-8cf8-58f87f969c4e" containerID="eba0771a9e320b7986bbee05c8fdc62991179b551aea3070a0001793d48226f9" exitCode=0
Jul 27 15:11:33.952882 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:33.952515    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g" event={"ID":"87b1b530-937e-4edc-8cf8-58f87f969c4e","Type":"ContainerDied","Data":"eba0771a9e320b7986bbee05c8fdc62991179b551aea3070a0001793d48226f9"}
Jul 27 15:11:34.958009 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:34.957929    2559 generic.go:356] "Generic (PLEG): container finished" podID="87b1b530-937e-4edc-8cf8-58f87f969c4e" containerID="74d41fef091aea914f6859076d0670848969ea5e0fa6b985e813707b3e6324dd" exitCode=0
Jul 27 15:11:34.958009 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:34.957989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g" event={"ID":"87b1b530-937e-4edc-8cf8-58f87f969c4e","Type":"ContainerDied","Data":"74d41fef091aea914f6859076d0670848969ea5e0fa6b985e813707b3e6324dd"}
Jul 27 15:11:36.083496 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.083471    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:36.146825 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.146801    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87b1b530-937e-4edc-8cf8-58f87f969c4e-util\") pod \"87b1b530-937e-4edc-8cf8-58f87f969c4e\" (UID: \"87b1b530-937e-4edc-8cf8-58f87f969c4e\") "
Jul 27 15:11:36.146918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.146851    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87b1b530-937e-4edc-8cf8-58f87f969c4e-bundle\") pod \"87b1b530-937e-4edc-8cf8-58f87f969c4e\" (UID: \"87b1b530-937e-4edc-8cf8-58f87f969c4e\") "
Jul 27 15:11:36.146918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.146878    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns5m4\" (UniqueName: \"kubernetes.io/projected/87b1b530-937e-4edc-8cf8-58f87f969c4e-kube-api-access-ns5m4\") pod \"87b1b530-937e-4edc-8cf8-58f87f969c4e\" (UID: \"87b1b530-937e-4edc-8cf8-58f87f969c4e\") "
Jul 27 15:11:36.147705 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.147671    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87b1b530-937e-4edc-8cf8-58f87f969c4e-bundle" (OuterVolumeSpecName: "bundle") pod "87b1b530-937e-4edc-8cf8-58f87f969c4e" (UID: "87b1b530-937e-4edc-8cf8-58f87f969c4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:11:36.148959 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.148937    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87b1b530-937e-4edc-8cf8-58f87f969c4e-kube-api-access-ns5m4" (OuterVolumeSpecName: "kube-api-access-ns5m4") pod "87b1b530-937e-4edc-8cf8-58f87f969c4e" (UID: "87b1b530-937e-4edc-8cf8-58f87f969c4e"). InnerVolumeSpecName "kube-api-access-ns5m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:11:36.152821 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.152801    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87b1b530-937e-4edc-8cf8-58f87f969c4e-util" (OuterVolumeSpecName: "util") pod "87b1b530-937e-4edc-8cf8-58f87f969c4e" (UID: "87b1b530-937e-4edc-8cf8-58f87f969c4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:11:36.247453 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.247407    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87b1b530-937e-4edc-8cf8-58f87f969c4e-util\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:11:36.247453 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.247427    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87b1b530-937e-4edc-8cf8-58f87f969c4e-bundle\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:11:36.247453 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.247439    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns5m4\" (UniqueName: \"kubernetes.io/projected/87b1b530-937e-4edc-8cf8-58f87f969c4e-kube-api-access-ns5m4\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:11:36.967482 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.967428    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g" event={"ID":"87b1b530-937e-4edc-8cf8-58f87f969c4e","Type":"ContainerDied","Data":"b7dedf81c3348c6a8971074f9acf12629c8343fba9ec204fab1631b4c06e4221"}
Jul 27 15:11:36.967482 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.967449    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzg6g"
Jul 27 15:11:36.967482 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:36.967471    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7dedf81c3348c6a8971074f9acf12629c8343fba9ec204fab1631b4c06e4221"
Jul 27 15:11:44.909699 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.909673    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"]
Jul 27 15:11:44.910134 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.909940    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87b1b530-937e-4edc-8cf8-58f87f969c4e" containerName="pull"
Jul 27 15:11:44.910134 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.909950    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="87b1b530-937e-4edc-8cf8-58f87f969c4e" containerName="pull"
Jul 27 15:11:44.910134 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.909970    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87b1b530-937e-4edc-8cf8-58f87f969c4e" containerName="extract"
Jul 27 15:11:44.910134 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.909975    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="87b1b530-937e-4edc-8cf8-58f87f969c4e" containerName="extract"
Jul 27 15:11:44.910134 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.909982    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87b1b530-937e-4edc-8cf8-58f87f969c4e" containerName="util"
Jul 27 15:11:44.910134 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.909987    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="87b1b530-937e-4edc-8cf8-58f87f969c4e" containerName="util"
Jul 27 15:11:44.910134 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.910026    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="87b1b530-937e-4edc-8cf8-58f87f969c4e" containerName="extract"
Jul 27 15:11:44.914504 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.914468    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:44.917531 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.917508    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 15:11:44.917653 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.917535    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-srgx6\""
Jul 27 15:11:44.917653 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.917635    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 15:11:44.917801 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.917745    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 15:11:44.918199 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.918186    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 15:11:44.935755 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:44.935730    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"]
Jul 27 15:11:45.008580 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.008532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g42pj\" (UniqueName: \"kubernetes.io/projected/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-kube-api-access-g42pj\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.008715 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.008593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-webhook-cert\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.008715 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.008647    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-manifests\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.008715 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.008684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-tmp\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.008715 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.008705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.109531 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.109490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g42pj\" (UniqueName: \"kubernetes.io/projected/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-kube-api-access-g42pj\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.109688 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.109561    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-webhook-cert\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.109688 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.109602    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-manifests\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.109688 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.109631    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-tmp\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.109688 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.109655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.110262 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.110238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-manifests\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.112249 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.112230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-tmp\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.112725 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.112697    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.113094 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.113072    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-webhook-cert\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.118291 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.118271    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g42pj\" (UniqueName: \"kubernetes.io/projected/2e6d87b4-3c2a-4af6-a2b7-27791fe55dad-kube-api-access-g42pj\") pod \"opendatahub-operator-controller-manager-78959f89bb-n8pwg\" (UID: \"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad\") " pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.224897 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.224875    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:45.366569 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:45.366547    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"]
Jul 27 15:11:45.368857 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:11:45.368831    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6d87b4_3c2a_4af6_a2b7_27791fe55dad.slice/crio-b3d210060adf38237898a17326e1a6521f4673a9f8891291109d6b14c4807eef WatchSource:0}: Error finding container b3d210060adf38237898a17326e1a6521f4673a9f8891291109d6b14c4807eef: Status 404 returned error can't find the container with id b3d210060adf38237898a17326e1a6521f4673a9f8891291109d6b14c4807eef
Jul 27 15:11:46.008623 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:46.008587    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg" event={"ID":"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad","Type":"ContainerStarted","Data":"b3d210060adf38237898a17326e1a6521f4673a9f8891291109d6b14c4807eef"}
Jul 27 15:11:49.024177 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:49.024140    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg" event={"ID":"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad","Type":"ContainerStarted","Data":"8178bbed2f74381c176ccae5bb09ea6a02472c5a90bb6a08d229c6d0630a1f6e"}
Jul 27 15:11:50.029273 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:50.029242    2559 generic.go:356] "Generic (PLEG): container finished" podID="2e6d87b4-3c2a-4af6-a2b7-27791fe55dad" containerID="8178bbed2f74381c176ccae5bb09ea6a02472c5a90bb6a08d229c6d0630a1f6e" exitCode=0
Jul 27 15:11:50.029605 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:50.029326    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg" event={"ID":"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad","Type":"ContainerDied","Data":"8178bbed2f74381c176ccae5bb09ea6a02472c5a90bb6a08d229c6d0630a1f6e"}
Jul 27 15:11:54.046750 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:54.046709    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg" event={"ID":"2e6d87b4-3c2a-4af6-a2b7-27791fe55dad","Type":"ContainerStarted","Data":"208ba23080b818cd71846128d467e17101062e764e9a790a0a76eaed62c6378b"}
Jul 27 15:11:54.047197 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:54.046854    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:11:54.072572 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:11:54.072522    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg" podStartSLOduration=2.743028017 podStartE2EDuration="10.07250711s" totalImagesPullingTime="6.278275858s" totalInitContainerRuntime="1.051203235s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:11:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:11:54.070014739 +0000 UTC m=+369.934592617" watchObservedRunningTime="2026-07-27 15:11:54.07250711 +0000 UTC m=+369.937084975"
Jul 27 15:12:05.053420 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:05.053390    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78959f89bb-n8pwg"
Jul 27 15:12:07.457004 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:07.456971    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nfljj"]
Jul 27 15:12:07.460167 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:07.460148    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nfljj"
Jul 27 15:12:07.463688 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:07.463667    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 15:12:07.463784 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:07.463740    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nwjd9\""
Jul 27 15:12:07.477378 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:07.477353    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nfljj"]
Jul 27 15:12:07.596362 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:07.596302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90530c29-62ea-4188-914d-460ee03ec048-cert\") pod \"odh-model-controller-7998c67dc4-nfljj\" (UID: \"90530c29-62ea-4188-914d-460ee03ec048\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfljj"
Jul 27 15:12:07.596547 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:07.596425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q2qk\" (UniqueName: \"kubernetes.io/projected/90530c29-62ea-4188-914d-460ee03ec048-kube-api-access-5q2qk\") pod \"odh-model-controller-7998c67dc4-nfljj\" (UID: \"90530c29-62ea-4188-914d-460ee03ec048\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfljj"
Jul 27 15:12:07.697030 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:07.696993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90530c29-62ea-4188-914d-460ee03ec048-cert\") pod \"odh-model-controller-7998c67dc4-nfljj\" (UID: \"90530c29-62ea-4188-914d-460ee03ec048\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfljj"
Jul 27 15:12:07.697219 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:07.697047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q2qk\" (UniqueName: \"kubernetes.io/projected/90530c29-62ea-4188-914d-460ee03ec048-kube-api-access-5q2qk\") pod \"odh-model-controller-7998c67dc4-nfljj\" (UID: \"90530c29-62ea-4188-914d-460ee03ec048\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfljj"
Jul 27 15:12:07.697219 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:12:07.697155    2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 27 15:12:07.697363 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:12:07.697239    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90530c29-62ea-4188-914d-460ee03ec048-cert podName:90530c29-62ea-4188-914d-460ee03ec048 nodeName:}" failed. No retries permitted until 2026-07-27 15:12:08.197222301 +0000 UTC m=+384.061800145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/90530c29-62ea-4188-914d-460ee03ec048-cert") pod "odh-model-controller-7998c67dc4-nfljj" (UID: "90530c29-62ea-4188-914d-460ee03ec048") : secret "odh-model-controller-webhook-cert" not found
Jul 27 15:12:07.712220 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:07.712150    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q2qk\" (UniqueName: \"kubernetes.io/projected/90530c29-62ea-4188-914d-460ee03ec048-kube-api-access-5q2qk\") pod \"odh-model-controller-7998c67dc4-nfljj\" (UID: \"90530c29-62ea-4188-914d-460ee03ec048\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfljj"
Jul 27 15:12:08.200553 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:08.200510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90530c29-62ea-4188-914d-460ee03ec048-cert\") pod \"odh-model-controller-7998c67dc4-nfljj\" (UID: \"90530c29-62ea-4188-914d-460ee03ec048\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfljj"
Jul 27 15:12:08.203210 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:08.203177    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90530c29-62ea-4188-914d-460ee03ec048-cert\") pod \"odh-model-controller-7998c67dc4-nfljj\" (UID: \"90530c29-62ea-4188-914d-460ee03ec048\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfljj"
Jul 27 15:12:08.369512 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:08.369470    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nfljj"
Jul 27 15:12:08.499782 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:08.499759    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nfljj"]
Jul 27 15:12:08.502286 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:12:08.502259    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90530c29_62ea_4188_914d_460ee03ec048.slice/crio-020fd53c23205ba1253e83e15164be69326844718091b14c86fb02d0ffb7bd47 WatchSource:0}: Error finding container 020fd53c23205ba1253e83e15164be69326844718091b14c86fb02d0ffb7bd47: Status 404 returned error can't find the container with id 020fd53c23205ba1253e83e15164be69326844718091b14c86fb02d0ffb7bd47
Jul 27 15:12:09.114897 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:09.114796    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nfljj" event={"ID":"90530c29-62ea-4188-914d-460ee03ec048","Type":"ContainerStarted","Data":"020fd53c23205ba1253e83e15164be69326844718091b14c86fb02d0ffb7bd47"}
Jul 27 15:12:12.129924 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.129887    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nfljj" event={"ID":"90530c29-62ea-4188-914d-460ee03ec048","Type":"ContainerStarted","Data":"ddcbf58b32b42f6452837f290b70a188d5b71c7e99b0b35230182f9e9bb91e0d"}
Jul 27 15:12:12.130287 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.130003    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-nfljj"
Jul 27 15:12:12.147667 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.147620    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-nfljj" podStartSLOduration=2.284301957 podStartE2EDuration="5.147606073s" totalImagesPullingTime="2.863304116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:12:12.145665074 +0000 UTC m=+388.010242941" watchObservedRunningTime="2026-07-27 15:12:12.147606073 +0000 UTC m=+388.012183935"
Jul 27 15:12:12.657563 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.657518    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"]
Jul 27 15:12:12.661088 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.661064    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"
Jul 27 15:12:12.663877 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.663845    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 15:12:12.663877 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.663851    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 15:12:12.664041 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.663889    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 15:12:12.664041 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.663907    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 15:12:12.664041 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.663857    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c828q\""
Jul 27 15:12:12.675606 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.675585    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"]
Jul 27 15:12:12.741887 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.741860    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6953c343-722a-4992-af21-708553023e89-tmp\") pod \"kube-auth-proxy-cd65dd67b-vrwf2\" (UID: \"6953c343-722a-4992-af21-708553023e89\") " pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"
Jul 27 15:12:12.742036 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.741896    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6953c343-722a-4992-af21-708553023e89-tls-certs\") pod \"kube-auth-proxy-cd65dd67b-vrwf2\" (UID: \"6953c343-722a-4992-af21-708553023e89\") " pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"
Jul 27 15:12:12.742036 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.741923    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t8lb\" (UniqueName: \"kubernetes.io/projected/6953c343-722a-4992-af21-708553023e89-kube-api-access-4t8lb\") pod \"kube-auth-proxy-cd65dd67b-vrwf2\" (UID: \"6953c343-722a-4992-af21-708553023e89\") " pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"
Jul 27 15:12:12.843183 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.843151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6953c343-722a-4992-af21-708553023e89-tmp\") pod \"kube-auth-proxy-cd65dd67b-vrwf2\" (UID: \"6953c343-722a-4992-af21-708553023e89\") " pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"
Jul 27 15:12:12.843311 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.843191    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6953c343-722a-4992-af21-708553023e89-tls-certs\") pod \"kube-auth-proxy-cd65dd67b-vrwf2\" (UID: \"6953c343-722a-4992-af21-708553023e89\") " pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"
Jul 27 15:12:12.843311 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.843210    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t8lb\" (UniqueName: \"kubernetes.io/projected/6953c343-722a-4992-af21-708553023e89-kube-api-access-4t8lb\") pod \"kube-auth-proxy-cd65dd67b-vrwf2\" (UID: \"6953c343-722a-4992-af21-708553023e89\") " pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"
Jul 27 15:12:12.845384 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.845363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6953c343-722a-4992-af21-708553023e89-tmp\") pod \"kube-auth-proxy-cd65dd67b-vrwf2\" (UID: \"6953c343-722a-4992-af21-708553023e89\") " pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"
Jul 27 15:12:12.845634 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.845616    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6953c343-722a-4992-af21-708553023e89-tls-certs\") pod \"kube-auth-proxy-cd65dd67b-vrwf2\" (UID: \"6953c343-722a-4992-af21-708553023e89\") " pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"
Jul 27 15:12:12.852735 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.852714    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t8lb\" (UniqueName: \"kubernetes.io/projected/6953c343-722a-4992-af21-708553023e89-kube-api-access-4t8lb\") pod \"kube-auth-proxy-cd65dd67b-vrwf2\" (UID: \"6953c343-722a-4992-af21-708553023e89\") " pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"
Jul 27 15:12:12.971111 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:12.971086    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"
Jul 27 15:12:13.111473 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:13.111450    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2"]
Jul 27 15:12:13.113269 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:12:13.113239    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6953c343_722a_4992_af21_708553023e89.slice/crio-ec1068d8942c131656850add6eee991b481a82402aa31204faf4d9c747ee3ba5 WatchSource:0}: Error finding container ec1068d8942c131656850add6eee991b481a82402aa31204faf4d9c747ee3ba5: Status 404 returned error can't find the container with id ec1068d8942c131656850add6eee991b481a82402aa31204faf4d9c747ee3ba5
Jul 27 15:12:13.135551 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:13.135513    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2" event={"ID":"6953c343-722a-4992-af21-708553023e89","Type":"ContainerStarted","Data":"ec1068d8942c131656850add6eee991b481a82402aa31204faf4d9c747ee3ba5"}
Jul 27 15:12:14.635268 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.635228    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"]
Jul 27 15:12:14.638814 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.638792    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.642998 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.642972    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xgplx\""
Jul 27 15:12:14.643107 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.643023    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 15:12:14.643670 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.643649    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 15:12:14.647304 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.647271    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 15:12:14.661680 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.661593    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"]
Jul 27 15:12:14.757659 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.757626    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b396b6ba-1d71-42a8-a974-fb1abcc7a571-cert\") pod \"lws-controller-manager-964ddd7d8-zvhlt\" (UID: \"b396b6ba-1d71-42a8-a974-fb1abcc7a571\") " pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.757835 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.757666    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b396b6ba-1d71-42a8-a974-fb1abcc7a571-manager-config\") pod \"lws-controller-manager-964ddd7d8-zvhlt\" (UID: \"b396b6ba-1d71-42a8-a974-fb1abcc7a571\") " pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.757835 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.757689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tsl6\" (UniqueName: \"kubernetes.io/projected/b396b6ba-1d71-42a8-a974-fb1abcc7a571-kube-api-access-7tsl6\") pod \"lws-controller-manager-964ddd7d8-zvhlt\" (UID: \"b396b6ba-1d71-42a8-a974-fb1abcc7a571\") " pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.757835 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.757784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b396b6ba-1d71-42a8-a974-fb1abcc7a571-metrics-cert\") pod \"lws-controller-manager-964ddd7d8-zvhlt\" (UID: \"b396b6ba-1d71-42a8-a974-fb1abcc7a571\") " pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.858721 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.858688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b396b6ba-1d71-42a8-a974-fb1abcc7a571-metrics-cert\") pod \"lws-controller-manager-964ddd7d8-zvhlt\" (UID: \"b396b6ba-1d71-42a8-a974-fb1abcc7a571\") " pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.858865 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.858765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b396b6ba-1d71-42a8-a974-fb1abcc7a571-cert\") pod \"lws-controller-manager-964ddd7d8-zvhlt\" (UID: \"b396b6ba-1d71-42a8-a974-fb1abcc7a571\") " pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.858865 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.858790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b396b6ba-1d71-42a8-a974-fb1abcc7a571-manager-config\") pod \"lws-controller-manager-964ddd7d8-zvhlt\" (UID: \"b396b6ba-1d71-42a8-a974-fb1abcc7a571\") " pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.858865 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.858810    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsl6\" (UniqueName: \"kubernetes.io/projected/b396b6ba-1d71-42a8-a974-fb1abcc7a571-kube-api-access-7tsl6\") pod \"lws-controller-manager-964ddd7d8-zvhlt\" (UID: \"b396b6ba-1d71-42a8-a974-fb1abcc7a571\") " pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.859583 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.859513    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b396b6ba-1d71-42a8-a974-fb1abcc7a571-manager-config\") pod \"lws-controller-manager-964ddd7d8-zvhlt\" (UID: \"b396b6ba-1d71-42a8-a974-fb1abcc7a571\") " pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.861138 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.861115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b396b6ba-1d71-42a8-a974-fb1abcc7a571-metrics-cert\") pod \"lws-controller-manager-964ddd7d8-zvhlt\" (UID: \"b396b6ba-1d71-42a8-a974-fb1abcc7a571\") " pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.861233 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.861219    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b396b6ba-1d71-42a8-a974-fb1abcc7a571-cert\") pod \"lws-controller-manager-964ddd7d8-zvhlt\" (UID: \"b396b6ba-1d71-42a8-a974-fb1abcc7a571\") " pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.868602 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.868581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tsl6\" (UniqueName: \"kubernetes.io/projected/b396b6ba-1d71-42a8-a974-fb1abcc7a571-kube-api-access-7tsl6\") pod \"lws-controller-manager-964ddd7d8-zvhlt\" (UID: \"b396b6ba-1d71-42a8-a974-fb1abcc7a571\") " pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:14.950551 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:14.950503    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:15.094689 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:15.093542    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"]
Jul 27 15:12:15.756270 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:12:15.756227    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb396b6ba_1d71_42a8_a974_fb1abcc7a571.slice/crio-8efde38b7c6859625d487f1fb1ad6edd56294aff5ae3a76a2527a685280f50f1 WatchSource:0}: Error finding container 8efde38b7c6859625d487f1fb1ad6edd56294aff5ae3a76a2527a685280f50f1: Status 404 returned error can't find the container with id 8efde38b7c6859625d487f1fb1ad6edd56294aff5ae3a76a2527a685280f50f1
Jul 27 15:12:16.155699 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:16.155601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2" event={"ID":"6953c343-722a-4992-af21-708553023e89","Type":"ContainerStarted","Data":"f249daddf6a0bac88ff60581d3bad8a472303103c25084ad5c220208cae49d48"}
Jul 27 15:12:16.156778 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:16.156754    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt" event={"ID":"b396b6ba-1d71-42a8-a974-fb1abcc7a571","Type":"ContainerStarted","Data":"8efde38b7c6859625d487f1fb1ad6edd56294aff5ae3a76a2527a685280f50f1"}
Jul 27 15:12:16.178764 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:16.178719    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2" podStartSLOduration=1.489002829 podStartE2EDuration="4.17870379s" totalImagesPullingTime="2.689700961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:12:16.178040705 +0000 UTC m=+392.042618571" watchObservedRunningTime="2026-07-27 15:12:16.17870379 +0000 UTC m=+392.043281655"
Jul 27 15:12:18.168412 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:18.168364    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt" event={"ID":"b396b6ba-1d71-42a8-a974-fb1abcc7a571","Type":"ContainerStarted","Data":"db5d2c4cbf4b0be51ea1f7d40ccc2ff831667476171518b3443461ab7bdc4e6c"}
Jul 27 15:12:18.168832 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:18.168531    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:12:23.138446 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:23.138411    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-nfljj"
Jul 27 15:12:23.156991 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:23.156946    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt" podStartSLOduration=7.785318123 podStartE2EDuration="9.156930655s" totalImagesPullingTime="1.371612532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:12:18.193961563 +0000 UTC m=+394.058539431" watchObservedRunningTime="2026-07-27 15:12:23.156930655 +0000 UTC m=+399.021508520"
Jul 27 15:12:29.174724 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:12:29.174698    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-964ddd7d8-zvhlt"
Jul 27 15:13:24.077586 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.077515    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"]
Jul 27 15:13:24.080010 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.079994    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:24.082937 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.082916    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nxml9\""
Jul 27 15:13:24.082937 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.082919    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 15:13:24.084414 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.084394    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 15:13:24.091570 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.091550    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"]
Jul 27 15:13:24.136437 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.136415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8876577d-480b-4999-bbfa-1f7bddc7baff-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m\" (UID: \"8876577d-480b-4999-bbfa-1f7bddc7baff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:24.136548 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.136486    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8876577d-480b-4999-bbfa-1f7bddc7baff-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m\" (UID: \"8876577d-480b-4999-bbfa-1f7bddc7baff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:24.136548 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.136540    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhqv2\" (UniqueName: \"kubernetes.io/projected/8876577d-480b-4999-bbfa-1f7bddc7baff-kube-api-access-xhqv2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m\" (UID: \"8876577d-480b-4999-bbfa-1f7bddc7baff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:24.237680 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.237657    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8876577d-480b-4999-bbfa-1f7bddc7baff-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m\" (UID: \"8876577d-480b-4999-bbfa-1f7bddc7baff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:24.237764 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.237702    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8876577d-480b-4999-bbfa-1f7bddc7baff-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m\" (UID: \"8876577d-480b-4999-bbfa-1f7bddc7baff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:24.237764 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.237725    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhqv2\" (UniqueName: \"kubernetes.io/projected/8876577d-480b-4999-bbfa-1f7bddc7baff-kube-api-access-xhqv2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m\" (UID: \"8876577d-480b-4999-bbfa-1f7bddc7baff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:24.237974 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.237957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8876577d-480b-4999-bbfa-1f7bddc7baff-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m\" (UID: \"8876577d-480b-4999-bbfa-1f7bddc7baff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:24.238040 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.238015    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8876577d-480b-4999-bbfa-1f7bddc7baff-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m\" (UID: \"8876577d-480b-4999-bbfa-1f7bddc7baff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:24.246686 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.246666    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhqv2\" (UniqueName: \"kubernetes.io/projected/8876577d-480b-4999-bbfa-1f7bddc7baff-kube-api-access-xhqv2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m\" (UID: \"8876577d-480b-4999-bbfa-1f7bddc7baff\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:24.389278 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.389223    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:24.512736 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.512715    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"]
Jul 27 15:13:24.514780 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:13:24.514751    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8876577d_480b_4999_bbfa_1f7bddc7baff.slice/crio-4c9f86d8c9644d0e3925bff7314d019321f33322a333a3181d0157bd71159ff5 WatchSource:0}: Error finding container 4c9f86d8c9644d0e3925bff7314d019321f33322a333a3181d0157bd71159ff5: Status 404 returned error can't find the container with id 4c9f86d8c9644d0e3925bff7314d019321f33322a333a3181d0157bd71159ff5
Jul 27 15:13:24.676683 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.676654    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"]
Jul 27 15:13:24.678937 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.678923    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:24.689032 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.689014    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"]
Jul 27 15:13:24.741124 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.741099    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05704ac7-28bd-4315-9984-6d165c1c67cd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm\" (UID: \"05704ac7-28bd-4315-9984-6d165c1c67cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:24.741229 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.741138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05704ac7-28bd-4315-9984-6d165c1c67cd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm\" (UID: \"05704ac7-28bd-4315-9984-6d165c1c67cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:24.741229 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.741185    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtg9f\" (UniqueName: \"kubernetes.io/projected/05704ac7-28bd-4315-9984-6d165c1c67cd-kube-api-access-mtg9f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm\" (UID: \"05704ac7-28bd-4315-9984-6d165c1c67cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:24.841670 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.841649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtg9f\" (UniqueName: \"kubernetes.io/projected/05704ac7-28bd-4315-9984-6d165c1c67cd-kube-api-access-mtg9f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm\" (UID: \"05704ac7-28bd-4315-9984-6d165c1c67cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:24.841758 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.841686    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05704ac7-28bd-4315-9984-6d165c1c67cd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm\" (UID: \"05704ac7-28bd-4315-9984-6d165c1c67cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:24.841758 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.841714    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05704ac7-28bd-4315-9984-6d165c1c67cd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm\" (UID: \"05704ac7-28bd-4315-9984-6d165c1c67cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:24.841972 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.841955    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05704ac7-28bd-4315-9984-6d165c1c67cd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm\" (UID: \"05704ac7-28bd-4315-9984-6d165c1c67cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:24.842076 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.842059    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05704ac7-28bd-4315-9984-6d165c1c67cd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm\" (UID: \"05704ac7-28bd-4315-9984-6d165c1c67cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:24.853102 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.853086    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtg9f\" (UniqueName: \"kubernetes.io/projected/05704ac7-28bd-4315-9984-6d165c1c67cd-kube-api-access-mtg9f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm\" (UID: \"05704ac7-28bd-4315-9984-6d165c1c67cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:24.989307 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:24.989262    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:25.112887 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.112857    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"]
Jul 27 15:13:25.114913 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:13:25.114890    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05704ac7_28bd_4315_9984_6d165c1c67cd.slice/crio-2f83dbda96e00f8e71203a8eedaaaa649dbb8eb42c39e7ce09a2a65e7f662bfe WatchSource:0}: Error finding container 2f83dbda96e00f8e71203a8eedaaaa649dbb8eb42c39e7ce09a2a65e7f662bfe: Status 404 returned error can't find the container with id 2f83dbda96e00f8e71203a8eedaaaa649dbb8eb42c39e7ce09a2a65e7f662bfe
Jul 27 15:13:25.270282 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.270253    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"]
Jul 27 15:13:25.272528 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.272514    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:25.281376 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.281356    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"]
Jul 27 15:13:25.345483 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.345462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a328329-e154-45e7-aef2-662926164df3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn\" (UID: \"4a328329-e154-45e7-aef2-662926164df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:25.345573 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.345487    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnb5q\" (UniqueName: \"kubernetes.io/projected/4a328329-e154-45e7-aef2-662926164df3-kube-api-access-hnb5q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn\" (UID: \"4a328329-e154-45e7-aef2-662926164df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:25.345573 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.345530    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a328329-e154-45e7-aef2-662926164df3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn\" (UID: \"4a328329-e154-45e7-aef2-662926164df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:25.445848 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.445825    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a328329-e154-45e7-aef2-662926164df3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn\" (UID: \"4a328329-e154-45e7-aef2-662926164df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:25.445935 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.445862    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnb5q\" (UniqueName: \"kubernetes.io/projected/4a328329-e154-45e7-aef2-662926164df3-kube-api-access-hnb5q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn\" (UID: \"4a328329-e154-45e7-aef2-662926164df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:25.445978 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.445939    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a328329-e154-45e7-aef2-662926164df3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn\" (UID: \"4a328329-e154-45e7-aef2-662926164df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:25.446216 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.446187    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a328329-e154-45e7-aef2-662926164df3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn\" (UID: \"4a328329-e154-45e7-aef2-662926164df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:25.446271 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.446221    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a328329-e154-45e7-aef2-662926164df3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn\" (UID: \"4a328329-e154-45e7-aef2-662926164df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:25.446900 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.446871    2559 generic.go:356] "Generic (PLEG): container finished" podID="8876577d-480b-4999-bbfa-1f7bddc7baff" containerID="dc68e418aee5291441a977c0d2ed0a95fc4f5b2bf96be3b789ff70e10b287d9a" exitCode=0
Jul 27 15:13:25.446980 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.446958    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m" event={"ID":"8876577d-480b-4999-bbfa-1f7bddc7baff","Type":"ContainerDied","Data":"dc68e418aee5291441a977c0d2ed0a95fc4f5b2bf96be3b789ff70e10b287d9a"}
Jul 27 15:13:25.447024 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.446994    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m" event={"ID":"8876577d-480b-4999-bbfa-1f7bddc7baff","Type":"ContainerStarted","Data":"4c9f86d8c9644d0e3925bff7314d019321f33322a333a3181d0157bd71159ff5"}
Jul 27 15:13:25.448594 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.448576    2559 generic.go:356] "Generic (PLEG): container finished" podID="05704ac7-28bd-4315-9984-6d165c1c67cd" containerID="b7285acb214f10a4a9e0563944acc91fff835d39f1b310c33a8bff345089b03b" exitCode=0
Jul 27 15:13:25.448666 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.448600    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm" event={"ID":"05704ac7-28bd-4315-9984-6d165c1c67cd","Type":"ContainerDied","Data":"b7285acb214f10a4a9e0563944acc91fff835d39f1b310c33a8bff345089b03b"}
Jul 27 15:13:25.448666 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.448637    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm" event={"ID":"05704ac7-28bd-4315-9984-6d165c1c67cd","Type":"ContainerStarted","Data":"2f83dbda96e00f8e71203a8eedaaaa649dbb8eb42c39e7ce09a2a65e7f662bfe"}
Jul 27 15:13:25.454918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.454898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnb5q\" (UniqueName: \"kubernetes.io/projected/4a328329-e154-45e7-aef2-662926164df3-kube-api-access-hnb5q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn\" (UID: \"4a328329-e154-45e7-aef2-662926164df3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:25.581559 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.581508    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:25.701368 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.701344    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"]
Jul 27 15:13:25.703186 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:13:25.703164    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a328329_e154_45e7_aef2_662926164df3.slice/crio-9d02c95fd807487d6c8b4425e1868fba4415cdb26bd5038deab1802d4523958e WatchSource:0}: Error finding container 9d02c95fd807487d6c8b4425e1868fba4415cdb26bd5038deab1802d4523958e: Status 404 returned error can't find the container with id 9d02c95fd807487d6c8b4425e1868fba4415cdb26bd5038deab1802d4523958e
Jul 27 15:13:25.869087 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.869022    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"]
Jul 27 15:13:25.871308 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.871289    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:25.881943 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.881924    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"]
Jul 27 15:13:25.950089 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.950067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nlbx\" (UniqueName: \"kubernetes.io/projected/eb9f4643-8b2e-41ee-b324-662c4d868fd1-kube-api-access-7nlbx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n\" (UID: \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:25.950182 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.950095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb9f4643-8b2e-41ee-b324-662c4d868fd1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n\" (UID: \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:25.950182 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:25.950124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb9f4643-8b2e-41ee-b324-662c4d868fd1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n\" (UID: \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:26.050619 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.050593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nlbx\" (UniqueName: \"kubernetes.io/projected/eb9f4643-8b2e-41ee-b324-662c4d868fd1-kube-api-access-7nlbx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n\" (UID: \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:26.050700 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.050623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb9f4643-8b2e-41ee-b324-662c4d868fd1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n\" (UID: \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:26.050700 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.050651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb9f4643-8b2e-41ee-b324-662c4d868fd1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n\" (UID: \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:26.050917 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.050900    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb9f4643-8b2e-41ee-b324-662c4d868fd1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n\" (UID: \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:26.050954 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.050937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb9f4643-8b2e-41ee-b324-662c4d868fd1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n\" (UID: \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:26.059259 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.059237    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nlbx\" (UniqueName: \"kubernetes.io/projected/eb9f4643-8b2e-41ee-b324-662c4d868fd1-kube-api-access-7nlbx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n\" (UID: \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:26.179751 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.179722    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:26.304604 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.304572    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"]
Jul 27 15:13:26.307526 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:13:26.307494    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9f4643_8b2e_41ee_b324_662c4d868fd1.slice/crio-28a81a336f4e133c4007f3bc8dcc74e85501f8209705ca9079845016f1e6a0d8 WatchSource:0}: Error finding container 28a81a336f4e133c4007f3bc8dcc74e85501f8209705ca9079845016f1e6a0d8: Status 404 returned error can't find the container with id 28a81a336f4e133c4007f3bc8dcc74e85501f8209705ca9079845016f1e6a0d8
Jul 27 15:13:26.455064 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.455006    2559 generic.go:356] "Generic (PLEG): container finished" podID="4a328329-e154-45e7-aef2-662926164df3" containerID="8b7af6d32d2487e7bcee54757b3bd97aab629a0aba935dc58415cc110cc25d9c" exitCode=0
Jul 27 15:13:26.455184 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.455102    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn" event={"ID":"4a328329-e154-45e7-aef2-662926164df3","Type":"ContainerDied","Data":"8b7af6d32d2487e7bcee54757b3bd97aab629a0aba935dc58415cc110cc25d9c"}
Jul 27 15:13:26.455184 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.455164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn" event={"ID":"4a328329-e154-45e7-aef2-662926164df3","Type":"ContainerStarted","Data":"9d02c95fd807487d6c8b4425e1868fba4415cdb26bd5038deab1802d4523958e"}
Jul 27 15:13:26.457039 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.457020    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n" event={"ID":"eb9f4643-8b2e-41ee-b324-662c4d868fd1","Type":"ContainerStarted","Data":"bcdae8f78f1950170c9cbecc8e7d952baf8e22c25e3f2e80d65b9c056f1a76e8"}
Jul 27 15:13:26.457124 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:26.457053    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n" event={"ID":"eb9f4643-8b2e-41ee-b324-662c4d868fd1","Type":"ContainerStarted","Data":"28a81a336f4e133c4007f3bc8dcc74e85501f8209705ca9079845016f1e6a0d8"}
Jul 27 15:13:27.462791 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:27.462766    2559 generic.go:356] "Generic (PLEG): container finished" podID="4a328329-e154-45e7-aef2-662926164df3" containerID="a76e20522c9a12d32824fec41738e172631c5723b73a402f6b2a37f8a41ded08" exitCode=0
Jul 27 15:13:27.463118 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:27.462863    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn" event={"ID":"4a328329-e154-45e7-aef2-662926164df3","Type":"ContainerDied","Data":"a76e20522c9a12d32824fec41738e172631c5723b73a402f6b2a37f8a41ded08"}
Jul 27 15:13:27.464337 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:27.464295    2559 generic.go:356] "Generic (PLEG): container finished" podID="eb9f4643-8b2e-41ee-b324-662c4d868fd1" containerID="bcdae8f78f1950170c9cbecc8e7d952baf8e22c25e3f2e80d65b9c056f1a76e8" exitCode=0
Jul 27 15:13:27.464419 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:27.464359    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n" event={"ID":"eb9f4643-8b2e-41ee-b324-662c4d868fd1","Type":"ContainerDied","Data":"bcdae8f78f1950170c9cbecc8e7d952baf8e22c25e3f2e80d65b9c056f1a76e8"}
Jul 27 15:13:27.466248 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:27.466230    2559 generic.go:356] "Generic (PLEG): container finished" podID="8876577d-480b-4999-bbfa-1f7bddc7baff" containerID="254122960d8aace36ece76c1926de970228be16a90030a06396ca5e98f182288" exitCode=0
Jul 27 15:13:27.466359 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:27.466277    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m" event={"ID":"8876577d-480b-4999-bbfa-1f7bddc7baff","Type":"ContainerDied","Data":"254122960d8aace36ece76c1926de970228be16a90030a06396ca5e98f182288"}
Jul 27 15:13:28.472457 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:28.472432    2559 generic.go:356] "Generic (PLEG): container finished" podID="eb9f4643-8b2e-41ee-b324-662c4d868fd1" containerID="dc158aee2cef38e331c815483e61c2ad6c15493621edbb6c48a8d7180cb28813" exitCode=0
Jul 27 15:13:28.472793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:28.472516    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n" event={"ID":"eb9f4643-8b2e-41ee-b324-662c4d868fd1","Type":"ContainerDied","Data":"dc158aee2cef38e331c815483e61c2ad6c15493621edbb6c48a8d7180cb28813"}
Jul 27 15:13:28.474733 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:28.474714    2559 generic.go:356] "Generic (PLEG): container finished" podID="8876577d-480b-4999-bbfa-1f7bddc7baff" containerID="64586553ddb10e7846fdc0894348b376c4593a838e902b48942d9abf5cb8e28a" exitCode=0
Jul 27 15:13:28.474839 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:28.474827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m" event={"ID":"8876577d-480b-4999-bbfa-1f7bddc7baff","Type":"ContainerDied","Data":"64586553ddb10e7846fdc0894348b376c4593a838e902b48942d9abf5cb8e28a"}
Jul 27 15:13:28.476988 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:28.476968    2559 generic.go:356] "Generic (PLEG): container finished" podID="4a328329-e154-45e7-aef2-662926164df3" containerID="e3e51846c3ed4564cb697c69e3afa8a3071160c18cd1e87f2d2e46c8587cc2c7" exitCode=0
Jul 27 15:13:28.477069 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:28.476997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn" event={"ID":"4a328329-e154-45e7-aef2-662926164df3","Type":"ContainerDied","Data":"e3e51846c3ed4564cb697c69e3afa8a3071160c18cd1e87f2d2e46c8587cc2c7"}
Jul 27 15:13:29.483468 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.483443    2559 generic.go:356] "Generic (PLEG): container finished" podID="05704ac7-28bd-4315-9984-6d165c1c67cd" containerID="7f1dd8c46c37e5c43ffc016fee4cfb55ed99e4ab203fc9ae9b8a367728bb4f51" exitCode=0
Jul 27 15:13:29.483791 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.483560    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm" event={"ID":"05704ac7-28bd-4315-9984-6d165c1c67cd","Type":"ContainerDied","Data":"7f1dd8c46c37e5c43ffc016fee4cfb55ed99e4ab203fc9ae9b8a367728bb4f51"}
Jul 27 15:13:29.485748 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.485727    2559 generic.go:356] "Generic (PLEG): container finished" podID="eb9f4643-8b2e-41ee-b324-662c4d868fd1" containerID="ee530435f3ee35fabd93a5ef6fd9301683e542da32c464df3132a6b288e1a663" exitCode=0
Jul 27 15:13:29.485847 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.485807    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n" event={"ID":"eb9f4643-8b2e-41ee-b324-662c4d868fd1","Type":"ContainerDied","Data":"ee530435f3ee35fabd93a5ef6fd9301683e542da32c464df3132a6b288e1a663"}
Jul 27 15:13:29.622304 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.622281    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:29.625573 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.625551    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:29.679804 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.679776    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a328329-e154-45e7-aef2-662926164df3-bundle\") pod \"4a328329-e154-45e7-aef2-662926164df3\" (UID: \"4a328329-e154-45e7-aef2-662926164df3\") "
Jul 27 15:13:29.679918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.679821    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8876577d-480b-4999-bbfa-1f7bddc7baff-util\") pod \"8876577d-480b-4999-bbfa-1f7bddc7baff\" (UID: \"8876577d-480b-4999-bbfa-1f7bddc7baff\") "
Jul 27 15:13:29.679918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.679836    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a328329-e154-45e7-aef2-662926164df3-util\") pod \"4a328329-e154-45e7-aef2-662926164df3\" (UID: \"4a328329-e154-45e7-aef2-662926164df3\") "
Jul 27 15:13:29.679918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.679862    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8876577d-480b-4999-bbfa-1f7bddc7baff-bundle\") pod \"8876577d-480b-4999-bbfa-1f7bddc7baff\" (UID: \"8876577d-480b-4999-bbfa-1f7bddc7baff\") "
Jul 27 15:13:29.680072 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.679925    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhqv2\" (UniqueName: \"kubernetes.io/projected/8876577d-480b-4999-bbfa-1f7bddc7baff-kube-api-access-xhqv2\") pod \"8876577d-480b-4999-bbfa-1f7bddc7baff\" (UID: \"8876577d-480b-4999-bbfa-1f7bddc7baff\") "
Jul 27 15:13:29.680072 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.679950    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnb5q\" (UniqueName: \"kubernetes.io/projected/4a328329-e154-45e7-aef2-662926164df3-kube-api-access-hnb5q\") pod \"4a328329-e154-45e7-aef2-662926164df3\" (UID: \"4a328329-e154-45e7-aef2-662926164df3\") "
Jul 27 15:13:29.680479 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.680455    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8876577d-480b-4999-bbfa-1f7bddc7baff-bundle" (OuterVolumeSpecName: "bundle") pod "8876577d-480b-4999-bbfa-1f7bddc7baff" (UID: "8876577d-480b-4999-bbfa-1f7bddc7baff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:13:29.680479 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.680450    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a328329-e154-45e7-aef2-662926164df3-bundle" (OuterVolumeSpecName: "bundle") pod "4a328329-e154-45e7-aef2-662926164df3" (UID: "4a328329-e154-45e7-aef2-662926164df3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:13:29.682125 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.682100    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a328329-e154-45e7-aef2-662926164df3-kube-api-access-hnb5q" (OuterVolumeSpecName: "kube-api-access-hnb5q") pod "4a328329-e154-45e7-aef2-662926164df3" (UID: "4a328329-e154-45e7-aef2-662926164df3"). InnerVolumeSpecName "kube-api-access-hnb5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:13:29.682208 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.682148    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8876577d-480b-4999-bbfa-1f7bddc7baff-kube-api-access-xhqv2" (OuterVolumeSpecName: "kube-api-access-xhqv2") pod "8876577d-480b-4999-bbfa-1f7bddc7baff" (UID: "8876577d-480b-4999-bbfa-1f7bddc7baff"). InnerVolumeSpecName "kube-api-access-xhqv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:13:29.685419 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.685395    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a328329-e154-45e7-aef2-662926164df3-util" (OuterVolumeSpecName: "util") pod "4a328329-e154-45e7-aef2-662926164df3" (UID: "4a328329-e154-45e7-aef2-662926164df3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:13:29.781562 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.781516    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhqv2\" (UniqueName: \"kubernetes.io/projected/8876577d-480b-4999-bbfa-1f7bddc7baff-kube-api-access-xhqv2\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:13:29.781562 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.781536    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnb5q\" (UniqueName: \"kubernetes.io/projected/4a328329-e154-45e7-aef2-662926164df3-kube-api-access-hnb5q\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:13:29.781562 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.781549    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a328329-e154-45e7-aef2-662926164df3-bundle\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:13:29.781562 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.781560    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a328329-e154-45e7-aef2-662926164df3-util\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:13:29.781748 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.781571    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8876577d-480b-4999-bbfa-1f7bddc7baff-bundle\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:13:29.788060 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.788038    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8876577d-480b-4999-bbfa-1f7bddc7baff-util" (OuterVolumeSpecName: "util") pod "8876577d-480b-4999-bbfa-1f7bddc7baff" (UID: "8876577d-480b-4999-bbfa-1f7bddc7baff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:13:29.882472 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:29.882447    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8876577d-480b-4999-bbfa-1f7bddc7baff-util\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:13:30.492157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.492131    2559 generic.go:356] "Generic (PLEG): container finished" podID="05704ac7-28bd-4315-9984-6d165c1c67cd" containerID="a6148c4ae15031ad0cdf62347887e3589f91e6688b88782e74e8bfd772005fb0" exitCode=0
Jul 27 15:13:30.492450 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.492212    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm" event={"ID":"05704ac7-28bd-4315-9984-6d165c1c67cd","Type":"ContainerDied","Data":"a6148c4ae15031ad0cdf62347887e3589f91e6688b88782e74e8bfd772005fb0"}
Jul 27 15:13:30.493859 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.493843    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn"
Jul 27 15:13:30.493950 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.493879    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn" event={"ID":"4a328329-e154-45e7-aef2-662926164df3","Type":"ContainerDied","Data":"9d02c95fd807487d6c8b4425e1868fba4415cdb26bd5038deab1802d4523958e"}
Jul 27 15:13:30.493950 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.493918    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d02c95fd807487d6c8b4425e1868fba4415cdb26bd5038deab1802d4523958e"
Jul 27 15:13:30.495621 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.495597    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m" event={"ID":"8876577d-480b-4999-bbfa-1f7bddc7baff","Type":"ContainerDied","Data":"4c9f86d8c9644d0e3925bff7314d019321f33322a333a3181d0157bd71159ff5"}
Jul 27 15:13:30.495686 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.495628    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m"
Jul 27 15:13:30.495686 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.495638    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c9f86d8c9644d0e3925bff7314d019321f33322a333a3181d0157bd71159ff5"
Jul 27 15:13:30.615234 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.615214    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:30.688088 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.688064    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb9f4643-8b2e-41ee-b324-662c4d868fd1-bundle\") pod \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\" (UID: \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\") "
Jul 27 15:13:30.688199 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.688095    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nlbx\" (UniqueName: \"kubernetes.io/projected/eb9f4643-8b2e-41ee-b324-662c4d868fd1-kube-api-access-7nlbx\") pod \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\" (UID: \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\") "
Jul 27 15:13:30.688199 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.688130    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb9f4643-8b2e-41ee-b324-662c4d868fd1-util\") pod \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\" (UID: \"eb9f4643-8b2e-41ee-b324-662c4d868fd1\") "
Jul 27 15:13:30.688616 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.688592    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9f4643-8b2e-41ee-b324-662c4d868fd1-bundle" (OuterVolumeSpecName: "bundle") pod "eb9f4643-8b2e-41ee-b324-662c4d868fd1" (UID: "eb9f4643-8b2e-41ee-b324-662c4d868fd1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:13:30.690271 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.690251    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9f4643-8b2e-41ee-b324-662c4d868fd1-kube-api-access-7nlbx" (OuterVolumeSpecName: "kube-api-access-7nlbx") pod "eb9f4643-8b2e-41ee-b324-662c4d868fd1" (UID: "eb9f4643-8b2e-41ee-b324-662c4d868fd1"). InnerVolumeSpecName "kube-api-access-7nlbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:13:30.694149 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.694087    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9f4643-8b2e-41ee-b324-662c4d868fd1-util" (OuterVolumeSpecName: "util") pod "eb9f4643-8b2e-41ee-b324-662c4d868fd1" (UID: "eb9f4643-8b2e-41ee-b324-662c4d868fd1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:13:30.789324 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.789299    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb9f4643-8b2e-41ee-b324-662c4d868fd1-util\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:13:30.789396 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.789339    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb9f4643-8b2e-41ee-b324-662c4d868fd1-bundle\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:13:30.789396 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:30.789348    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nlbx\" (UniqueName: \"kubernetes.io/projected/eb9f4643-8b2e-41ee-b324-662c4d868fd1-kube-api-access-7nlbx\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:13:31.501275 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.501248    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n" event={"ID":"eb9f4643-8b2e-41ee-b324-662c4d868fd1","Type":"ContainerDied","Data":"28a81a336f4e133c4007f3bc8dcc74e85501f8209705ca9079845016f1e6a0d8"}
Jul 27 15:13:31.501630 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.501276    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n"
Jul 27 15:13:31.501630 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.501291    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28a81a336f4e133c4007f3bc8dcc74e85501f8209705ca9079845016f1e6a0d8"
Jul 27 15:13:31.626197 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.626173    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:31.695046 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.695023    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05704ac7-28bd-4315-9984-6d165c1c67cd-util\") pod \"05704ac7-28bd-4315-9984-6d165c1c67cd\" (UID: \"05704ac7-28bd-4315-9984-6d165c1c67cd\") "
Jul 27 15:13:31.695144 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.695110    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtg9f\" (UniqueName: \"kubernetes.io/projected/05704ac7-28bd-4315-9984-6d165c1c67cd-kube-api-access-mtg9f\") pod \"05704ac7-28bd-4315-9984-6d165c1c67cd\" (UID: \"05704ac7-28bd-4315-9984-6d165c1c67cd\") "
Jul 27 15:13:31.695144 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.695133    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05704ac7-28bd-4315-9984-6d165c1c67cd-bundle\") pod \"05704ac7-28bd-4315-9984-6d165c1c67cd\" (UID: \"05704ac7-28bd-4315-9984-6d165c1c67cd\") "
Jul 27 15:13:31.695630 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.695600    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05704ac7-28bd-4315-9984-6d165c1c67cd-bundle" (OuterVolumeSpecName: "bundle") pod "05704ac7-28bd-4315-9984-6d165c1c67cd" (UID: "05704ac7-28bd-4315-9984-6d165c1c67cd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:13:31.697200 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.697182    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05704ac7-28bd-4315-9984-6d165c1c67cd-kube-api-access-mtg9f" (OuterVolumeSpecName: "kube-api-access-mtg9f") pod "05704ac7-28bd-4315-9984-6d165c1c67cd" (UID: "05704ac7-28bd-4315-9984-6d165c1c67cd"). InnerVolumeSpecName "kube-api-access-mtg9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:13:31.699535 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.699503    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05704ac7-28bd-4315-9984-6d165c1c67cd-util" (OuterVolumeSpecName: "util") pod "05704ac7-28bd-4315-9984-6d165c1c67cd" (UID: "05704ac7-28bd-4315-9984-6d165c1c67cd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:13:31.795776 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.795716    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtg9f\" (UniqueName: \"kubernetes.io/projected/05704ac7-28bd-4315-9984-6d165c1c67cd-kube-api-access-mtg9f\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:13:31.795776 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.795742    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05704ac7-28bd-4315-9984-6d165c1c67cd-bundle\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:13:31.795776 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:31.795755    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05704ac7-28bd-4315-9984-6d165c1c67cd-util\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:13:32.508098 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:32.508080    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm"
Jul 27 15:13:32.508098 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:32.508083    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm" event={"ID":"05704ac7-28bd-4315-9984-6d165c1c67cd","Type":"ContainerDied","Data":"2f83dbda96e00f8e71203a8eedaaaa649dbb8eb42c39e7ce09a2a65e7f662bfe"}
Jul 27 15:13:32.508499 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:13:32.508124    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f83dbda96e00f8e71203a8eedaaaa649dbb8eb42c39e7ce09a2a65e7f662bfe"
Jul 27 15:14:04.222351 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222304    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"]
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222643    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8876577d-480b-4999-bbfa-1f7bddc7baff" containerName="pull"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222655    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8876577d-480b-4999-bbfa-1f7bddc7baff" containerName="pull"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222662    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05704ac7-28bd-4315-9984-6d165c1c67cd" containerName="extract"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222666    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05704ac7-28bd-4315-9984-6d165c1c67cd" containerName="extract"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222674    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9f4643-8b2e-41ee-b324-662c4d868fd1" containerName="util"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222679    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9f4643-8b2e-41ee-b324-662c4d868fd1" containerName="util"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222687    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8876577d-480b-4999-bbfa-1f7bddc7baff" containerName="extract"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222694    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8876577d-480b-4999-bbfa-1f7bddc7baff" containerName="extract"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222703    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9f4643-8b2e-41ee-b324-662c4d868fd1" containerName="extract"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222710    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9f4643-8b2e-41ee-b324-662c4d868fd1" containerName="extract"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222718    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a328329-e154-45e7-aef2-662926164df3" containerName="pull"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222723    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a328329-e154-45e7-aef2-662926164df3" containerName="pull"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222731    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a328329-e154-45e7-aef2-662926164df3" containerName="util"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222735    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a328329-e154-45e7-aef2-662926164df3" containerName="util"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222741    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a328329-e154-45e7-aef2-662926164df3" containerName="extract"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222746    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a328329-e154-45e7-aef2-662926164df3" containerName="extract"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222751    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05704ac7-28bd-4315-9984-6d165c1c67cd" containerName="pull"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222755    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05704ac7-28bd-4315-9984-6d165c1c67cd" containerName="pull"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222761    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9f4643-8b2e-41ee-b324-662c4d868fd1" containerName="pull"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222765    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9f4643-8b2e-41ee-b324-662c4d868fd1" containerName="pull"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222776    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8876577d-480b-4999-bbfa-1f7bddc7baff" containerName="util"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222783    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8876577d-480b-4999-bbfa-1f7bddc7baff" containerName="util"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222792    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05704ac7-28bd-4315-9984-6d165c1c67cd" containerName="util"
Jul 27 15:14:04.222800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222797    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05704ac7-28bd-4315-9984-6d165c1c67cd" containerName="util"
Jul 27 15:14:04.223560 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222840    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="05704ac7-28bd-4315-9984-6d165c1c67cd" containerName="extract"
Jul 27 15:14:04.223560 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222850    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a328329-e154-45e7-aef2-662926164df3" containerName="extract"
Jul 27 15:14:04.223560 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222861    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9f4643-8b2e-41ee-b324-662c4d868fd1" containerName="extract"
Jul 27 15:14:04.223560 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.222871    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8876577d-480b-4999-bbfa-1f7bddc7baff" containerName="extract"
Jul 27 15:14:04.227344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.227310    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"
Jul 27 15:14:04.229704 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.229683    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 15:14:04.229813 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.229684    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 15:14:04.229813 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.229687    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 15:14:04.230906 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.230881    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 15:14:04.231055 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.231036    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nxml9\""
Jul 27 15:14:04.233094 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.233076    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"]
Jul 27 15:14:04.327500 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.327477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7c41abb8-f4b7-42e9-a58c-5edf6e41199c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zkntj\" (UID: \"7c41abb8-f4b7-42e9-a58c-5edf6e41199c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"
Jul 27 15:14:04.327599 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.327522    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wskft\" (UniqueName: \"kubernetes.io/projected/7c41abb8-f4b7-42e9-a58c-5edf6e41199c-kube-api-access-wskft\") pod \"kuadrant-console-plugin-66b5774985-zkntj\" (UID: \"7c41abb8-f4b7-42e9-a58c-5edf6e41199c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"
Jul 27 15:14:04.327599 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.327551    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c41abb8-f4b7-42e9-a58c-5edf6e41199c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zkntj\" (UID: \"7c41abb8-f4b7-42e9-a58c-5edf6e41199c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"
Jul 27 15:14:04.428763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.428740    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c41abb8-f4b7-42e9-a58c-5edf6e41199c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zkntj\" (UID: \"7c41abb8-f4b7-42e9-a58c-5edf6e41199c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"
Jul 27 15:14:04.428857 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.428784    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7c41abb8-f4b7-42e9-a58c-5edf6e41199c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zkntj\" (UID: \"7c41abb8-f4b7-42e9-a58c-5edf6e41199c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"
Jul 27 15:14:04.428857 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.428811    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wskft\" (UniqueName: \"kubernetes.io/projected/7c41abb8-f4b7-42e9-a58c-5edf6e41199c-kube-api-access-wskft\") pod \"kuadrant-console-plugin-66b5774985-zkntj\" (UID: \"7c41abb8-f4b7-42e9-a58c-5edf6e41199c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"
Jul 27 15:14:04.428940 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:14:04.428874    2559 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 27 15:14:04.428940 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:14:04.428935    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c41abb8-f4b7-42e9-a58c-5edf6e41199c-plugin-serving-cert podName:7c41abb8-f4b7-42e9-a58c-5edf6e41199c nodeName:}" failed. No retries permitted until 2026-07-27 15:14:04.928921079 +0000 UTC m=+500.793498926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/7c41abb8-f4b7-42e9-a58c-5edf6e41199c-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-zkntj" (UID: "7c41abb8-f4b7-42e9-a58c-5edf6e41199c") : secret "plugin-serving-cert" not found
Jul 27 15:14:04.429269 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.429253    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7c41abb8-f4b7-42e9-a58c-5edf6e41199c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zkntj\" (UID: \"7c41abb8-f4b7-42e9-a58c-5edf6e41199c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"
Jul 27 15:14:04.440849 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.440829    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wskft\" (UniqueName: \"kubernetes.io/projected/7c41abb8-f4b7-42e9-a58c-5edf6e41199c-kube-api-access-wskft\") pod \"kuadrant-console-plugin-66b5774985-zkntj\" (UID: \"7c41abb8-f4b7-42e9-a58c-5edf6e41199c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"
Jul 27 15:14:04.931786 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.931764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c41abb8-f4b7-42e9-a58c-5edf6e41199c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zkntj\" (UID: \"7c41abb8-f4b7-42e9-a58c-5edf6e41199c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"
Jul 27 15:14:04.933987 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:04.933968    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c41abb8-f4b7-42e9-a58c-5edf6e41199c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zkntj\" (UID: \"7c41abb8-f4b7-42e9-a58c-5edf6e41199c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"
Jul 27 15:14:05.143779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:05.143757    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"
Jul 27 15:14:05.277726 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:05.277703    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj"]
Jul 27 15:14:05.280059 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:14:05.280028    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c41abb8_f4b7_42e9_a58c_5edf6e41199c.slice/crio-a20f3fde1a6f42204dcd48d7505be99684fb3a1eb4a4273a4262b5335f203c97 WatchSource:0}: Error finding container a20f3fde1a6f42204dcd48d7505be99684fb3a1eb4a4273a4262b5335f203c97: Status 404 returned error can't find the container with id a20f3fde1a6f42204dcd48d7505be99684fb3a1eb4a4273a4262b5335f203c97
Jul 27 15:14:05.646170 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:05.646114    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj" event={"ID":"7c41abb8-f4b7-42e9-a58c-5edf6e41199c","Type":"ContainerStarted","Data":"a20f3fde1a6f42204dcd48d7505be99684fb3a1eb4a4273a4262b5335f203c97"}
Jul 27 15:14:28.767656 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:28.767626    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj" event={"ID":"7c41abb8-f4b7-42e9-a58c-5edf6e41199c","Type":"ContainerStarted","Data":"845c642a2cf49cb6f7312c0d168622951461c851b105088da619e344eaa52182"}
Jul 27 15:14:28.784018 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:14:28.783978    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zkntj" podStartSLOduration=1.750605655 podStartE2EDuration="24.783965246s" totalImagesPullingTime="23.033359591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:14:28.782545723 +0000 UTC m=+524.647123591" watchObservedRunningTime="2026-07-27 15:14:28.783965246 +0000 UTC m=+524.648543112"
Jul 27 15:15:00.529881 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.529850    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6ch9t"]
Jul 27 15:15:00.591280 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.591250    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6ch9t"]
Jul 27 15:15:00.591430 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.591359    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6ch9t"
Jul 27 15:15:00.593727 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.593710    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tlwvv\""
Jul 27 15:15:00.648177 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.648011    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8htqp\" (UniqueName: \"kubernetes.io/projected/3c6ca33c-62d4-4d81-9a34-a4458a74c05a-kube-api-access-8htqp\") pod \"authorino-58cd955675-6ch9t\" (UID: \"3c6ca33c-62d4-4d81-9a34-a4458a74c05a\") " pod="kuadrant-system/authorino-58cd955675-6ch9t"
Jul 27 15:15:00.666734 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.666713    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-74t98"]
Jul 27 15:15:00.669918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.669904    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-74t98"
Jul 27 15:15:00.677509 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.677491    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-74t98"]
Jul 27 15:15:00.749056 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.749029    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpdkr\" (UniqueName: \"kubernetes.io/projected/113bb58b-e63a-459c-b9e4-b8d3bf78d47a-kube-api-access-bpdkr\") pod \"authorino-75d556bd77-74t98\" (UID: \"113bb58b-e63a-459c-b9e4-b8d3bf78d47a\") " pod="kuadrant-system/authorino-75d556bd77-74t98"
Jul 27 15:15:00.749146 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.749069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8htqp\" (UniqueName: \"kubernetes.io/projected/3c6ca33c-62d4-4d81-9a34-a4458a74c05a-kube-api-access-8htqp\") pod \"authorino-58cd955675-6ch9t\" (UID: \"3c6ca33c-62d4-4d81-9a34-a4458a74c05a\") " pod="kuadrant-system/authorino-58cd955675-6ch9t"
Jul 27 15:15:00.760982 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.760960    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8htqp\" (UniqueName: \"kubernetes.io/projected/3c6ca33c-62d4-4d81-9a34-a4458a74c05a-kube-api-access-8htqp\") pod \"authorino-58cd955675-6ch9t\" (UID: \"3c6ca33c-62d4-4d81-9a34-a4458a74c05a\") " pod="kuadrant-system/authorino-58cd955675-6ch9t"
Jul 27 15:15:00.849555 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.849498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpdkr\" (UniqueName: \"kubernetes.io/projected/113bb58b-e63a-459c-b9e4-b8d3bf78d47a-kube-api-access-bpdkr\") pod \"authorino-75d556bd77-74t98\" (UID: \"113bb58b-e63a-459c-b9e4-b8d3bf78d47a\") " pod="kuadrant-system/authorino-75d556bd77-74t98"
Jul 27 15:15:00.858304 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.858286    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpdkr\" (UniqueName: \"kubernetes.io/projected/113bb58b-e63a-459c-b9e4-b8d3bf78d47a-kube-api-access-bpdkr\") pod \"authorino-75d556bd77-74t98\" (UID: \"113bb58b-e63a-459c-b9e4-b8d3bf78d47a\") " pod="kuadrant-system/authorino-75d556bd77-74t98"
Jul 27 15:15:00.900387 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.900367    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6ch9t"
Jul 27 15:15:00.978560 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:00.978535    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-74t98"
Jul 27 15:15:01.026599 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:01.026543    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6ch9t"]
Jul 27 15:15:01.106612 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:01.106588    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-74t98"]
Jul 27 15:15:01.108295 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:15:01.108266    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod113bb58b_e63a_459c_b9e4_b8d3bf78d47a.slice/crio-a2cd888e9a5e58c9a21199fe3c14a539b5c6c9b0580dcae8caf416e908fe8eb4 WatchSource:0}: Error finding container a2cd888e9a5e58c9a21199fe3c14a539b5c6c9b0580dcae8caf416e908fe8eb4: Status 404 returned error can't find the container with id a2cd888e9a5e58c9a21199fe3c14a539b5c6c9b0580dcae8caf416e908fe8eb4
Jul 27 15:15:01.934977 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:01.934941    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6ch9t" event={"ID":"3c6ca33c-62d4-4d81-9a34-a4458a74c05a","Type":"ContainerStarted","Data":"5088e03c931582634be7a8d0e0cd574bc6bec8421c4e341cd056c4444d769c4a"}
Jul 27 15:15:01.936677 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:01.936648    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-74t98" event={"ID":"113bb58b-e63a-459c-b9e4-b8d3bf78d47a","Type":"ContainerStarted","Data":"a2cd888e9a5e58c9a21199fe3c14a539b5c6c9b0580dcae8caf416e908fe8eb4"}
Jul 27 15:15:04.954858 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:04.954820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-74t98" event={"ID":"113bb58b-e63a-459c-b9e4-b8d3bf78d47a","Type":"ContainerStarted","Data":"cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2"}
Jul 27 15:15:04.956271 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:04.956247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6ch9t" event={"ID":"3c6ca33c-62d4-4d81-9a34-a4458a74c05a","Type":"ContainerStarted","Data":"2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31"}
Jul 27 15:15:04.971630 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:04.971590    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-74t98" podStartSLOduration=1.342039475 podStartE2EDuration="4.971579411s" totalImagesPullingTime="3.629539936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:15:04.970410819 +0000 UTC m=+560.834988687" watchObservedRunningTime="2026-07-27 15:15:04.971579411 +0000 UTC m=+560.836157278"
Jul 27 15:15:04.986447 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:04.986400    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6ch9t" podStartSLOduration=1.268704244 podStartE2EDuration="4.986386791s" totalImagesPullingTime="3.717682547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:15:04.984511776 +0000 UTC m=+560.849089642" watchObservedRunningTime="2026-07-27 15:15:04.986386791 +0000 UTC m=+560.850964659"
Jul 27 15:15:05.008085 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:05.008028    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6ch9t"]
Jul 27 15:15:06.965436 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:06.965395    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6ch9t" podUID="3c6ca33c-62d4-4d81-9a34-a4458a74c05a" containerName="authorino" containerID="cri-o://2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31" gracePeriod=30
Jul 27 15:15:07.197425 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.197404    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6ch9t"
Jul 27 15:15:07.306504 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.306426    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8htqp\" (UniqueName: \"kubernetes.io/projected/3c6ca33c-62d4-4d81-9a34-a4458a74c05a-kube-api-access-8htqp\") pod \"3c6ca33c-62d4-4d81-9a34-a4458a74c05a\" (UID: \"3c6ca33c-62d4-4d81-9a34-a4458a74c05a\") "
Jul 27 15:15:07.308556 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.308525    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c6ca33c-62d4-4d81-9a34-a4458a74c05a-kube-api-access-8htqp" (OuterVolumeSpecName: "kube-api-access-8htqp") pod "3c6ca33c-62d4-4d81-9a34-a4458a74c05a" (UID: "3c6ca33c-62d4-4d81-9a34-a4458a74c05a"). InnerVolumeSpecName "kube-api-access-8htqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:15:07.407767 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.407740    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8htqp\" (UniqueName: \"kubernetes.io/projected/3c6ca33c-62d4-4d81-9a34-a4458a74c05a-kube-api-access-8htqp\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:15:07.971915 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.971879    2559 generic.go:356] "Generic (PLEG): container finished" podID="3c6ca33c-62d4-4d81-9a34-a4458a74c05a" containerID="2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31" exitCode=0
Jul 27 15:15:07.972302 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.971917    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6ch9t"
Jul 27 15:15:07.972302 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.971962    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6ch9t" event={"ID":"3c6ca33c-62d4-4d81-9a34-a4458a74c05a","Type":"ContainerDied","Data":"2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31"}
Jul 27 15:15:07.972302 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.971998    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6ch9t" event={"ID":"3c6ca33c-62d4-4d81-9a34-a4458a74c05a","Type":"ContainerDied","Data":"5088e03c931582634be7a8d0e0cd574bc6bec8421c4e341cd056c4444d769c4a"}
Jul 27 15:15:07.972302 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.972014    2559 scope.go:117] "RemoveContainer" containerID="2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31"
Jul 27 15:15:07.980784 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.980771    2559 scope.go:117] "RemoveContainer" containerID="2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31"
Jul 27 15:15:07.981058 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:15:07.981038    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31\": container with ID starting with 2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31 not found: ID does not exist" containerID="2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31"
Jul 27 15:15:07.981126 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.981070    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31"} err="failed to get container status \"2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31\": rpc error: code = NotFound desc = could not find container \"2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31\": container with ID starting with 2d2445d602cae997c5d1b3bca6053daa73a348f99347596f8e697a166795fc31 not found: ID does not exist"
Jul 27 15:15:07.992183 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.992162    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6ch9t"]
Jul 27 15:15:07.997952 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:07.997931    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6ch9t"]
Jul 27 15:15:08.711083 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:08.711041    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c6ca33c-62d4-4d81-9a34-a4458a74c05a" path="/var/lib/kubelet/pods/3c6ca33c-62d4-4d81-9a34-a4458a74c05a/volumes"
Jul 27 15:15:30.251390 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.251357    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pjwfj"]
Jul 27 15:15:30.251736 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.251661    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6ca33c-62d4-4d81-9a34-a4458a74c05a" containerName="authorino"
Jul 27 15:15:30.251736 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.251671    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6ca33c-62d4-4d81-9a34-a4458a74c05a" containerName="authorino"
Jul 27 15:15:30.251814 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.251741    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c6ca33c-62d4-4d81-9a34-a4458a74c05a" containerName="authorino"
Jul 27 15:15:30.255472 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.255443    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pjwfj"
Jul 27 15:15:30.262342 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.261852    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pjwfj"]
Jul 27 15:15:30.298639 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.298614    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7hkb\" (UniqueName: \"kubernetes.io/projected/8c4340f7-3c2c-485b-a063-f24578661292-kube-api-access-d7hkb\") pod \"authorino-5d4b67c446-pjwfj\" (UID: \"8c4340f7-3c2c-485b-a063-f24578661292\") " pod="kuadrant-system/authorino-5d4b67c446-pjwfj"
Jul 27 15:15:30.399483 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.399458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7hkb\" (UniqueName: \"kubernetes.io/projected/8c4340f7-3c2c-485b-a063-f24578661292-kube-api-access-d7hkb\") pod \"authorino-5d4b67c446-pjwfj\" (UID: \"8c4340f7-3c2c-485b-a063-f24578661292\") " pod="kuadrant-system/authorino-5d4b67c446-pjwfj"
Jul 27 15:15:30.407436 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.407412    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7hkb\" (UniqueName: \"kubernetes.io/projected/8c4340f7-3c2c-485b-a063-f24578661292-kube-api-access-d7hkb\") pod \"authorino-5d4b67c446-pjwfj\" (UID: \"8c4340f7-3c2c-485b-a063-f24578661292\") " pod="kuadrant-system/authorino-5d4b67c446-pjwfj"
Jul 27 15:15:30.490100 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.490077    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pjwfj"]
Jul 27 15:15:30.490233 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.490223    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pjwfj"
Jul 27 15:15:30.511555 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.511502    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59f97c56bb-85shs"]
Jul 27 15:15:30.514591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.514576    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f97c56bb-85shs"
Jul 27 15:15:30.522033 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.522010    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59f97c56bb-85shs"]
Jul 27 15:15:30.600976 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.600932    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwtmv\" (UniqueName: \"kubernetes.io/projected/1d81b3ff-02b3-4f8a-9ba3-b040e49546c0-kube-api-access-dwtmv\") pod \"authorino-59f97c56bb-85shs\" (UID: \"1d81b3ff-02b3-4f8a-9ba3-b040e49546c0\") " pod="kuadrant-system/authorino-59f97c56bb-85shs"
Jul 27 15:15:30.619677 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.619654    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pjwfj"]
Jul 27 15:15:30.621599 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:15:30.621577    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c4340f7_3c2c_485b_a063_f24578661292.slice/crio-bf43cdd66ed122f3dd11357d9cd4fb276204b8e01138215fe7dac39116587dbc WatchSource:0}: Error finding container bf43cdd66ed122f3dd11357d9cd4fb276204b8e01138215fe7dac39116587dbc: Status 404 returned error can't find the container with id bf43cdd66ed122f3dd11357d9cd4fb276204b8e01138215fe7dac39116587dbc
Jul 27 15:15:30.702103 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.702080    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwtmv\" (UniqueName: \"kubernetes.io/projected/1d81b3ff-02b3-4f8a-9ba3-b040e49546c0-kube-api-access-dwtmv\") pod \"authorino-59f97c56bb-85shs\" (UID: \"1d81b3ff-02b3-4f8a-9ba3-b040e49546c0\") " pod="kuadrant-system/authorino-59f97c56bb-85shs"
Jul 27 15:15:30.710160 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.710141    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwtmv\" (UniqueName: \"kubernetes.io/projected/1d81b3ff-02b3-4f8a-9ba3-b040e49546c0-kube-api-access-dwtmv\") pod \"authorino-59f97c56bb-85shs\" (UID: \"1d81b3ff-02b3-4f8a-9ba3-b040e49546c0\") " pod="kuadrant-system/authorino-59f97c56bb-85shs"
Jul 27 15:15:30.771518 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.771465    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59f97c56bb-85shs"]
Jul 27 15:15:30.771667 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.771655    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f97c56bb-85shs"
Jul 27 15:15:30.797917 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.797893    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dc759bddb-qlxtz"]
Jul 27 15:15:30.801177 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.801157    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dc759bddb-qlxtz"
Jul 27 15:15:30.803669 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.803646    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 15:15:30.808513 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.808305    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dc759bddb-qlxtz"]
Jul 27 15:15:30.895823 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.895800    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59f97c56bb-85shs"]
Jul 27 15:15:30.897724 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:15:30.897701    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d81b3ff_02b3_4f8a_9ba3_b040e49546c0.slice/crio-3e68a0af9d2e4fdaf2f5b5f2e30e852879a48f794f463cd38f554803e08786ad WatchSource:0}: Error finding container 3e68a0af9d2e4fdaf2f5b5f2e30e852879a48f794f463cd38f554803e08786ad: Status 404 returned error can't find the container with id 3e68a0af9d2e4fdaf2f5b5f2e30e852879a48f794f463cd38f554803e08786ad
Jul 27 15:15:30.903679 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.903656    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81822929-297c-4eef-9f60-5009dc479071-tls-cert\") pod \"authorino-6dc759bddb-qlxtz\" (UID: \"81822929-297c-4eef-9f60-5009dc479071\") " pod="kuadrant-system/authorino-6dc759bddb-qlxtz"
Jul 27 15:15:30.903756 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:30.903715    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6smf\" (UniqueName: \"kubernetes.io/projected/81822929-297c-4eef-9f60-5009dc479071-kube-api-access-d6smf\") pod \"authorino-6dc759bddb-qlxtz\" (UID: \"81822929-297c-4eef-9f60-5009dc479071\") " pod="kuadrant-system/authorino-6dc759bddb-qlxtz"
Jul 27 15:15:31.004760 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:31.004739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6smf\" (UniqueName: \"kubernetes.io/projected/81822929-297c-4eef-9f60-5009dc479071-kube-api-access-d6smf\") pod \"authorino-6dc759bddb-qlxtz\" (UID: \"81822929-297c-4eef-9f60-5009dc479071\") " pod="kuadrant-system/authorino-6dc759bddb-qlxtz"
Jul 27 15:15:31.004857 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:31.004804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81822929-297c-4eef-9f60-5009dc479071-tls-cert\") pod \"authorino-6dc759bddb-qlxtz\" (UID: \"81822929-297c-4eef-9f60-5009dc479071\") " pod="kuadrant-system/authorino-6dc759bddb-qlxtz"
Jul 27 15:15:31.007059 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:31.007041    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81822929-297c-4eef-9f60-5009dc479071-tls-cert\") pod \"authorino-6dc759bddb-qlxtz\" (UID: \"81822929-297c-4eef-9f60-5009dc479071\") " pod="kuadrant-system/authorino-6dc759bddb-qlxtz"
Jul 27 15:15:31.012547 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:31.012531    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6smf\" (UniqueName: \"kubernetes.io/projected/81822929-297c-4eef-9f60-5009dc479071-kube-api-access-d6smf\") pod \"authorino-6dc759bddb-qlxtz\" (UID: \"81822929-297c-4eef-9f60-5009dc479071\") " pod="kuadrant-system/authorino-6dc759bddb-qlxtz"
Jul 27 15:15:31.081601 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:31.081549    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pjwfj" event={"ID":"8c4340f7-3c2c-485b-a063-f24578661292","Type":"ContainerStarted","Data":"bf43cdd66ed122f3dd11357d9cd4fb276204b8e01138215fe7dac39116587dbc"}
Jul 27 15:15:31.082706 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:31.082688    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59f97c56bb-85shs" event={"ID":"1d81b3ff-02b3-4f8a-9ba3-b040e49546c0","Type":"ContainerStarted","Data":"3e68a0af9d2e4fdaf2f5b5f2e30e852879a48f794f463cd38f554803e08786ad"}
Jul 27 15:15:31.112564 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:31.112541    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dc759bddb-qlxtz"
Jul 27 15:15:31.238782 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:31.238753    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dc759bddb-qlxtz"]
Jul 27 15:15:31.241189 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:15:31.241164    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81822929_297c_4eef_9f60_5009dc479071.slice/crio-d802e95f3692a959dedeb6b8e8d2acb6ad528cbfe22649cd72ba8d338eb5a26c WatchSource:0}: Error finding container d802e95f3692a959dedeb6b8e8d2acb6ad528cbfe22649cd72ba8d338eb5a26c: Status 404 returned error can't find the container with id d802e95f3692a959dedeb6b8e8d2acb6ad528cbfe22649cd72ba8d338eb5a26c
Jul 27 15:15:32.088782 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:32.088752    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dc759bddb-qlxtz" event={"ID":"81822929-297c-4eef-9f60-5009dc479071","Type":"ContainerStarted","Data":"d802e95f3692a959dedeb6b8e8d2acb6ad528cbfe22649cd72ba8d338eb5a26c"}
Jul 27 15:15:32.090199 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:32.090179    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pjwfj" event={"ID":"8c4340f7-3c2c-485b-a063-f24578661292","Type":"ContainerStarted","Data":"1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84"}
Jul 27 15:15:32.090294 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:32.090205    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-pjwfj" podUID="8c4340f7-3c2c-485b-a063-f24578661292" containerName="authorino" containerID="cri-o://1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84" gracePeriod=30
Jul 27 15:15:32.105765 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:32.105727    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-pjwfj" podStartSLOduration=1.580293693 podStartE2EDuration="2.10571384s" totalImagesPullingTime="525.420147ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:15:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:15:32.104229749 +0000 UTC m=+587.968807617" watchObservedRunningTime="2026-07-27 15:15:32.10571384 +0000 UTC m=+587.970291705"
Jul 27 15:15:32.317736 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:32.317713    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pjwfj"
Jul 27 15:15:32.414518 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:32.414494    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7hkb\" (UniqueName: \"kubernetes.io/projected/8c4340f7-3c2c-485b-a063-f24578661292-kube-api-access-d7hkb\") pod \"8c4340f7-3c2c-485b-a063-f24578661292\" (UID: \"8c4340f7-3c2c-485b-a063-f24578661292\") "
Jul 27 15:15:32.416538 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:32.416512    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4340f7-3c2c-485b-a063-f24578661292-kube-api-access-d7hkb" (OuterVolumeSpecName: "kube-api-access-d7hkb") pod "8c4340f7-3c2c-485b-a063-f24578661292" (UID: "8c4340f7-3c2c-485b-a063-f24578661292"). InnerVolumeSpecName "kube-api-access-d7hkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:15:32.515841 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:32.515818    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7hkb\" (UniqueName: \"kubernetes.io/projected/8c4340f7-3c2c-485b-a063-f24578661292-kube-api-access-d7hkb\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:15:33.096222 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.096151    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dc759bddb-qlxtz" event={"ID":"81822929-297c-4eef-9f60-5009dc479071","Type":"ContainerStarted","Data":"93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd"}
Jul 27 15:15:33.097396 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.097368    2559 generic.go:356] "Generic (PLEG): container finished" podID="8c4340f7-3c2c-485b-a063-f24578661292" containerID="1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84" exitCode=0
Jul 27 15:15:33.097528 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.097401    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pjwfj"
Jul 27 15:15:33.097528 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.097453    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pjwfj" event={"ID":"8c4340f7-3c2c-485b-a063-f24578661292","Type":"ContainerDied","Data":"1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84"}
Jul 27 15:15:33.097528 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.097489    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pjwfj" event={"ID":"8c4340f7-3c2c-485b-a063-f24578661292","Type":"ContainerDied","Data":"bf43cdd66ed122f3dd11357d9cd4fb276204b8e01138215fe7dac39116587dbc"}
Jul 27 15:15:33.097528 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.097506    2559 scope.go:117] "RemoveContainer" containerID="1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84"
Jul 27 15:15:33.099003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.098922    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59f97c56bb-85shs" event={"ID":"1d81b3ff-02b3-4f8a-9ba3-b040e49546c0","Type":"ContainerStarted","Data":"14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9"}
Jul 27 15:15:33.099003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.098992    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59f97c56bb-85shs" podUID="1d81b3ff-02b3-4f8a-9ba3-b040e49546c0" containerName="authorino" containerID="cri-o://14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9" gracePeriod=30
Jul 27 15:15:33.106447 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.106426    2559 scope.go:117] "RemoveContainer" containerID="1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84"
Jul 27 15:15:33.106703 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:15:33.106684    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84\": container with ID starting with 1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84 not found: ID does not exist" containerID="1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84"
Jul 27 15:15:33.106776 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.106712    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84"} err="failed to get container status \"1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84\": rpc error: code = NotFound desc = could not find container \"1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84\": container with ID starting with 1b4979ba4d478cc8ef480e20461ac2cf146aa587ac00cf38debe0cf7fd7fbc84 not found: ID does not exist"
Jul 27 15:15:33.112962 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.112923    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6dc759bddb-qlxtz" podStartSLOduration=2.301368976 podStartE2EDuration="3.112911307s" totalImagesPullingTime="811.542331ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:15:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:15:33.110587644 +0000 UTC m=+588.975165501" watchObservedRunningTime="2026-07-27 15:15:33.112911307 +0000 UTC m=+588.977489164"
Jul 27 15:15:33.125976 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.125931    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59f97c56bb-85shs" podStartSLOduration=1.2839450559999999 podStartE2EDuration="3.125915191s" totalImagesPullingTime="1.841970135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:15:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:15:33.123366197 +0000 UTC m=+588.987944114" watchObservedRunningTime="2026-07-27 15:15:33.125915191 +0000 UTC m=+588.990493058"
Jul 27 15:15:33.138614 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.138590    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-74t98"]
Jul 27 15:15:33.139400 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.139029    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-74t98" podUID="113bb58b-e63a-459c-b9e4-b8d3bf78d47a" containerName="authorino" containerID="cri-o://cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2" gracePeriod=30
Jul 27 15:15:33.140846 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.140820    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pjwfj"]
Jul 27 15:15:33.146431 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.146395    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pjwfj"]
Jul 27 15:15:33.382189 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.382162    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f97c56bb-85shs"
Jul 27 15:15:33.389453 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.389431    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-74t98"
Jul 27 15:15:33.423190 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.423168    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwtmv\" (UniqueName: \"kubernetes.io/projected/1d81b3ff-02b3-4f8a-9ba3-b040e49546c0-kube-api-access-dwtmv\") pod \"1d81b3ff-02b3-4f8a-9ba3-b040e49546c0\" (UID: \"1d81b3ff-02b3-4f8a-9ba3-b040e49546c0\") "
Jul 27 15:15:33.423355 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.423210    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpdkr\" (UniqueName: \"kubernetes.io/projected/113bb58b-e63a-459c-b9e4-b8d3bf78d47a-kube-api-access-bpdkr\") pod \"113bb58b-e63a-459c-b9e4-b8d3bf78d47a\" (UID: \"113bb58b-e63a-459c-b9e4-b8d3bf78d47a\") "
Jul 27 15:15:33.425349 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.425297    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/113bb58b-e63a-459c-b9e4-b8d3bf78d47a-kube-api-access-bpdkr" (OuterVolumeSpecName: "kube-api-access-bpdkr") pod "113bb58b-e63a-459c-b9e4-b8d3bf78d47a" (UID: "113bb58b-e63a-459c-b9e4-b8d3bf78d47a"). InnerVolumeSpecName "kube-api-access-bpdkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:15:33.425443 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.425353    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d81b3ff-02b3-4f8a-9ba3-b040e49546c0-kube-api-access-dwtmv" (OuterVolumeSpecName: "kube-api-access-dwtmv") pod "1d81b3ff-02b3-4f8a-9ba3-b040e49546c0" (UID: "1d81b3ff-02b3-4f8a-9ba3-b040e49546c0"). InnerVolumeSpecName "kube-api-access-dwtmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:15:33.524666 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.524633    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwtmv\" (UniqueName: \"kubernetes.io/projected/1d81b3ff-02b3-4f8a-9ba3-b040e49546c0-kube-api-access-dwtmv\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:15:33.524666 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:33.524663    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpdkr\" (UniqueName: \"kubernetes.io/projected/113bb58b-e63a-459c-b9e4-b8d3bf78d47a-kube-api-access-bpdkr\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:15:34.110255 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.110230    2559 generic.go:356] "Generic (PLEG): container finished" podID="113bb58b-e63a-459c-b9e4-b8d3bf78d47a" containerID="cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2" exitCode=0
Jul 27 15:15:34.110700 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.110277    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-74t98"
Jul 27 15:15:34.110700 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.110288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-74t98" event={"ID":"113bb58b-e63a-459c-b9e4-b8d3bf78d47a","Type":"ContainerDied","Data":"cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2"}
Jul 27 15:15:34.110700 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.110346    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-74t98" event={"ID":"113bb58b-e63a-459c-b9e4-b8d3bf78d47a","Type":"ContainerDied","Data":"a2cd888e9a5e58c9a21199fe3c14a539b5c6c9b0580dcae8caf416e908fe8eb4"}
Jul 27 15:15:34.110700 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.110370    2559 scope.go:117] "RemoveContainer" containerID="cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2"
Jul 27 15:15:34.112965 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.112941    2559 generic.go:356] "Generic (PLEG): container finished" podID="1d81b3ff-02b3-4f8a-9ba3-b040e49546c0" containerID="14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9" exitCode=0
Jul 27 15:15:34.113074 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.113016    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f97c56bb-85shs"
Jul 27 15:15:34.113074 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.113029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59f97c56bb-85shs" event={"ID":"1d81b3ff-02b3-4f8a-9ba3-b040e49546c0","Type":"ContainerDied","Data":"14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9"}
Jul 27 15:15:34.113074 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.113072    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59f97c56bb-85shs" event={"ID":"1d81b3ff-02b3-4f8a-9ba3-b040e49546c0","Type":"ContainerDied","Data":"3e68a0af9d2e4fdaf2f5b5f2e30e852879a48f794f463cd38f554803e08786ad"}
Jul 27 15:15:34.119668 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.119642    2559 scope.go:117] "RemoveContainer" containerID="cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2"
Jul 27 15:15:34.120150 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:15:34.119938    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2\": container with ID starting with cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2 not found: ID does not exist" containerID="cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2"
Jul 27 15:15:34.120150 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.119971    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2"} err="failed to get container status \"cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2\": rpc error: code = NotFound desc = could not find container \"cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2\": container with ID starting with cfacca57ef44d0fcb5b652aa70f36f86ebe06c40f75418b915f9f745d7c6f3d2 not found: ID does not exist"
Jul 27 15:15:34.120150 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.119993    2559 scope.go:117] "RemoveContainer" containerID="14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9"
Jul 27 15:15:34.127813 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.127797    2559 scope.go:117] "RemoveContainer" containerID="14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9"
Jul 27 15:15:34.128020 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:15:34.128001    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9\": container with ID starting with 14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9 not found: ID does not exist" containerID="14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9"
Jul 27 15:15:34.128077 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.128030    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9"} err="failed to get container status \"14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9\": rpc error: code = NotFound desc = could not find container \"14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9\": container with ID starting with 14c126a1b6dbe416c157c66a2b9a8a34583f83111f8eba8cb015461915206cb9 not found: ID does not exist"
Jul 27 15:15:34.138523 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.138500    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-74t98"]
Jul 27 15:15:34.146543 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.146524    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-74t98"]
Jul 27 15:15:34.160045 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.160023    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59f97c56bb-85shs"]
Jul 27 15:15:34.163576 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.163557    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59f97c56bb-85shs"]
Jul 27 15:15:34.711651 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.711632    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="113bb58b-e63a-459c-b9e4-b8d3bf78d47a" path="/var/lib/kubelet/pods/113bb58b-e63a-459c-b9e4-b8d3bf78d47a/volumes"
Jul 27 15:15:34.711915 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.711903    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d81b3ff-02b3-4f8a-9ba3-b040e49546c0" path="/var/lib/kubelet/pods/1d81b3ff-02b3-4f8a-9ba3-b040e49546c0/volumes"
Jul 27 15:15:34.712162 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:15:34.712151    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c4340f7-3c2c-485b-a063-f24578661292" path="/var/lib/kubelet/pods/8c4340f7-3c2c-485b-a063-f24578661292/volumes"
Jul 27 15:16:15.978528 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.978452    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-j5jfp"]
Jul 27 15:16:15.978947 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.978787    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c4340f7-3c2c-485b-a063-f24578661292" containerName="authorino"
Jul 27 15:16:15.978947 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.978799    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4340f7-3c2c-485b-a063-f24578661292" containerName="authorino"
Jul 27 15:16:15.978947 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.978810    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="113bb58b-e63a-459c-b9e4-b8d3bf78d47a" containerName="authorino"
Jul 27 15:16:15.978947 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.978815    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="113bb58b-e63a-459c-b9e4-b8d3bf78d47a" containerName="authorino"
Jul 27 15:16:15.978947 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.978825    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d81b3ff-02b3-4f8a-9ba3-b040e49546c0" containerName="authorino"
Jul 27 15:16:15.978947 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.978830    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d81b3ff-02b3-4f8a-9ba3-b040e49546c0" containerName="authorino"
Jul 27 15:16:15.978947 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.978884    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d81b3ff-02b3-4f8a-9ba3-b040e49546c0" containerName="authorino"
Jul 27 15:16:15.978947 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.978890    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="113bb58b-e63a-459c-b9e4-b8d3bf78d47a" containerName="authorino"
Jul 27 15:16:15.978947 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.978896    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c4340f7-3c2c-485b-a063-f24578661292" containerName="authorino"
Jul 27 15:16:15.981670 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.981655    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp"
Jul 27 15:16:15.984199 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.984174    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 15:16:15.984353 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.984231    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-t2gzn\""
Jul 27 15:16:15.992419 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:15.992396    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-j5jfp"]
Jul 27 15:16:16.113725 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:16.113696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8a5c866-9604-4af5-b222-ac22c28b73d7-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-j5jfp\" (UID: \"c8a5c866-9604-4af5-b222-ac22c28b73d7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp"
Jul 27 15:16:16.113848 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:16.113734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrnv2\" (UniqueName: \"kubernetes.io/projected/c8a5c866-9604-4af5-b222-ac22c28b73d7-kube-api-access-wrnv2\") pod \"payload-processing-5cc6cd444b-j5jfp\" (UID: \"c8a5c866-9604-4af5-b222-ac22c28b73d7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp"
Jul 27 15:16:16.214586 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:16.214560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8a5c866-9604-4af5-b222-ac22c28b73d7-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-j5jfp\" (UID: \"c8a5c866-9604-4af5-b222-ac22c28b73d7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp"
Jul 27 15:16:16.214686 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:16.214591    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrnv2\" (UniqueName: \"kubernetes.io/projected/c8a5c866-9604-4af5-b222-ac22c28b73d7-kube-api-access-wrnv2\") pod \"payload-processing-5cc6cd444b-j5jfp\" (UID: \"c8a5c866-9604-4af5-b222-ac22c28b73d7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp"
Jul 27 15:16:16.215169 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:16.215152    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8a5c866-9604-4af5-b222-ac22c28b73d7-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-j5jfp\" (UID: \"c8a5c866-9604-4af5-b222-ac22c28b73d7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp"
Jul 27 15:16:16.222480 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:16.222459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrnv2\" (UniqueName: \"kubernetes.io/projected/c8a5c866-9604-4af5-b222-ac22c28b73d7-kube-api-access-wrnv2\") pod \"payload-processing-5cc6cd444b-j5jfp\" (UID: \"c8a5c866-9604-4af5-b222-ac22c28b73d7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp"
Jul 27 15:16:16.291981 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:16.291927    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp"
Jul 27 15:16:16.423804 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:16.423774    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-j5jfp"]
Jul 27 15:16:16.425470 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:16:16.425442    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a5c866_9604_4af5_b222_ac22c28b73d7.slice/crio-2ed38aa672d8cfc0e2cdc4ccb29449453fc0822bc80f0b2e137df7f23c29ef0c WatchSource:0}: Error finding container 2ed38aa672d8cfc0e2cdc4ccb29449453fc0822bc80f0b2e137df7f23c29ef0c: Status 404 returned error can't find the container with id 2ed38aa672d8cfc0e2cdc4ccb29449453fc0822bc80f0b2e137df7f23c29ef0c
Jul 27 15:16:16.427231 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:16.427216    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 15:16:17.314534 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:17.314495    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp" event={"ID":"c8a5c866-9604-4af5-b222-ac22c28b73d7","Type":"ContainerStarted","Data":"2ed38aa672d8cfc0e2cdc4ccb29449453fc0822bc80f0b2e137df7f23c29ef0c"}
Jul 27 15:16:19.328145 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:19.328107    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp" event={"ID":"c8a5c866-9604-4af5-b222-ac22c28b73d7","Type":"ContainerStarted","Data":"b422ca65d6c63a7d75fc2a5e897eb4266fb2c3d570f79840c6b500ce7166cf8b"}
Jul 27 15:16:19.328554 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:19.328231    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp"
Jul 27 15:16:19.346565 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:19.346525    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp" podStartSLOduration=2.475090603 podStartE2EDuration="4.346511406s" totalImagesPullingTime="1.871420803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:16:19.344368419 +0000 UTC m=+635.208946287" watchObservedRunningTime="2026-07-27 15:16:19.346511406 +0000 UTC m=+635.211089271"
Jul 27 15:16:30.334147 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:30.334114    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-j5jfp"
Jul 27 15:16:43.381796 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.381758    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"]
Jul 27 15:16:43.384883 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.384864    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.391583 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.391564    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j4bbm\""
Jul 27 15:16:43.391700 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.391592    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 15:16:43.392777 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.392693    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 15:16:43.392777 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.392728    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 27 15:16:43.397297 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.397275    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"]
Jul 27 15:16:43.512758 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.512738    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23a8d5c4-8669-40f5-ba64-b9325358f6c0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.512843 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.512771    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pht8m\" (UniqueName: \"kubernetes.io/projected/23a8d5c4-8669-40f5-ba64-b9325358f6c0-kube-api-access-pht8m\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.512843 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.512805    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a8d5c4-8669-40f5-ba64-b9325358f6c0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.512910 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.512849    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23a8d5c4-8669-40f5-ba64-b9325358f6c0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.512910 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.512869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23a8d5c4-8669-40f5-ba64-b9325358f6c0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.512971 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.512938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23a8d5c4-8669-40f5-ba64-b9325358f6c0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.613545 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.613521    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23a8d5c4-8669-40f5-ba64-b9325358f6c0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.613642 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.613554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pht8m\" (UniqueName: \"kubernetes.io/projected/23a8d5c4-8669-40f5-ba64-b9325358f6c0-kube-api-access-pht8m\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.613642 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.613578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a8d5c4-8669-40f5-ba64-b9325358f6c0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.613642 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.613620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23a8d5c4-8669-40f5-ba64-b9325358f6c0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.613803 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.613669    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23a8d5c4-8669-40f5-ba64-b9325358f6c0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.613803 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.613714    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23a8d5c4-8669-40f5-ba64-b9325358f6c0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.613898 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.613878    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a8d5c4-8669-40f5-ba64-b9325358f6c0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.614009 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.613990    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23a8d5c4-8669-40f5-ba64-b9325358f6c0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.614063 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.614010    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23a8d5c4-8669-40f5-ba64-b9325358f6c0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.615865 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.615847    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23a8d5c4-8669-40f5-ba64-b9325358f6c0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.616016 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.616003    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23a8d5c4-8669-40f5-ba64-b9325358f6c0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.621545 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.621527    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pht8m\" (UniqueName: \"kubernetes.io/projected/23a8d5c4-8669-40f5-ba64-b9325358f6c0-kube-api-access-pht8m\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4q799\" (UID: \"23a8d5c4-8669-40f5-ba64-b9325358f6c0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.697032 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.697008    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:43.839750 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:43.839726    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"]
Jul 27 15:16:43.841245 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:16:43.841214    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a8d5c4_8669_40f5_ba64_b9325358f6c0.slice/crio-c50c9ad1e6cf5a51ad12f8386d239f849b173833a79035812abfb8c47fc2e8f6 WatchSource:0}: Error finding container c50c9ad1e6cf5a51ad12f8386d239f849b173833a79035812abfb8c47fc2e8f6: Status 404 returned error can't find the container with id c50c9ad1e6cf5a51ad12f8386d239f849b173833a79035812abfb8c47fc2e8f6
Jul 27 15:16:44.450918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:44.450877    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799" event={"ID":"23a8d5c4-8669-40f5-ba64-b9325358f6c0","Type":"ContainerStarted","Data":"c50c9ad1e6cf5a51ad12f8386d239f849b173833a79035812abfb8c47fc2e8f6"}
Jul 27 15:16:45.456633 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:45.456606    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799" event={"ID":"23a8d5c4-8669-40f5-ba64-b9325358f6c0","Type":"ContainerStarted","Data":"fcd60abcc8e214a65143a71a1ae008b52bf65148855626dbc7620fe0c01fe597"}
Jul 27 15:16:45.474942 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:45.474894    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799" podStartSLOduration=1.353503017 podStartE2EDuration="2.474880454s" totalImagesPullingTime="1.121377437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:16:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:16:45.473049638 +0000 UTC m=+661.337627503" watchObservedRunningTime="2026-07-27 15:16:45.474880454 +0000 UTC m=+661.339458318"
Jul 27 15:16:53.697841 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:53.697809    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:53.698282 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:53.697882    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:53.709248 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:53.709225    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:16:54.510564 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:16:54.510543    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4q799"
Jul 27 15:17:01.775382 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:01.775353    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"]
Jul 27 15:17:01.777965 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:01.777947    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:01.780545 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:01.780526    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 15:17:01.787219 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:01.787200    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"]
Jul 27 15:17:01.940082 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:01.940054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:01.940198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:01.940086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:01.940198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:01.940117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:01.940198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:01.940151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:01.940198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:01.940188    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:01.940373 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:01.940234    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gghv9\" (UniqueName: \"kubernetes.io/projected/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-kube-api-access-gghv9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.040895 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.040842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gghv9\" (UniqueName: \"kubernetes.io/projected/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-kube-api-access-gghv9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.040895 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.040873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.040895 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.040892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.041059 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.040927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.041059 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.040959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.041059 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.041003    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.041258 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.041238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.041306 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.041279    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.041393 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.041378    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.042956 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.042939    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.043263 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.043248    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.048497 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.048472    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gghv9\" (UniqueName: \"kubernetes.io/projected/7ef741f5-47bc-4c07-a7f3-f5a507c006f2-kube-api-access-gghv9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv\" (UID: \"7ef741f5-47bc-4c07-a7f3-f5a507c006f2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.089583 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.089564    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:02.208969 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.208947    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"]
Jul 27 15:17:02.210692 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:17:02.210671    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef741f5_47bc_4c07_a7f3_f5a507c006f2.slice/crio-07d0e1e4762273ec27268324c75640a9e9775ccc52649296d444e50e19536a3f WatchSource:0}: Error finding container 07d0e1e4762273ec27268324c75640a9e9775ccc52649296d444e50e19536a3f: Status 404 returned error can't find the container with id 07d0e1e4762273ec27268324c75640a9e9775ccc52649296d444e50e19536a3f
Jul 27 15:17:02.535341 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.535298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv" event={"ID":"7ef741f5-47bc-4c07-a7f3-f5a507c006f2","Type":"ContainerStarted","Data":"272fc1f250fb53f489b338cf544e752ad9a3eb308b058102218d6adfb03b44d0"}
Jul 27 15:17:02.535464 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.535359    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv" event={"ID":"7ef741f5-47bc-4c07-a7f3-f5a507c006f2","Type":"ContainerStarted","Data":"07d0e1e4762273ec27268324c75640a9e9775ccc52649296d444e50e19536a3f"}
Jul 27 15:17:02.553777 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:02.553737    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv" podStartSLOduration=1.34370806 podStartE2EDuration="1.553721717s" totalImagesPullingTime="210.013657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:17:02.551480111 +0000 UTC m=+678.416057976" watchObservedRunningTime="2026-07-27 15:17:02.553721717 +0000 UTC m=+678.418299581"
Jul 27 15:17:12.090081 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:12.090051    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:12.090510 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:12.090102    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:12.101862 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:12.101843    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:12.592623 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:12.592600    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv"
Jul 27 15:17:18.376641 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.376577    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"]
Jul 27 15:17:18.382525 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.382503    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.384931 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.384907    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 27 15:17:18.388576 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.388555    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"]
Jul 27 15:17:18.559418 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.559386    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98af6b35-0888-4ee9-bbfb-2dd54cf50360-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.559418 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.559422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98af6b35-0888-4ee9-bbfb-2dd54cf50360-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.559545 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.559448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98af6b35-0888-4ee9-bbfb-2dd54cf50360-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.559545 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.559466    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxwfw\" (UniqueName: \"kubernetes.io/projected/98af6b35-0888-4ee9-bbfb-2dd54cf50360-kube-api-access-mxwfw\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.559545 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.559489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98af6b35-0888-4ee9-bbfb-2dd54cf50360-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.559545 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.559527    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98af6b35-0888-4ee9-bbfb-2dd54cf50360-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.660271 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.660219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98af6b35-0888-4ee9-bbfb-2dd54cf50360-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.660271 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.660265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98af6b35-0888-4ee9-bbfb-2dd54cf50360-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.660430 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.660281    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98af6b35-0888-4ee9-bbfb-2dd54cf50360-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.660430 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.660305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98af6b35-0888-4ee9-bbfb-2dd54cf50360-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.660532 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.660427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxwfw\" (UniqueName: \"kubernetes.io/projected/98af6b35-0888-4ee9-bbfb-2dd54cf50360-kube-api-access-mxwfw\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.660532 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.660469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98af6b35-0888-4ee9-bbfb-2dd54cf50360-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.660644 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.660624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98af6b35-0888-4ee9-bbfb-2dd54cf50360-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.660695 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.660646    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98af6b35-0888-4ee9-bbfb-2dd54cf50360-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.660746 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.660720    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98af6b35-0888-4ee9-bbfb-2dd54cf50360-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.662552 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.662532    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98af6b35-0888-4ee9-bbfb-2dd54cf50360-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.662796 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.662779    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98af6b35-0888-4ee9-bbfb-2dd54cf50360-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.670046 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.670027    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxwfw\" (UniqueName: \"kubernetes.io/projected/98af6b35-0888-4ee9-bbfb-2dd54cf50360-kube-api-access-mxwfw\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h\" (UID: \"98af6b35-0888-4ee9-bbfb-2dd54cf50360\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.692998 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.692978    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:18.823622 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:18.823594    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"]
Jul 27 15:17:18.824487 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:17:18.824457    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98af6b35_0888_4ee9_bbfb_2dd54cf50360.slice/crio-3d84630200eca6d4af7603b9c2ce8c84a4327b49e6808ab7df579684ef930c50 WatchSource:0}: Error finding container 3d84630200eca6d4af7603b9c2ce8c84a4327b49e6808ab7df579684ef930c50: Status 404 returned error can't find the container with id 3d84630200eca6d4af7603b9c2ce8c84a4327b49e6808ab7df579684ef930c50
Jul 27 15:17:19.615894 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:19.615861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h" event={"ID":"98af6b35-0888-4ee9-bbfb-2dd54cf50360","Type":"ContainerStarted","Data":"f88060deaef9bbda6009d93d87181029d8a5b4cb622b68e9098beb1eb25b564e"}
Jul 27 15:17:19.616417 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:19.615900    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h" event={"ID":"98af6b35-0888-4ee9-bbfb-2dd54cf50360","Type":"ContainerStarted","Data":"3d84630200eca6d4af7603b9c2ce8c84a4327b49e6808ab7df579684ef930c50"}
Jul 27 15:17:19.637244 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:19.637198    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h" podStartSLOduration=1.391385683 podStartE2EDuration="1.637181682s" totalImagesPullingTime="245.795999ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:17:19.63655689 +0000 UTC m=+695.501134755" watchObservedRunningTime="2026-07-27 15:17:19.637181682 +0000 UTC m=+695.501759546"
Jul 27 15:17:28.693848 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:28.693805    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:28.694219 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:28.693867    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:28.710703 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:28.710683    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:17:29.677075 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:17:29.677055    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h"
Jul 27 15:18:47.628858 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:47.628821    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66ccb7479f-jsclr"]
Jul 27 15:18:47.632206 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:47.632183    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66ccb7479f-jsclr"
Jul 27 15:18:47.640137 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:47.640116    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66ccb7479f-jsclr"]
Jul 27 15:18:47.760284 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:47.760238    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnkvb\" (UniqueName: \"kubernetes.io/projected/614d7994-6f5b-4a1d-a923-ac54fd357b86-kube-api-access-gnkvb\") pod \"authorino-66ccb7479f-jsclr\" (UID: \"614d7994-6f5b-4a1d-a923-ac54fd357b86\") " pod="kuadrant-system/authorino-66ccb7479f-jsclr"
Jul 27 15:18:47.760284 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:47.760294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/614d7994-6f5b-4a1d-a923-ac54fd357b86-tls-cert\") pod \"authorino-66ccb7479f-jsclr\" (UID: \"614d7994-6f5b-4a1d-a923-ac54fd357b86\") " pod="kuadrant-system/authorino-66ccb7479f-jsclr"
Jul 27 15:18:47.861591 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:47.861554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnkvb\" (UniqueName: \"kubernetes.io/projected/614d7994-6f5b-4a1d-a923-ac54fd357b86-kube-api-access-gnkvb\") pod \"authorino-66ccb7479f-jsclr\" (UID: \"614d7994-6f5b-4a1d-a923-ac54fd357b86\") " pod="kuadrant-system/authorino-66ccb7479f-jsclr"
Jul 27 15:18:47.861776 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:47.861607    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/614d7994-6f5b-4a1d-a923-ac54fd357b86-tls-cert\") pod \"authorino-66ccb7479f-jsclr\" (UID: \"614d7994-6f5b-4a1d-a923-ac54fd357b86\") " pod="kuadrant-system/authorino-66ccb7479f-jsclr"
Jul 27 15:18:47.864231 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:47.864206    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/614d7994-6f5b-4a1d-a923-ac54fd357b86-tls-cert\") pod \"authorino-66ccb7479f-jsclr\" (UID: \"614d7994-6f5b-4a1d-a923-ac54fd357b86\") " pod="kuadrant-system/authorino-66ccb7479f-jsclr"
Jul 27 15:18:47.870631 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:47.870599    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnkvb\" (UniqueName: \"kubernetes.io/projected/614d7994-6f5b-4a1d-a923-ac54fd357b86-kube-api-access-gnkvb\") pod \"authorino-66ccb7479f-jsclr\" (UID: \"614d7994-6f5b-4a1d-a923-ac54fd357b86\") " pod="kuadrant-system/authorino-66ccb7479f-jsclr"
Jul 27 15:18:47.942008 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:47.941983    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66ccb7479f-jsclr"
Jul 27 15:18:48.076362 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:48.076332    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66ccb7479f-jsclr"]
Jul 27 15:18:48.078340 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:18:48.078281    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod614d7994_6f5b_4a1d_a923_ac54fd357b86.slice/crio-9120e6664073e21fe6faf7882556a9de9cfb7ab147250cce6f428b9a8ae4fb6c WatchSource:0}: Error finding container 9120e6664073e21fe6faf7882556a9de9cfb7ab147250cce6f428b9a8ae4fb6c: Status 404 returned error can't find the container with id 9120e6664073e21fe6faf7882556a9de9cfb7ab147250cce6f428b9a8ae4fb6c
Jul 27 15:18:49.038487 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:49.038449    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66ccb7479f-jsclr" event={"ID":"614d7994-6f5b-4a1d-a923-ac54fd357b86","Type":"ContainerStarted","Data":"8fbf4c5cb760d3fb5b6e0a592e684e6ac63f02c46798ea5629f7765deb4044d2"}
Jul 27 15:18:49.038919 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:49.038502    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66ccb7479f-jsclr" event={"ID":"614d7994-6f5b-4a1d-a923-ac54fd357b86","Type":"ContainerStarted","Data":"9120e6664073e21fe6faf7882556a9de9cfb7ab147250cce6f428b9a8ae4fb6c"}
Jul 27 15:18:49.056255 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:49.056158    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66ccb7479f-jsclr" podStartSLOduration=1.2409583610000001 podStartE2EDuration="2.056141998s" totalImagesPullingTime="815.183637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:18:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:18:49.054643935 +0000 UTC m=+784.919221802" watchObservedRunningTime="2026-07-27 15:18:49.056141998 +0000 UTC m=+784.920719864"
Jul 27 15:18:49.086193 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:49.086158    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dc759bddb-qlxtz"]
Jul 27 15:18:49.086428 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:49.086402    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6dc759bddb-qlxtz" podUID="81822929-297c-4eef-9f60-5009dc479071" containerName="authorino" containerID="cri-o://93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd" gracePeriod=30
Jul 27 15:18:49.326524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:49.326499    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dc759bddb-qlxtz"
Jul 27 15:18:49.476512 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:49.476475    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6smf\" (UniqueName: \"kubernetes.io/projected/81822929-297c-4eef-9f60-5009dc479071-kube-api-access-d6smf\") pod \"81822929-297c-4eef-9f60-5009dc479071\" (UID: \"81822929-297c-4eef-9f60-5009dc479071\") "
Jul 27 15:18:49.476663 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:49.476551    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81822929-297c-4eef-9f60-5009dc479071-tls-cert\") pod \"81822929-297c-4eef-9f60-5009dc479071\" (UID: \"81822929-297c-4eef-9f60-5009dc479071\") "
Jul 27 15:18:49.478659 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:49.478630    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81822929-297c-4eef-9f60-5009dc479071-kube-api-access-d6smf" (OuterVolumeSpecName: "kube-api-access-d6smf") pod "81822929-297c-4eef-9f60-5009dc479071" (UID: "81822929-297c-4eef-9f60-5009dc479071"). InnerVolumeSpecName "kube-api-access-d6smf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:18:49.494209 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:49.494173    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81822929-297c-4eef-9f60-5009dc479071-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "81822929-297c-4eef-9f60-5009dc479071" (UID: "81822929-297c-4eef-9f60-5009dc479071"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:18:49.577734 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:49.577644    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6smf\" (UniqueName: \"kubernetes.io/projected/81822929-297c-4eef-9f60-5009dc479071-kube-api-access-d6smf\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:18:49.577734 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:49.577677    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81822929-297c-4eef-9f60-5009dc479071-tls-cert\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:18:50.045436 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:50.045400    2559 generic.go:356] "Generic (PLEG): container finished" podID="81822929-297c-4eef-9f60-5009dc479071" containerID="93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd" exitCode=0
Jul 27 15:18:50.045855 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:50.045442    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dc759bddb-qlxtz"
Jul 27 15:18:50.045855 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:50.045472    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dc759bddb-qlxtz" event={"ID":"81822929-297c-4eef-9f60-5009dc479071","Type":"ContainerDied","Data":"93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd"}
Jul 27 15:18:50.045855 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:50.045499    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dc759bddb-qlxtz" event={"ID":"81822929-297c-4eef-9f60-5009dc479071","Type":"ContainerDied","Data":"d802e95f3692a959dedeb6b8e8d2acb6ad528cbfe22649cd72ba8d338eb5a26c"}
Jul 27 15:18:50.045855 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:50.045514    2559 scope.go:117] "RemoveContainer" containerID="93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd"
Jul 27 15:18:50.056355 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:50.056333    2559 scope.go:117] "RemoveContainer" containerID="93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd"
Jul 27 15:18:50.056674 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:18:50.056651    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd\": container with ID starting with 93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd not found: ID does not exist" containerID="93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd"
Jul 27 15:18:50.056726 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:50.056690    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd"} err="failed to get container status \"93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd\": rpc error: code = NotFound desc = could not find container \"93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd\": container with ID starting with 93d27005bc5e7099ebfc700b929ae24d23f62d9df24411e976f79de828f8f8bd not found: ID does not exist"
Jul 27 15:18:50.070957 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:50.070928    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dc759bddb-qlxtz"]
Jul 27 15:18:50.074236 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:50.074216    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dc759bddb-qlxtz"]
Jul 27 15:18:50.712060 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:18:50.712023    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81822929-297c-4eef-9f60-5009dc479071" path="/var/lib/kubelet/pods/81822929-297c-4eef-9f60-5009dc479071/volumes"
Jul 27 15:29:39.082852 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.082778    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"]
Jul 27 15:29:39.083271 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.083104    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81822929-297c-4eef-9f60-5009dc479071" containerName="authorino"
Jul 27 15:29:39.083271 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.083115    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81822929-297c-4eef-9f60-5009dc479071" containerName="authorino"
Jul 27 15:29:39.083271 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.083177    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="81822929-297c-4eef-9f60-5009dc479071" containerName="authorino"
Jul 27 15:29:39.086031 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.086017    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.088528 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.088511    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-2148bedd-kserve-self-signed-certs\""
Jul 27 15:29:39.101155 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.101131    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"]
Jul 27 15:29:39.178640 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.178614    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-model-cache\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.178766 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.178654    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-home\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.178766 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.178704    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-tmp-dir\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.178766 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.178754    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-dshm\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.178870 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.178791    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x4cz\" (UniqueName: \"kubernetes.io/projected/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-kube-api-access-4x4cz\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.178870 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.178808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-tls-certs\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.279858 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.279830    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-dshm\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.279987 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.279877    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x4cz\" (UniqueName: \"kubernetes.io/projected/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-kube-api-access-4x4cz\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.279987 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.279909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-tls-certs\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.279987 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.279946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-model-cache\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.280137 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.279991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-home\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.280137 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.280034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-tmp-dir\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.280384 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.280364    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-model-cache\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.280457 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.280424    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-home\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.280457 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.280441    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-tmp-dir\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.282170 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.282146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-dshm\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.282522 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.282505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-tls-certs\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.287506 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.287485    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x4cz\" (UniqueName: \"kubernetes.io/projected/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-kube-api-access-4x4cz\") pod \"e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") " pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.395039 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.394987    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:39.521810 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:39.521684    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"]
Jul 27 15:29:39.524058 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:29:39.524032    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fe85e54_e2d0_4675_9bf3_68b75f8ecdc8.slice/crio-2d9aabaf9380c64dd4092f6b67254c5b97b5e03f3d6477d82a74e51396a090b6 WatchSource:0}: Error finding container 2d9aabaf9380c64dd4092f6b67254c5b97b5e03f3d6477d82a74e51396a090b6: Status 404 returned error can't find the container with id 2d9aabaf9380c64dd4092f6b67254c5b97b5e03f3d6477d82a74e51396a090b6
Jul 27 15:29:40.191253 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:40.191223    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl" event={"ID":"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8","Type":"ContainerStarted","Data":"6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382"}
Jul 27 15:29:40.191624 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:40.191262    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl" event={"ID":"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8","Type":"ContainerStarted","Data":"2d9aabaf9380c64dd4092f6b67254c5b97b5e03f3d6477d82a74e51396a090b6"}
Jul 27 15:29:40.208330 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:40.208269    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl" podStartSLOduration=1.208255657 podStartE2EDuration="1.208255657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:29:40.206521455 +0000 UTC m=+1436.071099321" watchObservedRunningTime="2026-07-27 15:29:40.208255657 +0000 UTC m=+1436.072833548"
Jul 27 15:29:49.395268 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:49.395184    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:49.395268 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:49.395233    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:49.407604 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:49.407582    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:50.253749 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.253719    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:29:50.764986 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.764952    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"]
Jul 27 15:29:50.768649 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.768627    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.771089 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.771070    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-2148bedd-kserve-self-signed-certs\""
Jul 27 15:29:50.776997 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.776972    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"]
Jul 27 15:29:50.880339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.880298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc76b4af-7e32-4658-be11-0b955205844b-tls-certs\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.880428 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.880367    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhqbz\" (UniqueName: \"kubernetes.io/projected/fc76b4af-7e32-4658-be11-0b955205844b-kube-api-access-bhqbz\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.880428 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.880391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-tmp-dir\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.880428 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.880412    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-home\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.880428 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.880429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-dshm\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.880571 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.880469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-model-cache\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.981256 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.981233    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhqbz\" (UniqueName: \"kubernetes.io/projected/fc76b4af-7e32-4658-be11-0b955205844b-kube-api-access-bhqbz\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.981380 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.981264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-tmp-dir\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.981380 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.981287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-home\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.981474 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.981394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-dshm\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.981474 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.981427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-model-cache\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.981548 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.981511    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc76b4af-7e32-4658-be11-0b955205844b-tls-certs\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.981631 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.981612    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-tmp-dir\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.981679 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.981663    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-home\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.981795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.981779    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-model-cache\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.983554 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.983536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-dshm\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.983955 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.983937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc76b4af-7e32-4658-be11-0b955205844b-tls-certs\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:50.990041 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:50.990023    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhqbz\" (UniqueName: \"kubernetes.io/projected/fc76b4af-7e32-4658-be11-0b955205844b-kube-api-access-bhqbz\") pod \"e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") " pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:51.078816 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:51.078766    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:29:51.204817 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:51.204688    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"]
Jul 27 15:29:51.207499 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:29:51.207470    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc76b4af_7e32_4658_be11_0b955205844b.slice/crio-d80db2ab620d34a022e891029a7eecc9439cba966054ac4c9c56cb9772a6d5b2 WatchSource:0}: Error finding container d80db2ab620d34a022e891029a7eecc9439cba966054ac4c9c56cb9772a6d5b2: Status 404 returned error can't find the container with id d80db2ab620d34a022e891029a7eecc9439cba966054ac4c9c56cb9772a6d5b2
Jul 27 15:29:51.248433 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:51.248406    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt" event={"ID":"fc76b4af-7e32-4658-be11-0b955205844b","Type":"ContainerStarted","Data":"d80db2ab620d34a022e891029a7eecc9439cba966054ac4c9c56cb9772a6d5b2"}
Jul 27 15:29:52.255283 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:52.255241    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt" event={"ID":"fc76b4af-7e32-4658-be11-0b955205844b","Type":"ContainerStarted","Data":"89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737"}
Jul 27 15:29:52.271902 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:29:52.271855    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt" podStartSLOduration=2.271841791 podStartE2EDuration="2.271841791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:29:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:29:52.27038552 +0000 UTC m=+1448.134963385" watchObservedRunningTime="2026-07-27 15:29:52.271841791 +0000 UTC m=+1448.136419656"
Jul 27 15:30:01.079277 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:01.079245    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:30:01.079650 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:01.079297    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:30:01.091037 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:01.091017    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:30:01.309529 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:01.309508    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:30:14.793425 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:14.793385    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"]
Jul 27 15:30:15.595278 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:15.595249    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"]
Jul 27 15:30:29.812167 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:29.812125    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl" podUID="3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8" containerName="main" containerID="cri-o://6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382" gracePeriod=45
Jul 27 15:30:30.060201 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.060173    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:30:30.209211 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.209179    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x4cz\" (UniqueName: \"kubernetes.io/projected/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-kube-api-access-4x4cz\") pod \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") "
Jul 27 15:30:30.209380 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.209258    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-model-cache\") pod \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") "
Jul 27 15:30:30.209449 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.209431    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-tls-certs\") pod \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") "
Jul 27 15:30:30.209499 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.209481    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-model-cache" (OuterVolumeSpecName: "model-cache") pod "3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8" (UID: "3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:30:30.209557 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.209484    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-home\") pod \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") "
Jul 27 15:30:30.209557 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.209546    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-tmp-dir\") pod \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") "
Jul 27 15:30:30.209654 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.209621    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-dshm\") pod \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\" (UID: \"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8\") "
Jul 27 15:30:30.209654 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.209640    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-home" (OuterVolumeSpecName: "home") pod "3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8" (UID: "3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:30:30.209821 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.209785    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8" (UID: "3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:30:30.209939 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.209925    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-model-cache\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:30:30.209979 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.209943    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-home\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:30:30.209979 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.209951    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-tmp-dir\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:30:30.211585 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.211560    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8" (UID: "3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:30:30.211585 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.211565    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-kube-api-access-4x4cz" (OuterVolumeSpecName: "kube-api-access-4x4cz") pod "3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8" (UID: "3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8"). InnerVolumeSpecName "kube-api-access-4x4cz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:30:30.211705 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.211669    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-dshm" (OuterVolumeSpecName: "dshm") pod "3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8" (UID: "3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:30:30.310776 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.310742    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-dshm\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:30:30.310776 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.310773    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x4cz\" (UniqueName: \"kubernetes.io/projected/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-kube-api-access-4x4cz\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:30:30.310776 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.310783    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8-tls-certs\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:30:30.449997 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.449971    2559 generic.go:356] "Generic (PLEG): container finished" podID="3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8" containerID="6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382" exitCode=0
Jul 27 15:30:30.450114 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.450007    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"
Jul 27 15:30:30.450114 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.450007    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl" event={"ID":"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8","Type":"ContainerDied","Data":"6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382"}
Jul 27 15:30:30.450181 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.450133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl" event={"ID":"3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8","Type":"ContainerDied","Data":"2d9aabaf9380c64dd4092f6b67254c5b97b5e03f3d6477d82a74e51396a090b6"}
Jul 27 15:30:30.450181 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.450156    2559 scope.go:117] "RemoveContainer" containerID="6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382"
Jul 27 15:30:30.458986 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.458966    2559 scope.go:117] "RemoveContainer" containerID="6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382"
Jul 27 15:30:30.459248 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:30:30.459204    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382\": container with ID starting with 6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382 not found: ID does not exist" containerID="6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382"
Jul 27 15:30:30.459303 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.459236    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382"} err="failed to get container status \"6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382\": rpc error: code = NotFound desc = could not find container \"6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382\": container with ID starting with 6347eb771df0e3ddb3ec02f9f61b4acb97e74a881ed80ae9d5891ff4e8e5d382 not found: ID does not exist"
Jul 27 15:30:30.471351 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.471301    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"]
Jul 27 15:30:30.474430 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.474411    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-2148bedd-kserve-56cf6b685f-hr9tl"]
Jul 27 15:30:30.613991 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.613941    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt" podUID="fc76b4af-7e32-4658-be11-0b955205844b" containerName="main" containerID="cri-o://89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737" gracePeriod=45
Jul 27 15:30:30.712160 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.712076    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8" path="/var/lib/kubelet/pods/3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8/volumes"
Jul 27 15:30:30.858331 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.858292    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:30:30.914825 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.914794    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc76b4af-7e32-4658-be11-0b955205844b-tls-certs\") pod \"fc76b4af-7e32-4658-be11-0b955205844b\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") "
Jul 27 15:30:30.914825 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.914826    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-tmp-dir\") pod \"fc76b4af-7e32-4658-be11-0b955205844b\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") "
Jul 27 15:30:30.915008 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.914871    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-home\") pod \"fc76b4af-7e32-4658-be11-0b955205844b\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") "
Jul 27 15:30:30.915008 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.914897    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-dshm\") pod \"fc76b4af-7e32-4658-be11-0b955205844b\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") "
Jul 27 15:30:30.915127 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.915099    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fc76b4af-7e32-4658-be11-0b955205844b" (UID: "fc76b4af-7e32-4658-be11-0b955205844b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:30:30.915174 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.915133    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-home" (OuterVolumeSpecName: "home") pod "fc76b4af-7e32-4658-be11-0b955205844b" (UID: "fc76b4af-7e32-4658-be11-0b955205844b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:30:30.915221 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.915205    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-home\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:30:30.915276 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.915222    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-tmp-dir\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:30:30.917059 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.917033    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-dshm" (OuterVolumeSpecName: "dshm") pod "fc76b4af-7e32-4658-be11-0b955205844b" (UID: "fc76b4af-7e32-4658-be11-0b955205844b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:30:30.917059 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:30.917049    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc76b4af-7e32-4658-be11-0b955205844b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fc76b4af-7e32-4658-be11-0b955205844b" (UID: "fc76b4af-7e32-4658-be11-0b955205844b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:30:31.015615 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.015558    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhqbz\" (UniqueName: \"kubernetes.io/projected/fc76b4af-7e32-4658-be11-0b955205844b-kube-api-access-bhqbz\") pod \"fc76b4af-7e32-4658-be11-0b955205844b\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") "
Jul 27 15:30:31.015615 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.015588    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-model-cache\") pod \"fc76b4af-7e32-4658-be11-0b955205844b\" (UID: \"fc76b4af-7e32-4658-be11-0b955205844b\") "
Jul 27 15:30:31.015849 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.015832    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc76b4af-7e32-4658-be11-0b955205844b-tls-certs\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:30:31.015888 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.015856    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-dshm\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:30:31.015920 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.015881    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-model-cache" (OuterVolumeSpecName: "model-cache") pod "fc76b4af-7e32-4658-be11-0b955205844b" (UID: "fc76b4af-7e32-4658-be11-0b955205844b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:30:31.017567 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.017545    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc76b4af-7e32-4658-be11-0b955205844b-kube-api-access-bhqbz" (OuterVolumeSpecName: "kube-api-access-bhqbz") pod "fc76b4af-7e32-4658-be11-0b955205844b" (UID: "fc76b4af-7e32-4658-be11-0b955205844b"). InnerVolumeSpecName "kube-api-access-bhqbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:30:31.116936 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.116898    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhqbz\" (UniqueName: \"kubernetes.io/projected/fc76b4af-7e32-4658-be11-0b955205844b-kube-api-access-bhqbz\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:30:31.116936 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.116932    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc76b4af-7e32-4658-be11-0b955205844b-model-cache\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:30:31.455636 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.455605    2559 generic.go:356] "Generic (PLEG): container finished" podID="fc76b4af-7e32-4658-be11-0b955205844b" containerID="89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737" exitCode=0
Jul 27 15:30:31.455784 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.455650    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"
Jul 27 15:30:31.455784 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.455695    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt" event={"ID":"fc76b4af-7e32-4658-be11-0b955205844b","Type":"ContainerDied","Data":"89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737"}
Jul 27 15:30:31.455784 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.455734    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt" event={"ID":"fc76b4af-7e32-4658-be11-0b955205844b","Type":"ContainerDied","Data":"d80db2ab620d34a022e891029a7eecc9439cba966054ac4c9c56cb9772a6d5b2"}
Jul 27 15:30:31.455784 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.455755    2559 scope.go:117] "RemoveContainer" containerID="89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737"
Jul 27 15:30:31.464408 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.464394    2559 scope.go:117] "RemoveContainer" containerID="89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737"
Jul 27 15:30:31.464656 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:30:31.464637    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737\": container with ID starting with 89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737 not found: ID does not exist" containerID="89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737"
Jul 27 15:30:31.464702 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.464664    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737"} err="failed to get container status \"89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737\": rpc error: code = NotFound desc = could not find container \"89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737\": container with ID starting with 89e51885a80d5d868017fa63cd0d890203e6c469ced567432a619d78ae052737 not found: ID does not exist"
Jul 27 15:30:31.476969 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.476950    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"]
Jul 27 15:30:31.480280 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:31.480259    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-2148bedd-kserve-79757c786c-6hnjt"]
Jul 27 15:30:32.711545 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:30:32.711512    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc76b4af-7e32-4658-be11-0b955205844b" path="/var/lib/kubelet/pods/fc76b4af-7e32-4658-be11-0b955205844b/volumes"
Jul 27 15:34:10.412206 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.412135    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"]
Jul 27 15:34:10.412639 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.412512    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc76b4af-7e32-4658-be11-0b955205844b" containerName="main"
Jul 27 15:34:10.412639 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.412525    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc76b4af-7e32-4658-be11-0b955205844b" containerName="main"
Jul 27 15:34:10.412639 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.412539    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8" containerName="main"
Jul 27 15:34:10.412639 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.412544    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8" containerName="main"
Jul 27 15:34:10.412639 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.412608    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fe85e54-e2d0-4675-9bf3-68b75f8ecdc8" containerName="main"
Jul 27 15:34:10.412639 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.412618    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc76b4af-7e32-4658-be11-0b955205844b" containerName="main"
Jul 27 15:34:10.415758 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.415743    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"
Jul 27 15:34:10.419064 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.419045    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-654abfac-dockercfg-7xdrc\""
Jul 27 15:34:10.419202 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.419049    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-654abfac\""
Jul 27 15:34:10.427022 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.426997    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"]
Jul 27 15:34:10.429261 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.429240    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22709c19-d460-4316-a57e-6054a67a9a20-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2\" (UID: \"22709c19-d460-4316-a57e-6054a67a9a20\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"
Jul 27 15:34:10.429360 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.429272    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgqgn\" (UniqueName: \"kubernetes.io/projected/22709c19-d460-4316-a57e-6054a67a9a20-kube-api-access-zgqgn\") pod \"payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2\" (UID: \"22709c19-d460-4316-a57e-6054a67a9a20\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"
Jul 27 15:34:10.449154 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.449123    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"]
Jul 27 15:34:10.452392 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.452378    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"
Jul 27 15:34:10.463078 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.463054    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"]
Jul 27 15:34:10.529922 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.529895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22709c19-d460-4316-a57e-6054a67a9a20-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2\" (UID: \"22709c19-d460-4316-a57e-6054a67a9a20\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"
Jul 27 15:34:10.530069 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.529932    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgqgn\" (UniqueName: \"kubernetes.io/projected/22709c19-d460-4316-a57e-6054a67a9a20-kube-api-access-zgqgn\") pod \"payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2\" (UID: \"22709c19-d460-4316-a57e-6054a67a9a20\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"
Jul 27 15:34:10.530069 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.530007    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrg9k\" (UniqueName: \"kubernetes.io/projected/530a631d-dddd-4ee7-baf4-461189ac3bb7-kube-api-access-jrg9k\") pod \"payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr\" (UID: \"530a631d-dddd-4ee7-baf4-461189ac3bb7\") " pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"
Jul 27 15:34:10.530069 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.530034    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/530a631d-dddd-4ee7-baf4-461189ac3bb7-plugins-config-volume\") pod \"payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr\" (UID: \"530a631d-dddd-4ee7-baf4-461189ac3bb7\") " pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"
Jul 27 15:34:10.530646 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.530629    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22709c19-d460-4316-a57e-6054a67a9a20-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2\" (UID: \"22709c19-d460-4316-a57e-6054a67a9a20\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"
Jul 27 15:34:10.539090 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.539061    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgqgn\" (UniqueName: \"kubernetes.io/projected/22709c19-d460-4316-a57e-6054a67a9a20-kube-api-access-zgqgn\") pod \"payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2\" (UID: \"22709c19-d460-4316-a57e-6054a67a9a20\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"
Jul 27 15:34:10.630526 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.630502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrg9k\" (UniqueName: \"kubernetes.io/projected/530a631d-dddd-4ee7-baf4-461189ac3bb7-kube-api-access-jrg9k\") pod \"payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr\" (UID: \"530a631d-dddd-4ee7-baf4-461189ac3bb7\") " pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"
Jul 27 15:34:10.630643 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.630539    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/530a631d-dddd-4ee7-baf4-461189ac3bb7-plugins-config-volume\") pod \"payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr\" (UID: \"530a631d-dddd-4ee7-baf4-461189ac3bb7\") " pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"
Jul 27 15:34:10.631200 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.631183    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/530a631d-dddd-4ee7-baf4-461189ac3bb7-plugins-config-volume\") pod \"payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr\" (UID: \"530a631d-dddd-4ee7-baf4-461189ac3bb7\") " pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"
Jul 27 15:34:10.639086 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.639060    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrg9k\" (UniqueName: \"kubernetes.io/projected/530a631d-dddd-4ee7-baf4-461189ac3bb7-kube-api-access-jrg9k\") pod \"payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr\" (UID: \"530a631d-dddd-4ee7-baf4-461189ac3bb7\") " pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"
Jul 27 15:34:10.726025 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.726005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"
Jul 27 15:34:10.763019 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.762982    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"
Jul 27 15:34:10.873696 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.873597    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"]
Jul 27 15:34:10.875961 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:34:10.875934    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22709c19_d460_4316_a57e_6054a67a9a20.slice/crio-c5ed8a9012affd57f573a44ac055d005ad69b7e210706494800d9633b524e13c WatchSource:0}: Error finding container c5ed8a9012affd57f573a44ac055d005ad69b7e210706494800d9633b524e13c: Status 404 returned error can't find the container with id c5ed8a9012affd57f573a44ac055d005ad69b7e210706494800d9633b524e13c
Jul 27 15:34:10.911191 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:10.911167    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"]
Jul 27 15:34:10.912615 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:34:10.912588    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530a631d_dddd_4ee7_baf4_461189ac3bb7.slice/crio-e67733419534674e67415c895a5de71a1a1c1063f3f922181722277e4790d49b WatchSource:0}: Error finding container e67733419534674e67415c895a5de71a1a1c1063f3f922181722277e4790d49b: Status 404 returned error can't find the container with id e67733419534674e67415c895a5de71a1a1c1063f3f922181722277e4790d49b
Jul 27 15:34:11.550662 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:11.550622    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2" event={"ID":"22709c19-d460-4316-a57e-6054a67a9a20","Type":"ContainerStarted","Data":"690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196"}
Jul 27 15:34:11.551412 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:11.550725    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"
Jul 27 15:34:11.551412 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:11.550751    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2" event={"ID":"22709c19-d460-4316-a57e-6054a67a9a20","Type":"ContainerStarted","Data":"c5ed8a9012affd57f573a44ac055d005ad69b7e210706494800d9633b524e13c"}
Jul 27 15:34:11.552688 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:11.552666    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr" event={"ID":"530a631d-dddd-4ee7-baf4-461189ac3bb7","Type":"ContainerStarted","Data":"d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c"}
Jul 27 15:34:11.552815 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:11.552708    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr" event={"ID":"530a631d-dddd-4ee7-baf4-461189ac3bb7","Type":"ContainerStarted","Data":"e67733419534674e67415c895a5de71a1a1c1063f3f922181722277e4790d49b"}
Jul 27 15:34:11.552815 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:11.552797    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"
Jul 27 15:34:11.566487 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:11.566449    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2" podStartSLOduration=1.5664377 podStartE2EDuration="1.5664377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:34:11.564654519 +0000 UTC m=+1707.429232387" watchObservedRunningTime="2026-07-27 15:34:11.5664377 +0000 UTC m=+1707.431015595"
Jul 27 15:34:11.580271 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:11.580227    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr" podStartSLOduration=1.580217195 podStartE2EDuration="1.580217195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:34:11.579115103 +0000 UTC m=+1707.443692969" watchObservedRunningTime="2026-07-27 15:34:11.580217195 +0000 UTC m=+1707.444795111"
Jul 27 15:34:22.559821 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:22.559790    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"
Jul 27 15:34:22.560270 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:22.559866    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"
Jul 27 15:34:45.693778 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:45.693741    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"]
Jul 27 15:34:45.694223 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:45.693959    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr" podUID="530a631d-dddd-4ee7-baf4-461189ac3bb7" containerName="payload-processing" containerID="cri-o://d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c" gracePeriod=30
Jul 27 15:34:45.699400 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:45.699372    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"]
Jul 27 15:34:45.700112 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:45.700022    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2" podUID="22709c19-d460-4316-a57e-6054a67a9a20" containerName="payload-pre-processing" containerID="cri-o://690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196" gracePeriod=30
Jul 27 15:34:45.948710 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:45.948646    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"
Jul 27 15:34:45.971765 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:45.971744    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"
Jul 27 15:34:46.037792 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.037762    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrg9k\" (UniqueName: \"kubernetes.io/projected/530a631d-dddd-4ee7-baf4-461189ac3bb7-kube-api-access-jrg9k\") pod \"530a631d-dddd-4ee7-baf4-461189ac3bb7\" (UID: \"530a631d-dddd-4ee7-baf4-461189ac3bb7\") "
Jul 27 15:34:46.037928 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.037850    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/530a631d-dddd-4ee7-baf4-461189ac3bb7-plugins-config-volume\") pod \"530a631d-dddd-4ee7-baf4-461189ac3bb7\" (UID: \"530a631d-dddd-4ee7-baf4-461189ac3bb7\") "
Jul 27 15:34:46.038243 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.038218    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/530a631d-dddd-4ee7-baf4-461189ac3bb7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "530a631d-dddd-4ee7-baf4-461189ac3bb7" (UID: "530a631d-dddd-4ee7-baf4-461189ac3bb7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:34:46.039862 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.039835    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/530a631d-dddd-4ee7-baf4-461189ac3bb7-kube-api-access-jrg9k" (OuterVolumeSpecName: "kube-api-access-jrg9k") pod "530a631d-dddd-4ee7-baf4-461189ac3bb7" (UID: "530a631d-dddd-4ee7-baf4-461189ac3bb7"). InnerVolumeSpecName "kube-api-access-jrg9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:34:46.138454 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.138428    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22709c19-d460-4316-a57e-6054a67a9a20-plugins-config-volume\") pod \"22709c19-d460-4316-a57e-6054a67a9a20\" (UID: \"22709c19-d460-4316-a57e-6054a67a9a20\") "
Jul 27 15:34:46.138538 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.138516    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgqgn\" (UniqueName: \"kubernetes.io/projected/22709c19-d460-4316-a57e-6054a67a9a20-kube-api-access-zgqgn\") pod \"22709c19-d460-4316-a57e-6054a67a9a20\" (UID: \"22709c19-d460-4316-a57e-6054a67a9a20\") "
Jul 27 15:34:46.138741 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.138725    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/530a631d-dddd-4ee7-baf4-461189ac3bb7-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:34:46.138776 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.138750    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrg9k\" (UniqueName: \"kubernetes.io/projected/530a631d-dddd-4ee7-baf4-461189ac3bb7-kube-api-access-jrg9k\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:34:46.138808 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.138781    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22709c19-d460-4316-a57e-6054a67a9a20-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "22709c19-d460-4316-a57e-6054a67a9a20" (UID: "22709c19-d460-4316-a57e-6054a67a9a20"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:34:46.140542 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.140523    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22709c19-d460-4316-a57e-6054a67a9a20-kube-api-access-zgqgn" (OuterVolumeSpecName: "kube-api-access-zgqgn") pod "22709c19-d460-4316-a57e-6054a67a9a20" (UID: "22709c19-d460-4316-a57e-6054a67a9a20"). InnerVolumeSpecName "kube-api-access-zgqgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:34:46.239548 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.239487    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgqgn\" (UniqueName: \"kubernetes.io/projected/22709c19-d460-4316-a57e-6054a67a9a20-kube-api-access-zgqgn\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:34:46.239548 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.239514    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22709c19-d460-4316-a57e-6054a67a9a20-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:34:46.732021 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.731997    2559 generic.go:356] "Generic (PLEG): container finished" podID="22709c19-d460-4316-a57e-6054a67a9a20" containerID="690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196" exitCode=0
Jul 27 15:34:46.732343 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.732052    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"
Jul 27 15:34:46.732343 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.732085    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2" event={"ID":"22709c19-d460-4316-a57e-6054a67a9a20","Type":"ContainerDied","Data":"690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196"}
Jul 27 15:34:46.732343 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.732135    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2" event={"ID":"22709c19-d460-4316-a57e-6054a67a9a20","Type":"ContainerDied","Data":"c5ed8a9012affd57f573a44ac055d005ad69b7e210706494800d9633b524e13c"}
Jul 27 15:34:46.732343 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.732153    2559 scope.go:117] "RemoveContainer" containerID="690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196"
Jul 27 15:34:46.733449 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.733430    2559 generic.go:356] "Generic (PLEG): container finished" podID="530a631d-dddd-4ee7-baf4-461189ac3bb7" containerID="d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c" exitCode=0
Jul 27 15:34:46.733516 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.733460    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr" event={"ID":"530a631d-dddd-4ee7-baf4-461189ac3bb7","Type":"ContainerDied","Data":"d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c"}
Jul 27 15:34:46.733516 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.733475    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"
Jul 27 15:34:46.733516 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.733494    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr" event={"ID":"530a631d-dddd-4ee7-baf4-461189ac3bb7","Type":"ContainerDied","Data":"e67733419534674e67415c895a5de71a1a1c1063f3f922181722277e4790d49b"}
Jul 27 15:34:46.740587 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.740573    2559 scope.go:117] "RemoveContainer" containerID="690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196"
Jul 27 15:34:46.740858 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:34:46.740840    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196\": container with ID starting with 690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196 not found: ID does not exist" containerID="690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196"
Jul 27 15:34:46.740905 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.740870    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196"} err="failed to get container status \"690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196\": rpc error: code = NotFound desc = could not find container \"690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196\": container with ID starting with 690292ce43c005f5d3837e32df5dfa9c007360575e78e1ac181ea850065aa196 not found: ID does not exist"
Jul 27 15:34:46.740905 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.740888    2559 scope.go:117] "RemoveContainer" containerID="d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c"
Jul 27 15:34:46.748827 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.748810    2559 scope.go:117] "RemoveContainer" containerID="d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c"
Jul 27 15:34:46.749070 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:34:46.749045    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c\": container with ID starting with d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c not found: ID does not exist" containerID="d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c"
Jul 27 15:34:46.749131 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.749080    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c"} err="failed to get container status \"d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c\": rpc error: code = NotFound desc = could not find container \"d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c\": container with ID starting with d845e0895c3dd8a3591e56655f6bab09ef2469c509d293452632664c7b65a94c not found: ID does not exist"
Jul 27 15:34:46.750246 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.750228    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"]
Jul 27 15:34:46.754092 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.754072    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr"]
Jul 27 15:34:46.764551 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.764529    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"]
Jul 27 15:34:46.770023 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:46.770005    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2"]
Jul 27 15:34:48.711963 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:48.711930    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22709c19-d460-4316-a57e-6054a67a9a20" path="/var/lib/kubelet/pods/22709c19-d460-4316-a57e-6054a67a9a20/volumes"
Jul 27 15:34:48.712339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:34:48.712235    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="530a631d-dddd-4ee7-baf4-461189ac3bb7" path="/var/lib/kubelet/pods/530a631d-dddd-4ee7-baf4-461189ac3bb7/volumes"
Jul 27 15:35:30.956817 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:35:30.956775    2559 controller.go:195] "Failed to update lease" err="Put \"https://aec4395a0df5348538f12988908e86f1-d9d3b76b8a75332a.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-143-164.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 27 15:35:40.957600 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:35:40.957524    2559 controller.go:195] "Failed to update lease" err="Put \"https://aec4395a0df5348538f12988908e86f1-d9d3b76b8a75332a.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-143-164.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 27 15:35:50.957897 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:35:50.957857    2559 controller.go:195] "Failed to update lease" err="Put \"https://aec4395a0df5348538f12988908e86f1-d9d3b76b8a75332a.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-143-164.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 27 15:35:55.610250 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610207    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610250 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610234    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nwjd9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610263    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610275    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610282    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610300    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-spr6f\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610308    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610344    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610349    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610296    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610280    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610305    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610383    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610390    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vmcsb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610398    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610402    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gm8w7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610414    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610427    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610449    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.610779 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610462    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nxml9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610465    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-plp5z\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610478    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610516    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610526    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2bzfc\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610533    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mnxpm\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610552    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610568    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610570    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610573    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610577    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610592    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c828q\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610596    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vw8rk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610596    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tlwvv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610611    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610626    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610633    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610643    2559 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.611763 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610648    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610659    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610664    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610670    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rwmd4\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610692    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610694    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610705    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xgplx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610725    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610753    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610755    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:35:55.610762    2559 controller.go:195] "Failed to update lease" err="Put \"https://aec4395a0df5348538f12988908e86f1-d9d3b76b8a75332a.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-143-164.ec2.internal?timeout=10s\": http2: client connection lost"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610769    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610757    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610786    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-srgx6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610801    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610827    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610832    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-j8sm5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610830    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610848    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-t2gzn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610867    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610887    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610898    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610914    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2c97b\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610913    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ztn6x\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610943    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610954    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sz6gt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610973    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.610994    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611011    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611016    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611046    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gbpvp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611047    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-45fq9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611079    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611083    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gphkj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611081    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g4xvv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611103    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.612795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611111    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611117    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611127    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611127    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vwsgk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611142    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zc6mm\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611153    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611161    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611166    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611171    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611187    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkhzc\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611198    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611202    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611188    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611200    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611218    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611165    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611230    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mw646\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611215    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613299 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611167    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611189    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611257    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"default-dockercfg-j4bbm\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611241    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611230    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611254    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611280    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611283    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1ulafhn8f6h8k\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611259    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611302    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611302    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611337    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611282    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611346    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611358    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611365    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611373    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611377    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.613829 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611384    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611347    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611363    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-chjkj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611402    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611406    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611411    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611415    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611423    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jg9r5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611427    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611434    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611441    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611452    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611460    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611463    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611447    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611463    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611477    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611448    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gnz8v\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611471    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614835 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611476    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614835 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611511    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:55.614835 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:55.611462    2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 15:35:56.414792 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.414771    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 15:35:56.420521 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.420499    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 15:35:56.424720 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.424703    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nxml9\""
Jul 27 15:35:56.440239 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.440221    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 15:35:56.440297 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.440272    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 15:35:56.441033 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.441018    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gm8w7\""
Jul 27 15:35:56.454511 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.454494    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 15:35:56.455491 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.455470    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xgplx\""
Jul 27 15:35:56.488473 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.488458    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 15:35:56.490679 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.490665    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-45fq9\""
Jul 27 15:35:56.495894 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.495881    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 15:35:56.515756 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.515736    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 15:35:56.515892 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.515877    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 15:35:56.516546 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.516532    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 15:35:56.519728 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.519710    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 15:35:56.520193 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.520182    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 15:35:56.521891 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.521876    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1ulafhn8f6h8k\""
Jul 27 15:35:56.523412 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.523394    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 15:35:56.525373 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.525360    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 15:35:56.525966 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.525953    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sz6gt\""
Jul 27 15:35:56.526009 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.525968    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:35:56.553062 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.553046    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 15:35:56.561860 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.561843    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 15:35:56.568584 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.568566    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 15:35:56.585130 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.585114    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 15:35:56.591920 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.591906    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 15:35:56.597344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.597331    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 15:35:56.608575 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.608553    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 15:35:56.608870 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.608856    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 15:35:56.619955 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.619939    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 15:35:56.620198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.619984    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-t2gzn\""
Jul 27 15:35:56.621715 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.621702    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 15:35:56.621846 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.621830    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 15:35:56.624215 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.624201    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 15:35:56.633218 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.633202    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 15:35:56.633428 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.633415    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2bzfc\""
Jul 27 15:35:56.674888 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.674833    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 15:35:56.679334 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.679306    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:35:56.682843 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.682829    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 15:35:56.709382 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.709361    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 15:35:56.716576 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.716560    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 15:35:56.716966 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.716948    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 15:35:56.720164 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.720146    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vw8rk\""
Jul 27 15:35:56.722510 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.722493    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 15:35:56.735781 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.735758    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 15:35:56.748212 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.748190    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 15:35:56.753493 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.753467    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-spr6f\""
Jul 27 15:35:56.773856 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.773838    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 27 15:35:56.781559 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.781542    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 15:35:56.788035 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.788023    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 15:35:56.790008 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.789994    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2c97b\""
Jul 27 15:35:56.795350 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.795336    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rwmd4\""
Jul 27 15:35:56.797866 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.797854    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 15:35:56.799168 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.799155    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 15:35:56.801203 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.801190    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jg9r5\""
Jul 27 15:35:56.806012 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.805995    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 15:35:56.806108 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.806013    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 15:35:56.812634 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.811734    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6","openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"]
Jul 27 15:35:56.812634 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.812408    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22709c19-d460-4316-a57e-6054a67a9a20" containerName="payload-pre-processing"
Jul 27 15:35:56.812634 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.812424    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="22709c19-d460-4316-a57e-6054a67a9a20" containerName="payload-pre-processing"
Jul 27 15:35:56.812634 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.812458    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530a631d-dddd-4ee7-baf4-461189ac3bb7" containerName="payload-processing"
Jul 27 15:35:56.812634 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.812466    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="530a631d-dddd-4ee7-baf4-461189ac3bb7" containerName="payload-processing"
Jul 27 15:35:56.812889 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.812652    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="22709c19-d460-4316-a57e-6054a67a9a20" containerName="payload-pre-processing"
Jul 27 15:35:56.812889 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.812700    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="530a631d-dddd-4ee7-baf4-461189ac3bb7" containerName="payload-processing"
Jul 27 15:35:56.815394 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.815375    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 15:35:56.816984 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.816970    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:35:56.817548 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.817533    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 15:35:56.817668 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.817652    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"
Jul 27 15:35:56.820060 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.820042    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-58d49f55-dockercfg-tv6zz\""
Jul 27 15:35:56.820156 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.820115    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-58d49f55\""
Jul 27 15:35:56.820581 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.820566    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"
Jul 27 15:35:56.827573 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.827552    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 15:35:56.827649 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.827603    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 15:35:56.827782 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.827770    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 15:35:56.830544 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.830526    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 15:35:56.840184 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.840163    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 15:35:56.841443 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.841430    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 15:35:56.845651 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.845636    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 15:35:56.846767 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.846749    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mnxpm\""
Jul 27 15:35:56.851060 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.851045    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c828q\""
Jul 27 15:35:56.856896 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.856881    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:35:56.857679 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.857665    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 15:35:56.862986 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.862971    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 15:35:56.863898 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.863885    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 15:35:56.869431 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.869418    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 15:35:56.874596 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.874583    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 15:35:56.877768 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.877753    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gbpvp\""
Jul 27 15:35:56.883033 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.883018    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 15:35:56.883951 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.883938    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 15:35:56.885442 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.885423    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 15:35:56.895001 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.894987    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 15:35:56.896977 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.896964    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 15:35:56.902492 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.902471    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 15:35:56.902562 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.902550    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vmcsb\""
Jul 27 15:35:56.921045 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.921028    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 15:35:56.923014 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.923001    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j4bbm\""
Jul 27 15:35:56.929589 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.929552    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 15:35:56.931711 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.931697    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vwsgk\""
Jul 27 15:35:56.936003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.935989    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 15:35:56.940197 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.940185    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 15:35:56.953993 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.953974    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 15:35:56.967162 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.967147    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tlwvv\""
Jul 27 15:35:56.970466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.970453    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 15:35:56.972387 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.972374    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 15:35:56.975765 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.975750    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6783b018-a18a-4c80-906c-50cb7986b9a9-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858\" (UID: \"6783b018-a18a-4c80-906c-50cb7986b9a9\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"
Jul 27 15:35:56.975765 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.975753    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkhzc\""
Jul 27 15:35:56.975853 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.975783    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4brv\" (UniqueName: \"kubernetes.io/projected/acea29b4-aa94-4200-b630-3e431d073ef8-kube-api-access-g4brv\") pod \"payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6\" (UID: \"acea29b4-aa94-4200-b630-3e431d073ef8\") " pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"
Jul 27 15:35:56.975853 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.975836    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acea29b4-aa94-4200-b630-3e431d073ef8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6\" (UID: \"acea29b4-aa94-4200-b630-3e431d073ef8\") " pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"
Jul 27 15:35:56.975933 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.975866    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlfbj\" (UniqueName: \"kubernetes.io/projected/6783b018-a18a-4c80-906c-50cb7986b9a9-kube-api-access-tlfbj\") pod \"payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858\" (UID: \"6783b018-a18a-4c80-906c-50cb7986b9a9\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"
Jul 27 15:35:56.976765 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.976753    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:35:56.991370 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.991351    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 15:35:56.991459 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.991395    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mw646\""
Jul 27 15:35:56.999061 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:56.999036    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 15:35:57.017039 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.017018    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ztn6x\""
Jul 27 15:35:57.019348 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.019310    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 15:35:57.028638 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.028624    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 15:35:57.064735 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.064717    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 15:35:57.064849 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.064834    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-chjkj\""
Jul 27 15:35:57.070744 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.070728    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 15:35:57.076195 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.076179    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6783b018-a18a-4c80-906c-50cb7986b9a9-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858\" (UID: \"6783b018-a18a-4c80-906c-50cb7986b9a9\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"
Jul 27 15:35:57.076282 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.076205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4brv\" (UniqueName: \"kubernetes.io/projected/acea29b4-aa94-4200-b630-3e431d073ef8-kube-api-access-g4brv\") pod \"payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6\" (UID: \"acea29b4-aa94-4200-b630-3e431d073ef8\") " pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"
Jul 27 15:35:57.076282 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.076244    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acea29b4-aa94-4200-b630-3e431d073ef8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6\" (UID: \"acea29b4-aa94-4200-b630-3e431d073ef8\") " pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"
Jul 27 15:35:57.076282 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.076272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfbj\" (UniqueName: \"kubernetes.io/projected/6783b018-a18a-4c80-906c-50cb7986b9a9-kube-api-access-tlfbj\") pod \"payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858\" (UID: \"6783b018-a18a-4c80-906c-50cb7986b9a9\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"
Jul 27 15:35:57.076889 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.076869    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6783b018-a18a-4c80-906c-50cb7986b9a9-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858\" (UID: \"6783b018-a18a-4c80-906c-50cb7986b9a9\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"
Jul 27 15:35:57.077013 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.076917    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acea29b4-aa94-4200-b630-3e431d073ef8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6\" (UID: \"acea29b4-aa94-4200-b630-3e431d073ef8\") " pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"
Jul 27 15:35:57.077165 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.077149    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 15:35:57.084615 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.084595    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4brv\" (UniqueName: \"kubernetes.io/projected/acea29b4-aa94-4200-b630-3e431d073ef8-kube-api-access-g4brv\") pod \"payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6\" (UID: \"acea29b4-aa94-4200-b630-3e431d073ef8\") " pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"
Jul 27 15:35:57.084709 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.084652    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlfbj\" (UniqueName: \"kubernetes.io/projected/6783b018-a18a-4c80-906c-50cb7986b9a9-kube-api-access-tlfbj\") pod \"payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858\" (UID: \"6783b018-a18a-4c80-906c-50cb7986b9a9\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"
Jul 27 15:35:57.092748 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.092726    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-plp5z\""
Jul 27 15:35:57.095014 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.094999    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-j8sm5\""
Jul 27 15:35:57.098282 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.098269    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 15:35:57.099155 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.099141    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 27 15:35:57.100395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.100381    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 15:35:57.101017 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.101002    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-srgx6\""
Jul 27 15:35:57.108919 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.108900    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 15:35:57.118615 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.118599    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 15:35:57.119475 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.119462    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 15:35:57.121764 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.121750    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zc6mm\""
Jul 27 15:35:57.121822 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.121750    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 15:35:57.128068 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.128054    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"
Jul 27 15:35:57.134940 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.134926    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"
Jul 27 15:35:57.141187 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.141145    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:35:57.149704 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.149668    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nwjd9\""
Jul 27 15:35:57.151974 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.151958    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:35:57.152906 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.152889    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 15:35:57.166510 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.166491    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gphkj\""
Jul 27 15:35:57.172178 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.172135    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g4xvv\""
Jul 27 15:35:57.176354 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.176311    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 15:35:57.177850 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.177833    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 15:35:57.181770 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.181726    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 15:35:57.203115 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.203095    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 15:35:57.205459 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.205446    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 15:35:57.209724 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.209705    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:35:57.209808 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.209755    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 15:35:57.210722 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:57.210709    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gnz8v\""
Jul 27 15:35:58.680917 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:58.680841    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"]
Jul 27 15:35:58.685220 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:58.685195    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"]
Jul 27 15:35:58.939946 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:35:58.939904    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6783b018_a18a_4c80_906c_50cb7986b9a9.slice/crio-dea4f5e7c077c18f6e38c9264217c15d7874279b14e49d228e9da47e757e5619 WatchSource:0}: Error finding container dea4f5e7c077c18f6e38c9264217c15d7874279b14e49d228e9da47e757e5619: Status 404 returned error can't find the container with id dea4f5e7c077c18f6e38c9264217c15d7874279b14e49d228e9da47e757e5619
Jul 27 15:35:58.939946 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:58.939935    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"]
Jul 27 15:35:59.079156 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:59.079130    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858" event={"ID":"6783b018-a18a-4c80-906c-50cb7986b9a9","Type":"ContainerStarted","Data":"1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772"}
Jul 27 15:35:59.079272 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:59.079177    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858" event={"ID":"6783b018-a18a-4c80-906c-50cb7986b9a9","Type":"ContainerStarted","Data":"dea4f5e7c077c18f6e38c9264217c15d7874279b14e49d228e9da47e757e5619"}
Jul 27 15:35:59.079272 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:59.079221    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"
Jul 27 15:35:59.096057 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:59.096015    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858" podStartSLOduration=20.096003044 podStartE2EDuration="20.096003044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:35:59.095221298 +0000 UTC m=+1814.959799175" watchObservedRunningTime="2026-07-27 15:35:59.096003044 +0000 UTC m=+1814.960580909"
Jul 27 15:35:59.126064 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:35:59.126035    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacea29b4_aa94_4200_b630_3e431d073ef8.slice/crio-6ba04fab3bf266f3ceee1f51d3b03eeda1f29b163cc2e0b9c9e5cf84a75292c2 WatchSource:0}: Error finding container 6ba04fab3bf266f3ceee1f51d3b03eeda1f29b163cc2e0b9c9e5cf84a75292c2: Status 404 returned error can't find the container with id 6ba04fab3bf266f3ceee1f51d3b03eeda1f29b163cc2e0b9c9e5cf84a75292c2
Jul 27 15:35:59.126178 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:35:59.126068    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"]
Jul 27 15:36:00.085174 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:00.085143    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6" event={"ID":"acea29b4-aa94-4200-b630-3e431d073ef8","Type":"ContainerStarted","Data":"31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091"}
Jul 27 15:36:00.085174 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:00.085193    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6" event={"ID":"acea29b4-aa94-4200-b630-3e431d073ef8","Type":"ContainerStarted","Data":"6ba04fab3bf266f3ceee1f51d3b03eeda1f29b163cc2e0b9c9e5cf84a75292c2"}
Jul 27 15:36:00.085611 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:00.085360    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"
Jul 27 15:36:00.102411 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:00.102360    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6" podStartSLOduration=21.102347211 podStartE2EDuration="21.102347211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:36:00.101673014 +0000 UTC m=+1815.966250882" watchObservedRunningTime="2026-07-27 15:36:00.102347211 +0000 UTC m=+1815.966925073"
Jul 27 15:36:10.087098 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:10.087064    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"
Jul 27 15:36:11.091084 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:11.091059    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"
Jul 27 15:36:13.861360 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:13.861310    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"]
Jul 27 15:36:13.862133 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:13.862075    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6" podUID="acea29b4-aa94-4200-b630-3e431d073ef8" containerName="payload-processing" containerID="cri-o://31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091" gracePeriod=30
Jul 27 15:36:13.864856 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:13.864835    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"]
Jul 27 15:36:13.865045 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:13.865018    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858" podUID="6783b018-a18a-4c80-906c-50cb7986b9a9" containerName="payload-pre-processing" containerID="cri-o://1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772" gracePeriod=30
Jul 27 15:36:14.136077 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.136054    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"
Jul 27 15:36:14.138014 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.137996    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"
Jul 27 15:36:14.159796 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.159771    2559 generic.go:356] "Generic (PLEG): container finished" podID="6783b018-a18a-4c80-906c-50cb7986b9a9" containerID="1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772" exitCode=0
Jul 27 15:36:14.159901 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.159799    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"
Jul 27 15:36:14.159901 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.159889    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858" event={"ID":"6783b018-a18a-4c80-906c-50cb7986b9a9","Type":"ContainerDied","Data":"1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772"}
Jul 27 15:36:14.159993 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.159932    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858" event={"ID":"6783b018-a18a-4c80-906c-50cb7986b9a9","Type":"ContainerDied","Data":"dea4f5e7c077c18f6e38c9264217c15d7874279b14e49d228e9da47e757e5619"}
Jul 27 15:36:14.159993 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.159955    2559 scope.go:117] "RemoveContainer" containerID="1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772"
Jul 27 15:36:14.161175 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.161156    2559 generic.go:356] "Generic (PLEG): container finished" podID="acea29b4-aa94-4200-b630-3e431d073ef8" containerID="31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091" exitCode=0
Jul 27 15:36:14.161256 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.161188    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"
Jul 27 15:36:14.161256 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.161196    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6" event={"ID":"acea29b4-aa94-4200-b630-3e431d073ef8","Type":"ContainerDied","Data":"31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091"}
Jul 27 15:36:14.161256 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.161222    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6" event={"ID":"acea29b4-aa94-4200-b630-3e431d073ef8","Type":"ContainerDied","Data":"6ba04fab3bf266f3ceee1f51d3b03eeda1f29b163cc2e0b9c9e5cf84a75292c2"}
Jul 27 15:36:14.169173 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.169156    2559 scope.go:117] "RemoveContainer" containerID="1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772"
Jul 27 15:36:14.169482 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:36:14.169450    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772\": container with ID starting with 1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772 not found: ID does not exist" containerID="1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772"
Jul 27 15:36:14.169577 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.169493    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772"} err="failed to get container status \"1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772\": rpc error: code = NotFound desc = could not find container \"1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772\": container with ID starting with 1326bc832b14521753a1c0de25b756f098dae1263d91e78aaebe64014fcb1772 not found: ID does not exist"
Jul 27 15:36:14.169577 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.169514    2559 scope.go:117] "RemoveContainer" containerID="31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091"
Jul 27 15:36:14.184940 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.184917    2559 scope.go:117] "RemoveContainer" containerID="31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091"
Jul 27 15:36:14.185213 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:36:14.185196    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091\": container with ID starting with 31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091 not found: ID does not exist" containerID="31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091"
Jul 27 15:36:14.185266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.185219    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091"} err="failed to get container status \"31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091\": rpc error: code = NotFound desc = could not find container \"31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091\": container with ID starting with 31716bf8bbc7c33e78a96290958ae4f00689bc6336a0f3fb4653558a794fe091 not found: ID does not exist"
Jul 27 15:36:14.304479 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.304458    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlfbj\" (UniqueName: \"kubernetes.io/projected/6783b018-a18a-4c80-906c-50cb7986b9a9-kube-api-access-tlfbj\") pod \"6783b018-a18a-4c80-906c-50cb7986b9a9\" (UID: \"6783b018-a18a-4c80-906c-50cb7986b9a9\") "
Jul 27 15:36:14.304585 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.304530    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4brv\" (UniqueName: \"kubernetes.io/projected/acea29b4-aa94-4200-b630-3e431d073ef8-kube-api-access-g4brv\") pod \"acea29b4-aa94-4200-b630-3e431d073ef8\" (UID: \"acea29b4-aa94-4200-b630-3e431d073ef8\") "
Jul 27 15:36:14.304585 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.304565    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acea29b4-aa94-4200-b630-3e431d073ef8-plugins-config-volume\") pod \"acea29b4-aa94-4200-b630-3e431d073ef8\" (UID: \"acea29b4-aa94-4200-b630-3e431d073ef8\") "
Jul 27 15:36:14.304666 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.304590    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6783b018-a18a-4c80-906c-50cb7986b9a9-plugins-config-volume\") pod \"6783b018-a18a-4c80-906c-50cb7986b9a9\" (UID: \"6783b018-a18a-4c80-906c-50cb7986b9a9\") "
Jul 27 15:36:14.304977 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.304949    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6783b018-a18a-4c80-906c-50cb7986b9a9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6783b018-a18a-4c80-906c-50cb7986b9a9" (UID: "6783b018-a18a-4c80-906c-50cb7986b9a9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:36:14.304977 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.304967    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acea29b4-aa94-4200-b630-3e431d073ef8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "acea29b4-aa94-4200-b630-3e431d073ef8" (UID: "acea29b4-aa94-4200-b630-3e431d073ef8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:36:14.306816 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.306791    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acea29b4-aa94-4200-b630-3e431d073ef8-kube-api-access-g4brv" (OuterVolumeSpecName: "kube-api-access-g4brv") pod "acea29b4-aa94-4200-b630-3e431d073ef8" (UID: "acea29b4-aa94-4200-b630-3e431d073ef8"). InnerVolumeSpecName "kube-api-access-g4brv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:36:14.306912 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.306845    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6783b018-a18a-4c80-906c-50cb7986b9a9-kube-api-access-tlfbj" (OuterVolumeSpecName: "kube-api-access-tlfbj") pod "6783b018-a18a-4c80-906c-50cb7986b9a9" (UID: "6783b018-a18a-4c80-906c-50cb7986b9a9"). InnerVolumeSpecName "kube-api-access-tlfbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:36:14.406016 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.405945    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4brv\" (UniqueName: \"kubernetes.io/projected/acea29b4-aa94-4200-b630-3e431d073ef8-kube-api-access-g4brv\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:36:14.406016 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.405971    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acea29b4-aa94-4200-b630-3e431d073ef8-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:36:14.406016 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.405981    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6783b018-a18a-4c80-906c-50cb7986b9a9-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:36:14.406016 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.405989    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlfbj\" (UniqueName: \"kubernetes.io/projected/6783b018-a18a-4c80-906c-50cb7986b9a9-kube-api-access-tlfbj\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:36:14.483472 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.483446    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"]
Jul 27 15:36:14.485908 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.485889    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858"]
Jul 27 15:36:14.495354 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.495332    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"]
Jul 27 15:36:14.499191 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.499170    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6"]
Jul 27 15:36:14.711898 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.711874    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6783b018-a18a-4c80-906c-50cb7986b9a9" path="/var/lib/kubelet/pods/6783b018-a18a-4c80-906c-50cb7986b9a9/volumes"
Jul 27 15:36:14.712189 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:14.712177    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acea29b4-aa94-4200-b630-3e431d073ef8" path="/var/lib/kubelet/pods/acea29b4-aa94-4200-b630-3e431d073ef8/volumes"
Jul 27 15:36:32.543433 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.543393    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"]
Jul 27 15:36:32.543797 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.543744    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acea29b4-aa94-4200-b630-3e431d073ef8" containerName="payload-processing"
Jul 27 15:36:32.543797 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.543756    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="acea29b4-aa94-4200-b630-3e431d073ef8" containerName="payload-processing"
Jul 27 15:36:32.543797 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.543766    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6783b018-a18a-4c80-906c-50cb7986b9a9" containerName="payload-pre-processing"
Jul 27 15:36:32.543797 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.543771    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6783b018-a18a-4c80-906c-50cb7986b9a9" containerName="payload-pre-processing"
Jul 27 15:36:32.543925 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.543821    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6783b018-a18a-4c80-906c-50cb7986b9a9" containerName="payload-pre-processing"
Jul 27 15:36:32.543925 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.543830    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="acea29b4-aa94-4200-b630-3e431d073ef8" containerName="payload-processing"
Jul 27 15:36:32.546795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.546779    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"
Jul 27 15:36:32.549505 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.549482    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-3af40866\""
Jul 27 15:36:32.549632 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.549609    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-3af40866-dockercfg-8gn82\""
Jul 27 15:36:32.556515 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.556494    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"]
Jul 27 15:36:32.624131 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.624105    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09660e0-d85c-456c-8303-339ecf4eba00-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd\" (UID: \"c09660e0-d85c-456c-8303-339ecf4eba00\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"
Jul 27 15:36:32.624246 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.624228    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfnl4\" (UniqueName: \"kubernetes.io/projected/c09660e0-d85c-456c-8303-339ecf4eba00-kube-api-access-sfnl4\") pod \"payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd\" (UID: \"c09660e0-d85c-456c-8303-339ecf4eba00\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"
Jul 27 15:36:32.724803 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.724781    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09660e0-d85c-456c-8303-339ecf4eba00-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd\" (UID: \"c09660e0-d85c-456c-8303-339ecf4eba00\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"
Jul 27 15:36:32.725061 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.725040    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfnl4\" (UniqueName: \"kubernetes.io/projected/c09660e0-d85c-456c-8303-339ecf4eba00-kube-api-access-sfnl4\") pod \"payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd\" (UID: \"c09660e0-d85c-456c-8303-339ecf4eba00\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"
Jul 27 15:36:32.725444 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.725426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09660e0-d85c-456c-8303-339ecf4eba00-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd\" (UID: \"c09660e0-d85c-456c-8303-339ecf4eba00\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"
Jul 27 15:36:32.736739 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.736718    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfnl4\" (UniqueName: \"kubernetes.io/projected/c09660e0-d85c-456c-8303-339ecf4eba00-kube-api-access-sfnl4\") pod \"payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd\" (UID: \"c09660e0-d85c-456c-8303-339ecf4eba00\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"
Jul 27 15:36:32.857669 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.857619    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"
Jul 27 15:36:32.993788 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:32.991057    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"]
Jul 27 15:36:33.257367 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:33.257340    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd" event={"ID":"c09660e0-d85c-456c-8303-339ecf4eba00","Type":"ContainerStarted","Data":"561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4"}
Jul 27 15:36:33.257513 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:33.257390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd" event={"ID":"c09660e0-d85c-456c-8303-339ecf4eba00","Type":"ContainerStarted","Data":"7cae0a0fac484b0bfd3e91ade9024f520b3936ebc02cf982dcfd6161d91cac10"}
Jul 27 15:36:33.257513 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:33.257415    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"
Jul 27 15:36:33.275642 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:33.275600    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd" podStartSLOduration=1.275585296 podStartE2EDuration="1.275585296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:36:33.274651661 +0000 UTC m=+1849.139229527" watchObservedRunningTime="2026-07-27 15:36:33.275585296 +0000 UTC m=+1849.140163162"
Jul 27 15:36:44.263610 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:44.263570    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd" podUID="c09660e0-d85c-456c-8303-339ecf4eba00" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.45:9004: connect: connection refused"
Jul 27 15:36:54.264007 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:36:54.263975    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"
Jul 27 15:37:07.909459 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:07.909381    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"]
Jul 27 15:37:07.909861 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:07.909612    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd" podUID="c09660e0-d85c-456c-8303-339ecf4eba00" containerName="payload-pre-processing" containerID="cri-o://561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4" gracePeriod=30
Jul 27 15:37:08.143581 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.143557    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"
Jul 27 15:37:08.188344 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.188285    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfnl4\" (UniqueName: \"kubernetes.io/projected/c09660e0-d85c-456c-8303-339ecf4eba00-kube-api-access-sfnl4\") pod \"c09660e0-d85c-456c-8303-339ecf4eba00\" (UID: \"c09660e0-d85c-456c-8303-339ecf4eba00\") "
Jul 27 15:37:08.188558 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.188357    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09660e0-d85c-456c-8303-339ecf4eba00-plugins-config-volume\") pod \"c09660e0-d85c-456c-8303-339ecf4eba00\" (UID: \"c09660e0-d85c-456c-8303-339ecf4eba00\") "
Jul 27 15:37:08.188734 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.188699    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c09660e0-d85c-456c-8303-339ecf4eba00-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c09660e0-d85c-456c-8303-339ecf4eba00" (UID: "c09660e0-d85c-456c-8303-339ecf4eba00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:37:08.190575 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.190550    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c09660e0-d85c-456c-8303-339ecf4eba00-kube-api-access-sfnl4" (OuterVolumeSpecName: "kube-api-access-sfnl4") pod "c09660e0-d85c-456c-8303-339ecf4eba00" (UID: "c09660e0-d85c-456c-8303-339ecf4eba00"). InnerVolumeSpecName "kube-api-access-sfnl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:37:08.289394 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.289365    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfnl4\" (UniqueName: \"kubernetes.io/projected/c09660e0-d85c-456c-8303-339ecf4eba00-kube-api-access-sfnl4\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:37:08.289394 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.289389    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c09660e0-d85c-456c-8303-339ecf4eba00-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:37:08.420969 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.420934    2559 generic.go:356] "Generic (PLEG): container finished" podID="c09660e0-d85c-456c-8303-339ecf4eba00" containerID="561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4" exitCode=0
Jul 27 15:37:08.421096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.420999    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"
Jul 27 15:37:08.421096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.421010    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd" event={"ID":"c09660e0-d85c-456c-8303-339ecf4eba00","Type":"ContainerDied","Data":"561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4"}
Jul 27 15:37:08.421096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.421078    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd" event={"ID":"c09660e0-d85c-456c-8303-339ecf4eba00","Type":"ContainerDied","Data":"7cae0a0fac484b0bfd3e91ade9024f520b3936ebc02cf982dcfd6161d91cac10"}
Jul 27 15:37:08.421198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.421100    2559 scope.go:117] "RemoveContainer" containerID="561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4"
Jul 27 15:37:08.434656 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.434636    2559 scope.go:117] "RemoveContainer" containerID="561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4"
Jul 27 15:37:08.434931 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:37:08.434914    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4\": container with ID starting with 561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4 not found: ID does not exist" containerID="561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4"
Jul 27 15:37:08.434991 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.434942    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4"} err="failed to get container status \"561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4\": rpc error: code = NotFound desc = could not find container \"561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4\": container with ID starting with 561f6c5b3227fec357edc7dde08b0415873086387026ac0ce669d29239acf6f4 not found: ID does not exist"
Jul 27 15:37:08.451291 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.451231    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"]
Jul 27 15:37:08.457170 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.457148    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd"]
Jul 27 15:37:08.713300 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:08.713220    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c09660e0-d85c-456c-8303-339ecf4eba00" path="/var/lib/kubelet/pods/c09660e0-d85c-456c-8303-339ecf4eba00/volumes"
Jul 27 15:37:17.550727 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.550694    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"]
Jul 27 15:37:17.551097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.551028    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c09660e0-d85c-456c-8303-339ecf4eba00" containerName="payload-pre-processing"
Jul 27 15:37:17.551097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.551039    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c09660e0-d85c-456c-8303-339ecf4eba00" containerName="payload-pre-processing"
Jul 27 15:37:17.551097 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.551090    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c09660e0-d85c-456c-8303-339ecf4eba00" containerName="payload-pre-processing"
Jul 27 15:37:17.553954 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.553928    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"
Jul 27 15:37:17.556557 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.556534    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-b2ba96cb\""
Jul 27 15:37:17.567441 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.567420    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"]
Jul 27 15:37:17.670089 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.670064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca-plugins-config-volume\") pod \"payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl\" (UID: \"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca\") " pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"
Jul 27 15:37:17.670218 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.670098    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhtbs\" (UniqueName: \"kubernetes.io/projected/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca-kube-api-access-lhtbs\") pod \"payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl\" (UID: \"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca\") " pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"
Jul 27 15:37:17.770599 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.770572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca-plugins-config-volume\") pod \"payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl\" (UID: \"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca\") " pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"
Jul 27 15:37:17.770732 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.770627    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhtbs\" (UniqueName: \"kubernetes.io/projected/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca-kube-api-access-lhtbs\") pod \"payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl\" (UID: \"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca\") " pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"
Jul 27 15:37:17.771201 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.771183    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca-plugins-config-volume\") pod \"payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl\" (UID: \"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca\") " pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"
Jul 27 15:37:17.779851 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.779830    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhtbs\" (UniqueName: \"kubernetes.io/projected/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca-kube-api-access-lhtbs\") pod \"payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl\" (UID: \"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca\") " pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"
Jul 27 15:37:17.863257 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.863207    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"
Jul 27 15:37:17.992800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:17.992766    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"]
Jul 27 15:37:17.993583 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:37:17.993547    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c2abf7a_8aaa_41db_9162_6a1eb29f30ca.slice/crio-1825831b71c88f2e8ca07e3bba1088440d6f0c23ad436ab036f1b12d1a2e02a9 WatchSource:0}: Error finding container 1825831b71c88f2e8ca07e3bba1088440d6f0c23ad436ab036f1b12d1a2e02a9: Status 404 returned error can't find the container with id 1825831b71c88f2e8ca07e3bba1088440d6f0c23ad436ab036f1b12d1a2e02a9
Jul 27 15:37:18.475284 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:18.475256    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl" event={"ID":"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca","Type":"ContainerStarted","Data":"8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c"}
Jul 27 15:37:18.475451 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:18.475303    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl" event={"ID":"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca","Type":"ContainerStarted","Data":"1825831b71c88f2e8ca07e3bba1088440d6f0c23ad436ab036f1b12d1a2e02a9"}
Jul 27 15:37:18.475451 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:18.475350    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"
Jul 27 15:37:18.493943 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:18.493899    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl" podStartSLOduration=1.493885769 podStartE2EDuration="1.493885769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:37:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:37:18.491862143 +0000 UTC m=+1894.356440010" watchObservedRunningTime="2026-07-27 15:37:18.493885769 +0000 UTC m=+1894.358463639"
Jul 27 15:37:29.482329 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:29.482293    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"
Jul 27 15:37:52.024210 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.024178    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"]
Jul 27 15:37:52.024704 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.024431    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl" podUID="0c2abf7a-8aaa-41db-9162-6a1eb29f30ca" containerName="payload-processing" containerID="cri-o://8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c" gracePeriod=30
Jul 27 15:37:52.271588 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.271566    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"
Jul 27 15:37:52.330968 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.330905    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhtbs\" (UniqueName: \"kubernetes.io/projected/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca-kube-api-access-lhtbs\") pod \"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca\" (UID: \"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca\") "
Jul 27 15:37:52.331074 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.330990    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca-plugins-config-volume\") pod \"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca\" (UID: \"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca\") "
Jul 27 15:37:52.331333 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.331292    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0c2abf7a-8aaa-41db-9162-6a1eb29f30ca" (UID: "0c2abf7a-8aaa-41db-9162-6a1eb29f30ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:37:52.332926 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.332901    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca-kube-api-access-lhtbs" (OuterVolumeSpecName: "kube-api-access-lhtbs") pod "0c2abf7a-8aaa-41db-9162-6a1eb29f30ca" (UID: "0c2abf7a-8aaa-41db-9162-6a1eb29f30ca"). InnerVolumeSpecName "kube-api-access-lhtbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:37:52.431456 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.431418    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:37:52.431456 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.431457    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhtbs\" (UniqueName: \"kubernetes.io/projected/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca-kube-api-access-lhtbs\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:37:52.648789 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.648732    2559 generic.go:356] "Generic (PLEG): container finished" podID="0c2abf7a-8aaa-41db-9162-6a1eb29f30ca" containerID="8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c" exitCode=0
Jul 27 15:37:52.648789 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.648770    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"
Jul 27 15:37:52.648918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.648797    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl" event={"ID":"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca","Type":"ContainerDied","Data":"8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c"}
Jul 27 15:37:52.648918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.648843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl" event={"ID":"0c2abf7a-8aaa-41db-9162-6a1eb29f30ca","Type":"ContainerDied","Data":"1825831b71c88f2e8ca07e3bba1088440d6f0c23ad436ab036f1b12d1a2e02a9"}
Jul 27 15:37:52.648918 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.648863    2559 scope.go:117] "RemoveContainer" containerID="8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c"
Jul 27 15:37:52.657378 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.657364    2559 scope.go:117] "RemoveContainer" containerID="8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c"
Jul 27 15:37:52.657614 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:37:52.657597    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c\": container with ID starting with 8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c not found: ID does not exist" containerID="8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c"
Jul 27 15:37:52.657657 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.657622    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c"} err="failed to get container status \"8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c\": rpc error: code = NotFound desc = could not find container \"8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c\": container with ID starting with 8b9a9fb3ff61b88640237925677541ef2eb994dae77acad14c973c397b84515c not found: ID does not exist"
Jul 27 15:37:52.670996 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.670974    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"]
Jul 27 15:37:52.676891 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.676874    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl"]
Jul 27 15:37:52.712465 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:37:52.712441    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c2abf7a-8aaa-41db-9162-6a1eb29f30ca" path="/var/lib/kubelet/pods/0c2abf7a-8aaa-41db-9162-6a1eb29f30ca/volumes"
Jul 27 15:39:37.755632 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.755601    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"]
Jul 27 15:39:37.756083 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.755919    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c2abf7a-8aaa-41db-9162-6a1eb29f30ca" containerName="payload-processing"
Jul 27 15:39:37.756083 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.755929    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c2abf7a-8aaa-41db-9162-6a1eb29f30ca" containerName="payload-processing"
Jul 27 15:39:37.756083 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.755997    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c2abf7a-8aaa-41db-9162-6a1eb29f30ca" containerName="payload-processing"
Jul 27 15:39:37.758883 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.758867    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"
Jul 27 15:39:37.761641 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.761621    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-22f7c4a2\""
Jul 27 15:39:37.767849 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.767826    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"]
Jul 27 15:39:37.771437 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.771417    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"]
Jul 27 15:39:37.771537 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.771490    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"
Jul 27 15:39:37.774422 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.774398    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-22f7c4a2-dockercfg-q2c9t\""
Jul 27 15:39:37.779594 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.779571    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"]
Jul 27 15:39:37.792549 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.792529    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn64q\" (UniqueName: \"kubernetes.io/projected/3ebe9623-bed5-49a8-b81e-9e893737a234-kube-api-access-wn64q\") pod \"payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c\" (UID: \"3ebe9623-bed5-49a8-b81e-9e893737a234\") " pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"
Jul 27 15:39:37.792642 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.792567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ebe9623-bed5-49a8-b81e-9e893737a234-plugins-config-volume\") pod \"payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c\" (UID: \"3ebe9623-bed5-49a8-b81e-9e893737a234\") " pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"
Jul 27 15:39:37.893491 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.893468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn64q\" (UniqueName: \"kubernetes.io/projected/3ebe9623-bed5-49a8-b81e-9e893737a234-kube-api-access-wn64q\") pod \"payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c\" (UID: \"3ebe9623-bed5-49a8-b81e-9e893737a234\") " pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"
Jul 27 15:39:37.893592 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.893504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ebe9623-bed5-49a8-b81e-9e893737a234-plugins-config-volume\") pod \"payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c\" (UID: \"3ebe9623-bed5-49a8-b81e-9e893737a234\") " pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"
Jul 27 15:39:37.893592 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.893548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g75f\" (UniqueName: \"kubernetes.io/projected/19e0a30c-209f-49bc-a729-3a99d46c898c-kube-api-access-5g75f\") pod \"payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j\" (UID: \"19e0a30c-209f-49bc-a729-3a99d46c898c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"
Jul 27 15:39:37.893592 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.893578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19e0a30c-209f-49bc-a729-3a99d46c898c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j\" (UID: \"19e0a30c-209f-49bc-a729-3a99d46c898c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"
Jul 27 15:39:37.894179 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.894157    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ebe9623-bed5-49a8-b81e-9e893737a234-plugins-config-volume\") pod \"payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c\" (UID: \"3ebe9623-bed5-49a8-b81e-9e893737a234\") " pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"
Jul 27 15:39:37.902871 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.902852    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn64q\" (UniqueName: \"kubernetes.io/projected/3ebe9623-bed5-49a8-b81e-9e893737a234-kube-api-access-wn64q\") pod \"payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c\" (UID: \"3ebe9623-bed5-49a8-b81e-9e893737a234\") " pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"
Jul 27 15:39:37.994681 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.994656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g75f\" (UniqueName: \"kubernetes.io/projected/19e0a30c-209f-49bc-a729-3a99d46c898c-kube-api-access-5g75f\") pod \"payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j\" (UID: \"19e0a30c-209f-49bc-a729-3a99d46c898c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"
Jul 27 15:39:37.994782 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.994694    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19e0a30c-209f-49bc-a729-3a99d46c898c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j\" (UID: \"19e0a30c-209f-49bc-a729-3a99d46c898c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"
Jul 27 15:39:37.995243 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:37.995224    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19e0a30c-209f-49bc-a729-3a99d46c898c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j\" (UID: \"19e0a30c-209f-49bc-a729-3a99d46c898c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"
Jul 27 15:39:38.009697 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:38.009650    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g75f\" (UniqueName: \"kubernetes.io/projected/19e0a30c-209f-49bc-a729-3a99d46c898c-kube-api-access-5g75f\") pod \"payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j\" (UID: \"19e0a30c-209f-49bc-a729-3a99d46c898c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"
Jul 27 15:39:38.070045 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:38.070020    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"
Jul 27 15:39:38.084506 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:38.084469    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"
Jul 27 15:39:38.213732 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:38.213707    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"]
Jul 27 15:39:38.214771 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:39:38.214747    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebe9623_bed5_49a8_b81e_9e893737a234.slice/crio-a468c6d658e1f522e63830adeb5a2639df3ec2ceadd134c58bfc855af3820596 WatchSource:0}: Error finding container a468c6d658e1f522e63830adeb5a2639df3ec2ceadd134c58bfc855af3820596: Status 404 returned error can't find the container with id a468c6d658e1f522e63830adeb5a2639df3ec2ceadd134c58bfc855af3820596
Jul 27 15:39:38.441805 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:38.441779    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"]
Jul 27 15:39:38.442878 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:39:38.442850    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e0a30c_209f_49bc_a729_3a99d46c898c.slice/crio-5157e73e5fb8217734d6f7a5ad1d4f84bb4df73d08b6be7b3f0edfc38b594d72 WatchSource:0}: Error finding container 5157e73e5fb8217734d6f7a5ad1d4f84bb4df73d08b6be7b3f0edfc38b594d72: Status 404 returned error can't find the container with id 5157e73e5fb8217734d6f7a5ad1d4f84bb4df73d08b6be7b3f0edfc38b594d72
Jul 27 15:39:39.172839 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:39.172800    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j" event={"ID":"19e0a30c-209f-49bc-a729-3a99d46c898c","Type":"ContainerStarted","Data":"4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200"}
Jul 27 15:39:39.173284 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:39.172864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j" event={"ID":"19e0a30c-209f-49bc-a729-3a99d46c898c","Type":"ContainerStarted","Data":"5157e73e5fb8217734d6f7a5ad1d4f84bb4df73d08b6be7b3f0edfc38b594d72"}
Jul 27 15:39:39.173284 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:39.172891    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"
Jul 27 15:39:39.174447 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:39.174423    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c" event={"ID":"3ebe9623-bed5-49a8-b81e-9e893737a234","Type":"ContainerStarted","Data":"fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1"}
Jul 27 15:39:39.174553 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:39.174470    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c" event={"ID":"3ebe9623-bed5-49a8-b81e-9e893737a234","Type":"ContainerStarted","Data":"a468c6d658e1f522e63830adeb5a2639df3ec2ceadd134c58bfc855af3820596"}
Jul 27 15:39:39.174553 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:39.174546    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"
Jul 27 15:39:39.189798 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:39.189757    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j" podStartSLOduration=2.189745132 podStartE2EDuration="2.189745132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:39:39.187540276 +0000 UTC m=+2035.052118135" watchObservedRunningTime="2026-07-27 15:39:39.189745132 +0000 UTC m=+2035.054322998"
Jul 27 15:39:39.202570 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:39.202527    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c" podStartSLOduration=2.202513838 podStartE2EDuration="2.202513838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:39:39.202061654 +0000 UTC m=+2035.066639521" watchObservedRunningTime="2026-07-27 15:39:39.202513838 +0000 UTC m=+2035.067091750"
Jul 27 15:39:50.181471 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:50.181444    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"
Jul 27 15:39:50.181911 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:50.181709    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"
Jul 27 15:39:59.261264 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.261229    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"]
Jul 27 15:39:59.261793 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.261622    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c" podUID="3ebe9623-bed5-49a8-b81e-9e893737a234" containerName="payload-processing" containerID="cri-o://fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1" gracePeriod=30
Jul 27 15:39:59.265576 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.265551    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"]
Jul 27 15:39:59.266048 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.265961    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j" podUID="19e0a30c-209f-49bc-a729-3a99d46c898c" containerName="payload-pre-processing" containerID="cri-o://4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200" gracePeriod=30
Jul 27 15:39:59.514555 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.514497    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"
Jul 27 15:39:59.537265 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.537246    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"
Jul 27 15:39:59.650607 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.650570    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn64q\" (UniqueName: \"kubernetes.io/projected/3ebe9623-bed5-49a8-b81e-9e893737a234-kube-api-access-wn64q\") pod \"3ebe9623-bed5-49a8-b81e-9e893737a234\" (UID: \"3ebe9623-bed5-49a8-b81e-9e893737a234\") "
Jul 27 15:39:59.650718 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.650653    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g75f\" (UniqueName: \"kubernetes.io/projected/19e0a30c-209f-49bc-a729-3a99d46c898c-kube-api-access-5g75f\") pod \"19e0a30c-209f-49bc-a729-3a99d46c898c\" (UID: \"19e0a30c-209f-49bc-a729-3a99d46c898c\") "
Jul 27 15:39:59.650775 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.650755    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19e0a30c-209f-49bc-a729-3a99d46c898c-plugins-config-volume\") pod \"19e0a30c-209f-49bc-a729-3a99d46c898c\" (UID: \"19e0a30c-209f-49bc-a729-3a99d46c898c\") "
Jul 27 15:39:59.650830 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.650819    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ebe9623-bed5-49a8-b81e-9e893737a234-plugins-config-volume\") pod \"3ebe9623-bed5-49a8-b81e-9e893737a234\" (UID: \"3ebe9623-bed5-49a8-b81e-9e893737a234\") "
Jul 27 15:39:59.651141 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.651113    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ebe9623-bed5-49a8-b81e-9e893737a234-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3ebe9623-bed5-49a8-b81e-9e893737a234" (UID: "3ebe9623-bed5-49a8-b81e-9e893737a234"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:39:59.651239 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.651137    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19e0a30c-209f-49bc-a729-3a99d46c898c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "19e0a30c-209f-49bc-a729-3a99d46c898c" (UID: "19e0a30c-209f-49bc-a729-3a99d46c898c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:39:59.652675 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.652655    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19e0a30c-209f-49bc-a729-3a99d46c898c-kube-api-access-5g75f" (OuterVolumeSpecName: "kube-api-access-5g75f") pod "19e0a30c-209f-49bc-a729-3a99d46c898c" (UID: "19e0a30c-209f-49bc-a729-3a99d46c898c"). InnerVolumeSpecName "kube-api-access-5g75f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:39:59.652754 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.652702    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ebe9623-bed5-49a8-b81e-9e893737a234-kube-api-access-wn64q" (OuterVolumeSpecName: "kube-api-access-wn64q") pod "3ebe9623-bed5-49a8-b81e-9e893737a234" (UID: "3ebe9623-bed5-49a8-b81e-9e893737a234"). InnerVolumeSpecName "kube-api-access-wn64q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:39:59.751790 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.751765    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g75f\" (UniqueName: \"kubernetes.io/projected/19e0a30c-209f-49bc-a729-3a99d46c898c-kube-api-access-5g75f\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:39:59.751790 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.751790    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19e0a30c-209f-49bc-a729-3a99d46c898c-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:39:59.751917 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.751803    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ebe9623-bed5-49a8-b81e-9e893737a234-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:39:59.751917 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:39:59.751816    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn64q\" (UniqueName: \"kubernetes.io/projected/3ebe9623-bed5-49a8-b81e-9e893737a234-kube-api-access-wn64q\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:40:00.279198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.279140    2559 generic.go:356] "Generic (PLEG): container finished" podID="3ebe9623-bed5-49a8-b81e-9e893737a234" containerID="fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1" exitCode=0
Jul 27 15:40:00.279542 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.279205    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"
Jul 27 15:40:00.279542 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.279222    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c" event={"ID":"3ebe9623-bed5-49a8-b81e-9e893737a234","Type":"ContainerDied","Data":"fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1"}
Jul 27 15:40:00.279542 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.279269    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c" event={"ID":"3ebe9623-bed5-49a8-b81e-9e893737a234","Type":"ContainerDied","Data":"a468c6d658e1f522e63830adeb5a2639df3ec2ceadd134c58bfc855af3820596"}
Jul 27 15:40:00.279542 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.279293    2559 scope.go:117] "RemoveContainer" containerID="fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1"
Jul 27 15:40:00.281142 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.281123    2559 generic.go:356] "Generic (PLEG): container finished" podID="19e0a30c-209f-49bc-a729-3a99d46c898c" containerID="4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200" exitCode=0
Jul 27 15:40:00.281223 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.281164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j" event={"ID":"19e0a30c-209f-49bc-a729-3a99d46c898c","Type":"ContainerDied","Data":"4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200"}
Jul 27 15:40:00.281223 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.281199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j" event={"ID":"19e0a30c-209f-49bc-a729-3a99d46c898c","Type":"ContainerDied","Data":"5157e73e5fb8217734d6f7a5ad1d4f84bb4df73d08b6be7b3f0edfc38b594d72"}
Jul 27 15:40:00.281389 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.281222    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"
Jul 27 15:40:00.290334 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.290297    2559 scope.go:117] "RemoveContainer" containerID="fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1"
Jul 27 15:40:00.290666 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:40:00.290638    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1\": container with ID starting with fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1 not found: ID does not exist" containerID="fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1"
Jul 27 15:40:00.290758 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.290686    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1"} err="failed to get container status \"fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1\": rpc error: code = NotFound desc = could not find container \"fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1\": container with ID starting with fddb7cb49b49b12dcd57bc53041f462278250578aa170f4e8d75a51e462b41d1 not found: ID does not exist"
Jul 27 15:40:00.290758 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.290707    2559 scope.go:117] "RemoveContainer" containerID="4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200"
Jul 27 15:40:00.300753 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.300727    2559 scope.go:117] "RemoveContainer" containerID="4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200"
Jul 27 15:40:00.301131 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:40:00.301081    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200\": container with ID starting with 4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200 not found: ID does not exist" containerID="4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200"
Jul 27 15:40:00.301229 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.301131    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200"} err="failed to get container status \"4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200\": rpc error: code = NotFound desc = could not find container \"4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200\": container with ID starting with 4f44ee472a9802a005b715900a04b45c7f6e00bbbd9c43e43ecb2a3bbf8fc200 not found: ID does not exist"
Jul 27 15:40:00.304938 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.304916    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"]
Jul 27 15:40:00.309187 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.309165    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c"]
Jul 27 15:40:00.320191 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.320168    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"]
Jul 27 15:40:00.324234 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.324215    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j"]
Jul 27 15:40:00.711536 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.711507    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19e0a30c-209f-49bc-a729-3a99d46c898c" path="/var/lib/kubelet/pods/19e0a30c-209f-49bc-a729-3a99d46c898c/volumes"
Jul 27 15:40:00.711896 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:00.711877    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ebe9623-bed5-49a8-b81e-9e893737a234" path="/var/lib/kubelet/pods/3ebe9623-bed5-49a8-b81e-9e893737a234/volumes"
Jul 27 15:40:35.349216 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.349182    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"]
Jul 27 15:40:35.349667 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.349579    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ebe9623-bed5-49a8-b81e-9e893737a234" containerName="payload-processing"
Jul 27 15:40:35.349667 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.349592    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ebe9623-bed5-49a8-b81e-9e893737a234" containerName="payload-processing"
Jul 27 15:40:35.349667 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.349610    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19e0a30c-209f-49bc-a729-3a99d46c898c" containerName="payload-pre-processing"
Jul 27 15:40:35.349667 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.349617    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="19e0a30c-209f-49bc-a729-3a99d46c898c" containerName="payload-pre-processing"
Jul 27 15:40:35.349800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.349676    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ebe9623-bed5-49a8-b81e-9e893737a234" containerName="payload-processing"
Jul 27 15:40:35.349800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.349687    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="19e0a30c-209f-49bc-a729-3a99d46c898c" containerName="payload-pre-processing"
Jul 27 15:40:35.352770 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.352755    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"
Jul 27 15:40:35.356654 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.356634    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-44b2dff2\""
Jul 27 15:40:35.356803 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.356710    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-44b2dff2-dockercfg-s5z2s\""
Jul 27 15:40:35.363926 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.363905    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"]
Jul 27 15:40:35.433141 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.433112    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"]
Jul 27 15:40:35.436508 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.436489    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"
Jul 27 15:40:35.446753 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.446724    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"]
Jul 27 15:40:35.502230 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.502197    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85686\" (UniqueName: \"kubernetes.io/projected/19c0b160-1f51-405e-80b4-13912721cbd3-kube-api-access-85686\") pod \"payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p\" (UID: \"19c0b160-1f51-405e-80b4-13912721cbd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"
Jul 27 15:40:35.502413 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.502287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19c0b160-1f51-405e-80b4-13912721cbd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p\" (UID: \"19c0b160-1f51-405e-80b4-13912721cbd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"
Jul 27 15:40:35.603573 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.603484    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb6jb\" (UniqueName: \"kubernetes.io/projected/d234c5c0-f1c9-40bd-ac89-2877b970abbe-kube-api-access-qb6jb\") pod \"payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4\" (UID: \"d234c5c0-f1c9-40bd-ac89-2877b970abbe\") " pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"
Jul 27 15:40:35.603573 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.603548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19c0b160-1f51-405e-80b4-13912721cbd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p\" (UID: \"19c0b160-1f51-405e-80b4-13912721cbd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"
Jul 27 15:40:35.603735 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.603582    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d234c5c0-f1c9-40bd-ac89-2877b970abbe-plugins-config-volume\") pod \"payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4\" (UID: \"d234c5c0-f1c9-40bd-ac89-2877b970abbe\") " pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"
Jul 27 15:40:35.603735 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.603685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85686\" (UniqueName: \"kubernetes.io/projected/19c0b160-1f51-405e-80b4-13912721cbd3-kube-api-access-85686\") pod \"payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p\" (UID: \"19c0b160-1f51-405e-80b4-13912721cbd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"
Jul 27 15:40:35.604181 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.604163    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19c0b160-1f51-405e-80b4-13912721cbd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p\" (UID: \"19c0b160-1f51-405e-80b4-13912721cbd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"
Jul 27 15:40:35.612951 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.612930    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85686\" (UniqueName: \"kubernetes.io/projected/19c0b160-1f51-405e-80b4-13912721cbd3-kube-api-access-85686\") pod \"payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p\" (UID: \"19c0b160-1f51-405e-80b4-13912721cbd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"
Jul 27 15:40:35.664083 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.664049    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"
Jul 27 15:40:35.705052 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.705023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb6jb\" (UniqueName: \"kubernetes.io/projected/d234c5c0-f1c9-40bd-ac89-2877b970abbe-kube-api-access-qb6jb\") pod \"payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4\" (UID: \"d234c5c0-f1c9-40bd-ac89-2877b970abbe\") " pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"
Jul 27 15:40:35.705189 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.705069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d234c5c0-f1c9-40bd-ac89-2877b970abbe-plugins-config-volume\") pod \"payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4\" (UID: \"d234c5c0-f1c9-40bd-ac89-2877b970abbe\") " pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"
Jul 27 15:40:35.705675 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.705658    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d234c5c0-f1c9-40bd-ac89-2877b970abbe-plugins-config-volume\") pod \"payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4\" (UID: \"d234c5c0-f1c9-40bd-ac89-2877b970abbe\") " pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"
Jul 27 15:40:35.716137 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.716103    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb6jb\" (UniqueName: \"kubernetes.io/projected/d234c5c0-f1c9-40bd-ac89-2877b970abbe-kube-api-access-qb6jb\") pod \"payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4\" (UID: \"d234c5c0-f1c9-40bd-ac89-2877b970abbe\") " pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"
Jul 27 15:40:35.747725 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.747688    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"
Jul 27 15:40:35.795695 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.795664    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"]
Jul 27 15:40:35.797723 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:40:35.797680    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c0b160_1f51_405e_80b4_13912721cbd3.slice/crio-3eab2344c7155dd0102d52ff2ab6e2d2535d5b3cfb3a92cf928d1b41e4fb7967 WatchSource:0}: Error finding container 3eab2344c7155dd0102d52ff2ab6e2d2535d5b3cfb3a92cf928d1b41e4fb7967: Status 404 returned error can't find the container with id 3eab2344c7155dd0102d52ff2ab6e2d2535d5b3cfb3a92cf928d1b41e4fb7967
Jul 27 15:40:35.892145 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:35.892118    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"]
Jul 27 15:40:35.893029 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:40:35.893003    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd234c5c0_f1c9_40bd_ac89_2877b970abbe.slice/crio-d7b276ce4ff1531a002562151bce3034f13515b63f5ba6bd06a73eb2b2a0debc WatchSource:0}: Error finding container d7b276ce4ff1531a002562151bce3034f13515b63f5ba6bd06a73eb2b2a0debc: Status 404 returned error can't find the container with id d7b276ce4ff1531a002562151bce3034f13515b63f5ba6bd06a73eb2b2a0debc
Jul 27 15:40:36.471371 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:36.471333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4" event={"ID":"d234c5c0-f1c9-40bd-ac89-2877b970abbe","Type":"ContainerStarted","Data":"36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2"}
Jul 27 15:40:36.471770 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:36.471382    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4" event={"ID":"d234c5c0-f1c9-40bd-ac89-2877b970abbe","Type":"ContainerStarted","Data":"d7b276ce4ff1531a002562151bce3034f13515b63f5ba6bd06a73eb2b2a0debc"}
Jul 27 15:40:36.471770 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:36.471430    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"
Jul 27 15:40:36.472944 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:36.472922    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p" event={"ID":"19c0b160-1f51-405e-80b4-13912721cbd3","Type":"ContainerStarted","Data":"138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16"}
Jul 27 15:40:36.473079 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:36.472956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p" event={"ID":"19c0b160-1f51-405e-80b4-13912721cbd3","Type":"ContainerStarted","Data":"3eab2344c7155dd0102d52ff2ab6e2d2535d5b3cfb3a92cf928d1b41e4fb7967"}
Jul 27 15:40:36.473079 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:36.473055    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"
Jul 27 15:40:36.493290 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:36.493241    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4" podStartSLOduration=1.493228816 podStartE2EDuration="1.493228816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:40:36.489763202 +0000 UTC m=+2092.354341103" watchObservedRunningTime="2026-07-27 15:40:36.493228816 +0000 UTC m=+2092.357806709"
Jul 27 15:40:36.535919 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:36.535865    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p" podStartSLOduration=1.535848404 podStartE2EDuration="1.535848404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:40:36.530900978 +0000 UTC m=+2092.395478843" watchObservedRunningTime="2026-07-27 15:40:36.535848404 +0000 UTC m=+2092.400426271"
Jul 27 15:40:47.480209 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:47.480173    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"
Jul 27 15:40:47.480640 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:47.480251    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"
Jul 27 15:40:49.496377 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.496342    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"]
Jul 27 15:40:49.499982 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.499960    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.502891 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.502871    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-44b2dff2\"/\"openshift-service-ca.crt\""
Jul 27 15:40:49.504649 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.504628    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-44b2dff2\"/\"default-dockercfg-qmcmf\""
Jul 27 15:40:49.504756 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.504629    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-44b2dff2\"/\"e2e-lifecycle-model-44b2dff2-kserve-self-signed-certs\""
Jul 27 15:40:49.504756 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.504702    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-44b2dff2\"/\"kube-root-ca.crt\""
Jul 27 15:40:49.511665 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.511641    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"]
Jul 27 15:40:49.615708 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.615686    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-dshm\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.615822 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.615713    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd67cda7-04f8-4052-b0c3-b32e4048694d-tls-certs\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.615822 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.615738    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-model-cache\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.615822 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.615779    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg9bp\" (UniqueName: \"kubernetes.io/projected/fd67cda7-04f8-4052-b0c3-b32e4048694d-kube-api-access-kg9bp\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.615945 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.615827    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-tmp-dir\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.615945 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.615915    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-home\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.716386 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.716363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-home\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.716488 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.716397    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-dshm\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.716488 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.716414    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd67cda7-04f8-4052-b0c3-b32e4048694d-tls-certs\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.716488 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.716445    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-model-cache\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.716488 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.716474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg9bp\" (UniqueName: \"kubernetes.io/projected/fd67cda7-04f8-4052-b0c3-b32e4048694d-kube-api-access-kg9bp\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.716673 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.716498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-tmp-dir\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.716743 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.716721    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-home\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.716844 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.716827    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-tmp-dir\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.716908 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.716870    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-model-cache\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.718689 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.718671    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-dshm\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.718991 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.718974    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd67cda7-04f8-4052-b0c3-b32e4048694d-tls-certs\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.728569 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.728545    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg9bp\" (UniqueName: \"kubernetes.io/projected/fd67cda7-04f8-4052-b0c3-b32e4048694d-kube-api-access-kg9bp\") pod \"e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") " pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.809546 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.809491    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:49.943524 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:49.943497    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"]
Jul 27 15:40:49.945038 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:40:49.945009    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd67cda7_04f8_4052_b0c3_b32e4048694d.slice/crio-d1fa86f810ffa0dfc5c7f1b89a860ce00e0c9d6c6f2fa1748957c12f09ff1fe7 WatchSource:0}: Error finding container d1fa86f810ffa0dfc5c7f1b89a860ce00e0c9d6c6f2fa1748957c12f09ff1fe7: Status 404 returned error can't find the container with id d1fa86f810ffa0dfc5c7f1b89a860ce00e0c9d6c6f2fa1748957c12f09ff1fe7
Jul 27 15:40:50.546638 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:50.546607    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5" event={"ID":"fd67cda7-04f8-4052-b0c3-b32e4048694d","Type":"ContainerStarted","Data":"ff5bad54b73fc3b7a210b2ec6fc219d1f70ed41704a592cf0668cdc663d94479"}
Jul 27 15:40:50.547062 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:50.546649    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5" event={"ID":"fd67cda7-04f8-4052-b0c3-b32e4048694d","Type":"ContainerStarted","Data":"d1fa86f810ffa0dfc5c7f1b89a860ce00e0c9d6c6f2fa1748957c12f09ff1fe7"}
Jul 27 15:40:50.570508 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:50.570461    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5" podStartSLOduration=1.570446121 podStartE2EDuration="1.570446121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:40:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:40:50.568466543 +0000 UTC m=+2106.433044409" watchObservedRunningTime="2026-07-27 15:40:50.570446121 +0000 UTC m=+2106.435023978"
Jul 27 15:40:59.810389 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:59.810361    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:59.810389 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:59.810397    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:40:59.822499 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:40:59.822476    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:41:00.606969 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:00.606943    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:41:29.071885 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.071848    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"]
Jul 27 15:41:29.072426 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.072099    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4" podUID="d234c5c0-f1c9-40bd-ac89-2877b970abbe" containerName="payload-processing" containerID="cri-o://36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2" gracePeriod=30
Jul 27 15:41:29.079845 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.079814    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"]
Jul 27 15:41:29.080086 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.080044    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p" podUID="19c0b160-1f51-405e-80b4-13912721cbd3" containerName="payload-pre-processing" containerID="cri-o://138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16" gracePeriod=30
Jul 27 15:41:29.342941 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.342918    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"
Jul 27 15:41:29.345551 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.345534    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"
Jul 27 15:41:29.420936 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.420907    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb6jb\" (UniqueName: \"kubernetes.io/projected/d234c5c0-f1c9-40bd-ac89-2877b970abbe-kube-api-access-qb6jb\") pod \"d234c5c0-f1c9-40bd-ac89-2877b970abbe\" (UID: \"d234c5c0-f1c9-40bd-ac89-2877b970abbe\") "
Jul 27 15:41:29.421076 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.420991    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d234c5c0-f1c9-40bd-ac89-2877b970abbe-plugins-config-volume\") pod \"d234c5c0-f1c9-40bd-ac89-2877b970abbe\" (UID: \"d234c5c0-f1c9-40bd-ac89-2877b970abbe\") "
Jul 27 15:41:29.421076 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.421032    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19c0b160-1f51-405e-80b4-13912721cbd3-plugins-config-volume\") pod \"19c0b160-1f51-405e-80b4-13912721cbd3\" (UID: \"19c0b160-1f51-405e-80b4-13912721cbd3\") "
Jul 27 15:41:29.421076 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.421071    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85686\" (UniqueName: \"kubernetes.io/projected/19c0b160-1f51-405e-80b4-13912721cbd3-kube-api-access-85686\") pod \"19c0b160-1f51-405e-80b4-13912721cbd3\" (UID: \"19c0b160-1f51-405e-80b4-13912721cbd3\") "
Jul 27 15:41:29.421406 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.421374    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c0b160-1f51-405e-80b4-13912721cbd3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "19c0b160-1f51-405e-80b4-13912721cbd3" (UID: "19c0b160-1f51-405e-80b4-13912721cbd3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:41:29.421406 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.421374    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d234c5c0-f1c9-40bd-ac89-2877b970abbe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d234c5c0-f1c9-40bd-ac89-2877b970abbe" (UID: "d234c5c0-f1c9-40bd-ac89-2877b970abbe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:41:29.423308 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.423280    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c0b160-1f51-405e-80b4-13912721cbd3-kube-api-access-85686" (OuterVolumeSpecName: "kube-api-access-85686") pod "19c0b160-1f51-405e-80b4-13912721cbd3" (UID: "19c0b160-1f51-405e-80b4-13912721cbd3"). InnerVolumeSpecName "kube-api-access-85686". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:41:29.423584 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.423566    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d234c5c0-f1c9-40bd-ac89-2877b970abbe-kube-api-access-qb6jb" (OuterVolumeSpecName: "kube-api-access-qb6jb") pod "d234c5c0-f1c9-40bd-ac89-2877b970abbe" (UID: "d234c5c0-f1c9-40bd-ac89-2877b970abbe"). InnerVolumeSpecName "kube-api-access-qb6jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:41:29.522539 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.522516    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85686\" (UniqueName: \"kubernetes.io/projected/19c0b160-1f51-405e-80b4-13912721cbd3-kube-api-access-85686\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:41:29.522539 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.522535    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb6jb\" (UniqueName: \"kubernetes.io/projected/d234c5c0-f1c9-40bd-ac89-2877b970abbe-kube-api-access-qb6jb\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:41:29.522673 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.522544    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d234c5c0-f1c9-40bd-ac89-2877b970abbe-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:41:29.522673 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.522552    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19c0b160-1f51-405e-80b4-13912721cbd3-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:41:29.744202 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.744171    2559 generic.go:356] "Generic (PLEG): container finished" podID="d234c5c0-f1c9-40bd-ac89-2877b970abbe" containerID="36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2" exitCode=0
Jul 27 15:41:29.744292 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.744215    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"
Jul 27 15:41:29.744292 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.744261    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4" event={"ID":"d234c5c0-f1c9-40bd-ac89-2877b970abbe","Type":"ContainerDied","Data":"36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2"}
Jul 27 15:41:29.744421 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.744306    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4" event={"ID":"d234c5c0-f1c9-40bd-ac89-2877b970abbe","Type":"ContainerDied","Data":"d7b276ce4ff1531a002562151bce3034f13515b63f5ba6bd06a73eb2b2a0debc"}
Jul 27 15:41:29.744421 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.744351    2559 scope.go:117] "RemoveContainer" containerID="36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2"
Jul 27 15:41:29.745472 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.745452    2559 generic.go:356] "Generic (PLEG): container finished" podID="19c0b160-1f51-405e-80b4-13912721cbd3" containerID="138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16" exitCode=0
Jul 27 15:41:29.745562 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.745481    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p" event={"ID":"19c0b160-1f51-405e-80b4-13912721cbd3","Type":"ContainerDied","Data":"138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16"}
Jul 27 15:41:29.745562 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.745498    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"
Jul 27 15:41:29.745562 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.745517    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p" event={"ID":"19c0b160-1f51-405e-80b4-13912721cbd3","Type":"ContainerDied","Data":"3eab2344c7155dd0102d52ff2ab6e2d2535d5b3cfb3a92cf928d1b41e4fb7967"}
Jul 27 15:41:29.753478 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.753456    2559 scope.go:117] "RemoveContainer" containerID="36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2"
Jul 27 15:41:29.753749 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:41:29.753727    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2\": container with ID starting with 36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2 not found: ID does not exist" containerID="36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2"
Jul 27 15:41:29.753859 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.753755    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2"} err="failed to get container status \"36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2\": rpc error: code = NotFound desc = could not find container \"36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2\": container with ID starting with 36832172b521fe058b38f967f0fb1a3d017575213edf5cd9ce3a4db0242cc6d2 not found: ID does not exist"
Jul 27 15:41:29.753859 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.753771    2559 scope.go:117] "RemoveContainer" containerID="138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16"
Jul 27 15:41:29.761301 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.761283    2559 scope.go:117] "RemoveContainer" containerID="138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16"
Jul 27 15:41:29.761560 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:41:29.761538    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16\": container with ID starting with 138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16 not found: ID does not exist" containerID="138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16"
Jul 27 15:41:29.761624 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.761571    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16"} err="failed to get container status \"138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16\": rpc error: code = NotFound desc = could not find container \"138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16\": container with ID starting with 138a2c44447a3d5ecd9e4782cedf1d206bec3afbaa81c7cb0bcdd19231d72a16 not found: ID does not exist"
Jul 27 15:41:29.770133 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.770112    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"]
Jul 27 15:41:29.774337 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.774304    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4"]
Jul 27 15:41:29.785936 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.785917    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"]
Jul 27 15:41:29.789955 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:29.789937    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p"]
Jul 27 15:41:30.712033 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:30.712001    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19c0b160-1f51-405e-80b4-13912721cbd3" path="/var/lib/kubelet/pods/19c0b160-1f51-405e-80b4-13912721cbd3/volumes"
Jul 27 15:41:30.712385 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:30.712345    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d234c5c0-f1c9-40bd-ac89-2877b970abbe" path="/var/lib/kubelet/pods/d234c5c0-f1c9-40bd-ac89-2877b970abbe/volumes"
Jul 27 15:41:41.630938 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:41.630864    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"]
Jul 27 15:41:56.649573 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:56.649532    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5" podUID="fd67cda7-04f8-4052-b0c3-b32e4048694d" containerName="main" containerID="cri-o://ff5bad54b73fc3b7a210b2ec6fc219d1f70ed41704a592cf0668cdc663d94479" gracePeriod=45
Jul 27 15:41:56.887874 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:56.887840    2559 generic.go:356] "Generic (PLEG): container finished" podID="fd67cda7-04f8-4052-b0c3-b32e4048694d" containerID="ff5bad54b73fc3b7a210b2ec6fc219d1f70ed41704a592cf0668cdc663d94479" exitCode=0
Jul 27 15:41:56.887999 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:56.887908    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5" event={"ID":"fd67cda7-04f8-4052-b0c3-b32e4048694d","Type":"ContainerDied","Data":"ff5bad54b73fc3b7a210b2ec6fc219d1f70ed41704a592cf0668cdc663d94479"}
Jul 27 15:41:56.887999 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:56.887949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5" event={"ID":"fd67cda7-04f8-4052-b0c3-b32e4048694d","Type":"ContainerDied","Data":"d1fa86f810ffa0dfc5c7f1b89a860ce00e0c9d6c6f2fa1748957c12f09ff1fe7"}
Jul 27 15:41:56.887999 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:56.887961    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1fa86f810ffa0dfc5c7f1b89a860ce00e0c9d6c6f2fa1748957c12f09ff1fe7"
Jul 27 15:41:56.895173 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:56.895154    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:41:57.031206 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.031171    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-home\") pod \"fd67cda7-04f8-4052-b0c3-b32e4048694d\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") "
Jul 27 15:41:57.031384 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.031225    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-model-cache\") pod \"fd67cda7-04f8-4052-b0c3-b32e4048694d\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") "
Jul 27 15:41:57.031384 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.031272    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd67cda7-04f8-4052-b0c3-b32e4048694d-tls-certs\") pod \"fd67cda7-04f8-4052-b0c3-b32e4048694d\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") "
Jul 27 15:41:57.031384 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.031289    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg9bp\" (UniqueName: \"kubernetes.io/projected/fd67cda7-04f8-4052-b0c3-b32e4048694d-kube-api-access-kg9bp\") pod \"fd67cda7-04f8-4052-b0c3-b32e4048694d\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") "
Jul 27 15:41:57.031384 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.031353    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-dshm\") pod \"fd67cda7-04f8-4052-b0c3-b32e4048694d\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") "
Jul 27 15:41:57.031384 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.031379    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-tmp-dir\") pod \"fd67cda7-04f8-4052-b0c3-b32e4048694d\" (UID: \"fd67cda7-04f8-4052-b0c3-b32e4048694d\") "
Jul 27 15:41:57.031660 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.031509    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-home" (OuterVolumeSpecName: "home") pod "fd67cda7-04f8-4052-b0c3-b32e4048694d" (UID: "fd67cda7-04f8-4052-b0c3-b32e4048694d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:41:57.031660 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.031565    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-model-cache" (OuterVolumeSpecName: "model-cache") pod "fd67cda7-04f8-4052-b0c3-b32e4048694d" (UID: "fd67cda7-04f8-4052-b0c3-b32e4048694d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:41:57.031772 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.031656    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fd67cda7-04f8-4052-b0c3-b32e4048694d" (UID: "fd67cda7-04f8-4052-b0c3-b32e4048694d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:41:57.031772 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.031725    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-home\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:41:57.031772 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.031738    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-model-cache\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:41:57.031772 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.031747    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-tmp-dir\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:41:57.033567 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.033547    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-dshm" (OuterVolumeSpecName: "dshm") pod "fd67cda7-04f8-4052-b0c3-b32e4048694d" (UID: "fd67cda7-04f8-4052-b0c3-b32e4048694d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:41:57.033567 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.033545    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd67cda7-04f8-4052-b0c3-b32e4048694d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fd67cda7-04f8-4052-b0c3-b32e4048694d" (UID: "fd67cda7-04f8-4052-b0c3-b32e4048694d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:41:57.033721 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.033560    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd67cda7-04f8-4052-b0c3-b32e4048694d-kube-api-access-kg9bp" (OuterVolumeSpecName: "kube-api-access-kg9bp") pod "fd67cda7-04f8-4052-b0c3-b32e4048694d" (UID: "fd67cda7-04f8-4052-b0c3-b32e4048694d"). InnerVolumeSpecName "kube-api-access-kg9bp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:41:57.132605 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.132576    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd67cda7-04f8-4052-b0c3-b32e4048694d-tls-certs\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:41:57.132605 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.132600    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg9bp\" (UniqueName: \"kubernetes.io/projected/fd67cda7-04f8-4052-b0c3-b32e4048694d-kube-api-access-kg9bp\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:41:57.132733 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.132612    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd67cda7-04f8-4052-b0c3-b32e4048694d-dshm\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:41:57.893203 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.893180    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"
Jul 27 15:41:57.917535 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.917503    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"]
Jul 27 15:41:57.921844 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:57.921825    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-44b2dff2/e2e-lifecycle-model-44b2dff2-kserve-5c9ff59d67-mj5c5"]
Jul 27 15:41:58.711767 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:41:58.711743    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd67cda7-04f8-4052-b0c3-b32e4048694d" path="/var/lib/kubelet/pods/fd67cda7-04f8-4052-b0c3-b32e4048694d/volumes"
Jul 27 15:43:26.078939 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.078857    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"]
Jul 27 15:43:26.081205 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.079380    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c0b160-1f51-405e-80b4-13912721cbd3" containerName="payload-pre-processing"
Jul 27 15:43:26.081205 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.079397    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c0b160-1f51-405e-80b4-13912721cbd3" containerName="payload-pre-processing"
Jul 27 15:43:26.081205 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.079414    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd67cda7-04f8-4052-b0c3-b32e4048694d" containerName="main"
Jul 27 15:43:26.081205 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.079423    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd67cda7-04f8-4052-b0c3-b32e4048694d" containerName="main"
Jul 27 15:43:26.081205 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.079459    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d234c5c0-f1c9-40bd-ac89-2877b970abbe" containerName="payload-processing"
Jul 27 15:43:26.081205 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.079469    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d234c5c0-f1c9-40bd-ac89-2877b970abbe" containerName="payload-processing"
Jul 27 15:43:26.081205 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.079556    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d234c5c0-f1c9-40bd-ac89-2877b970abbe" containerName="payload-processing"
Jul 27 15:43:26.081205 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.079568    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c0b160-1f51-405e-80b4-13912721cbd3" containerName="payload-pre-processing"
Jul 27 15:43:26.081205 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.079581    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd67cda7-04f8-4052-b0c3-b32e4048694d" containerName="main"
Jul 27 15:43:26.082662 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.082644    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"
Jul 27 15:43:26.085459 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.085431    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-0d2dee-dockercfg-9jjjv\""
Jul 27 15:43:26.085574 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.085494    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-0d2dee\""
Jul 27 15:43:26.094761 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.094737    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"]
Jul 27 15:43:26.183416 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.183389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fqpk\" (UniqueName: \"kubernetes.io/projected/c267e87c-82d3-4c9f-b12f-665820eef759-kube-api-access-5fqpk\") pod \"payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6\" (UID: \"c267e87c-82d3-4c9f-b12f-665820eef759\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"
Jul 27 15:43:26.183549 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.183518    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c267e87c-82d3-4c9f-b12f-665820eef759-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6\" (UID: \"c267e87c-82d3-4c9f-b12f-665820eef759\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"
Jul 27 15:43:26.284086 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.284061    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c267e87c-82d3-4c9f-b12f-665820eef759-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6\" (UID: \"c267e87c-82d3-4c9f-b12f-665820eef759\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"
Jul 27 15:43:26.284181 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.284102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fqpk\" (UniqueName: \"kubernetes.io/projected/c267e87c-82d3-4c9f-b12f-665820eef759-kube-api-access-5fqpk\") pod \"payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6\" (UID: \"c267e87c-82d3-4c9f-b12f-665820eef759\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"
Jul 27 15:43:26.284695 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.284680    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c267e87c-82d3-4c9f-b12f-665820eef759-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6\" (UID: \"c267e87c-82d3-4c9f-b12f-665820eef759\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"
Jul 27 15:43:26.294220 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.294192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fqpk\" (UniqueName: \"kubernetes.io/projected/c267e87c-82d3-4c9f-b12f-665820eef759-kube-api-access-5fqpk\") pod \"payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6\" (UID: \"c267e87c-82d3-4c9f-b12f-665820eef759\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"
Jul 27 15:43:26.396114 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.396053    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"
Jul 27 15:43:26.520301 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:26.520270    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"]
Jul 27 15:43:26.521133 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:43:26.521110    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc267e87c_82d3_4c9f_b12f_665820eef759.slice/crio-dfc70d9a2622c5e3d7d773a2ebddcb08786f7de0b7fe67518c9c6727e478d91e WatchSource:0}: Error finding container dfc70d9a2622c5e3d7d773a2ebddcb08786f7de0b7fe67518c9c6727e478d91e: Status 404 returned error can't find the container with id dfc70d9a2622c5e3d7d773a2ebddcb08786f7de0b7fe67518c9c6727e478d91e
Jul 27 15:43:27.313686 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:27.313646    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6" event={"ID":"c267e87c-82d3-4c9f-b12f-665820eef759","Type":"ContainerStarted","Data":"4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6"}
Jul 27 15:43:27.314020 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:27.313711    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"
Jul 27 15:43:27.314020 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:27.313732    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6" event={"ID":"c267e87c-82d3-4c9f-b12f-665820eef759","Type":"ContainerStarted","Data":"dfc70d9a2622c5e3d7d773a2ebddcb08786f7de0b7fe67518c9c6727e478d91e"}
Jul 27 15:43:27.333999 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:27.333957    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6" podStartSLOduration=1.333942433 podStartE2EDuration="1.333942433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:43:27.33099478 +0000 UTC m=+2263.195572665" watchObservedRunningTime="2026-07-27 15:43:27.333942433 +0000 UTC m=+2263.198520299"
Jul 27 15:43:33.925606 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:33.925573    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"]
Jul 27 15:43:33.928960 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:33.928946    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"
Jul 27 15:43:33.932748 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:33.932715    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-664c72-dockercfg-ktdmh\""
Jul 27 15:43:33.933125 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:33.933109    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-664c72\""
Jul 27 15:43:33.943716 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:33.943693    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"]
Jul 27 15:43:33.963432 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:33.963395    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"]
Jul 27 15:43:33.967139 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:33.967122    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"
Jul 27 15:43:33.976080 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:33.976057    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"]
Jul 27 15:43:34.040798 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.040774    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f481a8c-653e-403a-9386-de2152695dcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp\" (UID: \"5f481a8c-653e-403a-9386-de2152695dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"
Jul 27 15:43:34.040889 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.040820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sgz4\" (UniqueName: \"kubernetes.io/projected/5f481a8c-653e-403a-9386-de2152695dcd-kube-api-access-2sgz4\") pod \"payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp\" (UID: \"5f481a8c-653e-403a-9386-de2152695dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"
Jul 27 15:43:34.142180 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.142155    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sgz4\" (UniqueName: \"kubernetes.io/projected/5f481a8c-653e-403a-9386-de2152695dcd-kube-api-access-2sgz4\") pod \"payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp\" (UID: \"5f481a8c-653e-403a-9386-de2152695dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"
Jul 27 15:43:34.142261 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.142207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c1d3a32-db62-4ee8-8fff-bacc694a999b-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c\" (UID: \"6c1d3a32-db62-4ee8-8fff-bacc694a999b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"
Jul 27 15:43:34.142261 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.142234    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f481a8c-653e-403a-9386-de2152695dcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp\" (UID: \"5f481a8c-653e-403a-9386-de2152695dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"
Jul 27 15:43:34.142261 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.142258    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st8mc\" (UniqueName: \"kubernetes.io/projected/6c1d3a32-db62-4ee8-8fff-bacc694a999b-kube-api-access-st8mc\") pod \"payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c\" (UID: \"6c1d3a32-db62-4ee8-8fff-bacc694a999b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"
Jul 27 15:43:34.142831 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.142815    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f481a8c-653e-403a-9386-de2152695dcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp\" (UID: \"5f481a8c-653e-403a-9386-de2152695dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"
Jul 27 15:43:34.151847 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.151829    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sgz4\" (UniqueName: \"kubernetes.io/projected/5f481a8c-653e-403a-9386-de2152695dcd-kube-api-access-2sgz4\") pod \"payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp\" (UID: \"5f481a8c-653e-403a-9386-de2152695dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"
Jul 27 15:43:34.238725 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.238662    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"
Jul 27 15:43:34.242597 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.242582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c1d3a32-db62-4ee8-8fff-bacc694a999b-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c\" (UID: \"6c1d3a32-db62-4ee8-8fff-bacc694a999b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"
Jul 27 15:43:34.242865 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.242621    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st8mc\" (UniqueName: \"kubernetes.io/projected/6c1d3a32-db62-4ee8-8fff-bacc694a999b-kube-api-access-st8mc\") pod \"payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c\" (UID: \"6c1d3a32-db62-4ee8-8fff-bacc694a999b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"
Jul 27 15:43:34.243355 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.243305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c1d3a32-db62-4ee8-8fff-bacc694a999b-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c\" (UID: \"6c1d3a32-db62-4ee8-8fff-bacc694a999b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"
Jul 27 15:43:34.251845 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.251825    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st8mc\" (UniqueName: \"kubernetes.io/projected/6c1d3a32-db62-4ee8-8fff-bacc694a999b-kube-api-access-st8mc\") pod \"payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c\" (UID: \"6c1d3a32-db62-4ee8-8fff-bacc694a999b\") " pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"
Jul 27 15:43:34.276603 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.276572    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"
Jul 27 15:43:34.384689 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.384660    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"]
Jul 27 15:43:34.384834 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:43:34.384813    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f481a8c_653e_403a_9386_de2152695dcd.slice/crio-cb8c4c3b1e1f335d5be9999d7dc7ce0ee62b960d4bfbab7fc25e0b977bd22363 WatchSource:0}: Error finding container cb8c4c3b1e1f335d5be9999d7dc7ce0ee62b960d4bfbab7fc25e0b977bd22363: Status 404 returned error can't find the container with id cb8c4c3b1e1f335d5be9999d7dc7ce0ee62b960d4bfbab7fc25e0b977bd22363
Jul 27 15:43:34.423355 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:34.421760    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"]
Jul 27 15:43:35.354398 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:35.354355    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp" event={"ID":"5f481a8c-653e-403a-9386-de2152695dcd","Type":"ContainerStarted","Data":"d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6"}
Jul 27 15:43:35.354810 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:35.354416    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp" event={"ID":"5f481a8c-653e-403a-9386-de2152695dcd","Type":"ContainerStarted","Data":"cb8c4c3b1e1f335d5be9999d7dc7ce0ee62b960d4bfbab7fc25e0b977bd22363"}
Jul 27 15:43:35.354810 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:35.354535    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"
Jul 27 15:43:35.355847 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:35.355824    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c" event={"ID":"6c1d3a32-db62-4ee8-8fff-bacc694a999b","Type":"ContainerStarted","Data":"725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431"}
Jul 27 15:43:35.355972 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:35.355874    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c" event={"ID":"6c1d3a32-db62-4ee8-8fff-bacc694a999b","Type":"ContainerStarted","Data":"8874266c8938638fb7b03764950faa5cab839dc776aa817a4c03a027246f6edc"}
Jul 27 15:43:35.355972 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:35.355903    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"
Jul 27 15:43:35.371938 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:35.371895    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp" podStartSLOduration=2.3718848120000002 podStartE2EDuration="2.371884812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:43:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:43:35.370509312 +0000 UTC m=+2271.235087176" watchObservedRunningTime="2026-07-27 15:43:35.371884812 +0000 UTC m=+2271.236462721"
Jul 27 15:43:35.388860 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:35.388823    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c" podStartSLOduration=2.388812495 podStartE2EDuration="2.388812495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:43:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:43:35.386060654 +0000 UTC m=+2271.250638521" watchObservedRunningTime="2026-07-27 15:43:35.388812495 +0000 UTC m=+2271.253390360"
Jul 27 15:43:38.320404 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:38.320374    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"
Jul 27 15:43:45.482250 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.482219    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"]
Jul 27 15:43:45.485861 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.485845    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.490089 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.490064    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0d2dee\"/\"default-dockercfg-ggkk4\""
Jul 27 15:43:45.490225 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.490116    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0d2dee\"/\"kube-root-ca.crt\""
Jul 27 15:43:45.490225 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.490133    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0d2dee\"/\"test-model-0d2dee-kserve-self-signed-certs\""
Jul 27 15:43:45.490225 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.490200    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0d2dee\"/\"openshift-service-ca.crt\""
Jul 27 15:43:45.496659 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.496638    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"]
Jul 27 15:43:45.525243 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.525223    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-home\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.525389 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.525255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx8qm\" (UniqueName: \"kubernetes.io/projected/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-kube-api-access-sx8qm\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.525389 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.525289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-tls-certs\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.525389 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.525358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-tmp-dir\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.525389 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.525387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-dshm\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.525576 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.525440    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-model-cache\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.626476 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.626454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-home\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.626554 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.626481    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx8qm\" (UniqueName: \"kubernetes.io/projected/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-kube-api-access-sx8qm\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.626554 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.626502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-tls-certs\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.626554 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.626521    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-tmp-dir\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.626696 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.626577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-dshm\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.626744 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.626686    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-model-cache\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.626857 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.626837    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-home\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.626947 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.626929    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-tmp-dir\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.626995 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.626947    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-model-cache\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.628802 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.628786    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-dshm\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.628960 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.628943    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-tls-certs\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.634828 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.634807    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx8qm\" (UniqueName: \"kubernetes.io/projected/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-kube-api-access-sx8qm\") pod \"test-model-0d2dee-kserve-b8d4bdcbf-jdkqb\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") " pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.795700 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.795647    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:45.924980 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:45.924953    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"]
Jul 27 15:43:45.925086 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:43:45.924951    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70c1a76e_bc6c_41d7_aae5_e6211fc60b5e.slice/crio-45e756d20c0870f2dac6e30e3c59aafb22a227969c36ea244bd8fcd92e6aa2fc WatchSource:0}: Error finding container 45e756d20c0870f2dac6e30e3c59aafb22a227969c36ea244bd8fcd92e6aa2fc: Status 404 returned error can't find the container with id 45e756d20c0870f2dac6e30e3c59aafb22a227969c36ea244bd8fcd92e6aa2fc
Jul 27 15:43:46.363076 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:46.363051    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"
Jul 27 15:43:46.363205 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:46.363133    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"
Jul 27 15:43:46.415366 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:46.415310    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb" event={"ID":"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e","Type":"ContainerStarted","Data":"4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b"}
Jul 27 15:43:46.415546 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:46.415375    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb" event={"ID":"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e","Type":"ContainerStarted","Data":"45e756d20c0870f2dac6e30e3c59aafb22a227969c36ea244bd8fcd92e6aa2fc"}
Jul 27 15:43:46.434876 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:46.434840    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb" podStartSLOduration=1.434827232 podStartE2EDuration="1.434827232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:43:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:43:46.431985881 +0000 UTC m=+2282.296563754" watchObservedRunningTime="2026-07-27 15:43:46.434827232 +0000 UTC m=+2282.299405096"
Jul 27 15:43:55.795875 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:55.795835    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:55.796373 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:55.795899    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:55.807684 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:55.807660    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:43:56.475156 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:43:56.475118    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:44:01.977682 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:01.977651    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"]
Jul 27 15:44:01.981111 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:01.981095    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:01.983979 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:01.983957    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-664c72\"/\"kube-root-ca.crt\""
Jul 27 15:44:01.985349 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:01.985310    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-664c72\"/\"test-model-664c72-kserve-self-signed-certs\""
Jul 27 15:44:01.985475 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:01.985366    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-664c72\"/\"openshift-service-ca.crt\""
Jul 27 15:44:01.985475 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:01.985391    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-664c72\"/\"default-dockercfg-cjbsn\""
Jul 27 15:44:01.990881 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:01.990861    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"]
Jul 27 15:44:02.039104 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.039065    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc36ed85-38ff-4402-9675-30f3e199d756-tls-certs\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.039215 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.039120    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-dshm\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.039215 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.039165    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-home\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.039361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.039253    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-tmp-dir\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.039361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.039294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-model-cache\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.039361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.039333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnfkz\" (UniqueName: \"kubernetes.io/projected/cc36ed85-38ff-4402-9675-30f3e199d756-kube-api-access-rnfkz\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.139653 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.139628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-dshm\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.139751 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.139663    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-home\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.139751 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.139710    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-tmp-dir\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.139751 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.139746    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-model-cache\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.139908 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.139768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnfkz\" (UniqueName: \"kubernetes.io/projected/cc36ed85-38ff-4402-9675-30f3e199d756-kube-api-access-rnfkz\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.139908 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.139827    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc36ed85-38ff-4402-9675-30f3e199d756-tls-certs\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.140141 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.140114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-home\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.140198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.140164    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-tmp-dir\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.140198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.140183    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-model-cache\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.141995 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.141975    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-dshm\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.142122 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.142107    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc36ed85-38ff-4402-9675-30f3e199d756-tls-certs\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.148520 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.148504    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnfkz\" (UniqueName: \"kubernetes.io/projected/cc36ed85-38ff-4402-9675-30f3e199d756-kube-api-access-rnfkz\") pod \"test-model-664c72-kserve-59c5f47f8f-qsp7r\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") " pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.293737 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.293687    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:02.417505 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.417474    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"]
Jul 27 15:44:02.417969 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:44:02.417947    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc36ed85_38ff_4402_9675_30f3e199d756.slice/crio-6b1716fdc2ca8ffb08a620f3a5d2c12ed42b511de5b76959a97e56a653d4bc76 WatchSource:0}: Error finding container 6b1716fdc2ca8ffb08a620f3a5d2c12ed42b511de5b76959a97e56a653d4bc76: Status 404 returned error can't find the container with id 6b1716fdc2ca8ffb08a620f3a5d2c12ed42b511de5b76959a97e56a653d4bc76
Jul 27 15:44:02.496382 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.496353    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r" event={"ID":"cc36ed85-38ff-4402-9675-30f3e199d756","Type":"ContainerStarted","Data":"a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21"}
Jul 27 15:44:02.496516 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.496397    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r" event={"ID":"cc36ed85-38ff-4402-9675-30f3e199d756","Type":"ContainerStarted","Data":"6b1716fdc2ca8ffb08a620f3a5d2c12ed42b511de5b76959a97e56a653d4bc76"}
Jul 27 15:44:02.513176 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:02.513138    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r" podStartSLOduration=1.513120265 podStartE2EDuration="1.513120265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:44:02.512382032 +0000 UTC m=+2298.376959896" watchObservedRunningTime="2026-07-27 15:44:02.513120265 +0000 UTC m=+2298.377698133"
Jul 27 15:44:12.293867 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:12.293835    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:12.294204 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:12.293880    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:12.305093 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:12.305069    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:12.557419 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:12.557362    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:44:47.007564 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:47.007465    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"]
Jul 27 15:44:47.920676 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:47.920646    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"]
Jul 27 15:44:58.513276 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.513242    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"]
Jul 27 15:44:58.513815 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.513511    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6" podUID="c267e87c-82d3-4c9f-b12f-665820eef759" containerName="payload-pre-processing" containerID="cri-o://4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6" gracePeriod=30
Jul 27 15:44:58.755136 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.755114    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"
Jul 27 15:44:58.761184 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.761160    2559 generic.go:356] "Generic (PLEG): container finished" podID="c267e87c-82d3-4c9f-b12f-665820eef759" containerID="4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6" exitCode=0
Jul 27 15:44:58.761266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.761197    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"
Jul 27 15:44:58.761266 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.761224    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6" event={"ID":"c267e87c-82d3-4c9f-b12f-665820eef759","Type":"ContainerDied","Data":"4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6"}
Jul 27 15:44:58.761407 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.761273    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6" event={"ID":"c267e87c-82d3-4c9f-b12f-665820eef759","Type":"ContainerDied","Data":"dfc70d9a2622c5e3d7d773a2ebddcb08786f7de0b7fe67518c9c6727e478d91e"}
Jul 27 15:44:58.761407 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.761294    2559 scope.go:117] "RemoveContainer" containerID="4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6"
Jul 27 15:44:58.769289 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.769273    2559 scope.go:117] "RemoveContainer" containerID="4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6"
Jul 27 15:44:58.769549 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:44:58.769530    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6\": container with ID starting with 4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6 not found: ID does not exist" containerID="4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6"
Jul 27 15:44:58.769628 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.769557    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6"} err="failed to get container status \"4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6\": rpc error: code = NotFound desc = could not find container \"4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6\": container with ID starting with 4f045a155a25dea857deffccb1558640d3e77b930335802cfd5ebb963b8c41c6 not found: ID does not exist"
Jul 27 15:44:58.871614 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.871594    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fqpk\" (UniqueName: \"kubernetes.io/projected/c267e87c-82d3-4c9f-b12f-665820eef759-kube-api-access-5fqpk\") pod \"c267e87c-82d3-4c9f-b12f-665820eef759\" (UID: \"c267e87c-82d3-4c9f-b12f-665820eef759\") "
Jul 27 15:44:58.871702 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.871659    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c267e87c-82d3-4c9f-b12f-665820eef759-plugins-config-volume\") pod \"c267e87c-82d3-4c9f-b12f-665820eef759\" (UID: \"c267e87c-82d3-4c9f-b12f-665820eef759\") "
Jul 27 15:44:58.872091 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.872059    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c267e87c-82d3-4c9f-b12f-665820eef759-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c267e87c-82d3-4c9f-b12f-665820eef759" (UID: "c267e87c-82d3-4c9f-b12f-665820eef759"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:44:58.873522 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.873498    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c267e87c-82d3-4c9f-b12f-665820eef759-kube-api-access-5fqpk" (OuterVolumeSpecName: "kube-api-access-5fqpk") pod "c267e87c-82d3-4c9f-b12f-665820eef759" (UID: "c267e87c-82d3-4c9f-b12f-665820eef759"). InnerVolumeSpecName "kube-api-access-5fqpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:44:58.972845 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.972820    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fqpk\" (UniqueName: \"kubernetes.io/projected/c267e87c-82d3-4c9f-b12f-665820eef759-kube-api-access-5fqpk\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:44:58.972845 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:58.972842    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c267e87c-82d3-4c9f-b12f-665820eef759-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:44:59.085088 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:59.085068    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"]
Jul 27 15:44:59.088878 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:44:59.088860    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6"]
Jul 27 15:45:00.711125 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:00.711089    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c267e87c-82d3-4c9f-b12f-665820eef759" path="/var/lib/kubelet/pods/c267e87c-82d3-4c9f-b12f-665820eef759/volumes"
Jul 27 15:45:02.026523 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.026490    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb" podUID="70c1a76e-bc6c-41d7-aae5-e6211fc60b5e" containerName="main" containerID="cri-o://4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b" gracePeriod=45
Jul 27 15:45:02.268740 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.268720    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:45:02.397777 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.397724    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx8qm\" (UniqueName: \"kubernetes.io/projected/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-kube-api-access-sx8qm\") pod \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") "
Jul 27 15:45:02.397777 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.397754    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-model-cache\") pod \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") "
Jul 27 15:45:02.397777 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.397774    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-tmp-dir\") pod \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") "
Jul 27 15:45:02.398003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.397822    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-home\") pod \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") "
Jul 27 15:45:02.398003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.397838    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-tls-certs\") pod \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") "
Jul 27 15:45:02.398003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.397851    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-dshm\") pod \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\" (UID: \"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e\") "
Jul 27 15:45:02.398003 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.397989    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-model-cache" (OuterVolumeSpecName: "model-cache") pod "70c1a76e-bc6c-41d7-aae5-e6211fc60b5e" (UID: "70c1a76e-bc6c-41d7-aae5-e6211fc60b5e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:45:02.398184 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.398077    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-home" (OuterVolumeSpecName: "home") pod "70c1a76e-bc6c-41d7-aae5-e6211fc60b5e" (UID: "70c1a76e-bc6c-41d7-aae5-e6211fc60b5e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:45:02.398184 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.398097    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "70c1a76e-bc6c-41d7-aae5-e6211fc60b5e" (UID: "70c1a76e-bc6c-41d7-aae5-e6211fc60b5e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:45:02.398184 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.398138    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-model-cache\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:02.399984 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.399962    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-dshm" (OuterVolumeSpecName: "dshm") pod "70c1a76e-bc6c-41d7-aae5-e6211fc60b5e" (UID: "70c1a76e-bc6c-41d7-aae5-e6211fc60b5e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:45:02.400070 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.400024    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-kube-api-access-sx8qm" (OuterVolumeSpecName: "kube-api-access-sx8qm") pod "70c1a76e-bc6c-41d7-aae5-e6211fc60b5e" (UID: "70c1a76e-bc6c-41d7-aae5-e6211fc60b5e"). InnerVolumeSpecName "kube-api-access-sx8qm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:45:02.400070 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.400046    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "70c1a76e-bc6c-41d7-aae5-e6211fc60b5e" (UID: "70c1a76e-bc6c-41d7-aae5-e6211fc60b5e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:45:02.498660 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.498639    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx8qm\" (UniqueName: \"kubernetes.io/projected/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-kube-api-access-sx8qm\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:02.498660 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.498659    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-tmp-dir\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:02.498792 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.498668    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-home\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:02.498792 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.498675    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-tls-certs\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:02.498792 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.498681    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e-dshm\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:02.791558 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.791533    2559 generic.go:356] "Generic (PLEG): container finished" podID="70c1a76e-bc6c-41d7-aae5-e6211fc60b5e" containerID="4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b" exitCode=0
Jul 27 15:45:02.791673 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.791585    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"
Jul 27 15:45:02.791673 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.791620    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb" event={"ID":"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e","Type":"ContainerDied","Data":"4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b"}
Jul 27 15:45:02.791673 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.791661    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb" event={"ID":"70c1a76e-bc6c-41d7-aae5-e6211fc60b5e","Type":"ContainerDied","Data":"45e756d20c0870f2dac6e30e3c59aafb22a227969c36ea244bd8fcd92e6aa2fc"}
Jul 27 15:45:02.791797 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.791681    2559 scope.go:117] "RemoveContainer" containerID="4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b"
Jul 27 15:45:02.799756 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.799736    2559 scope.go:117] "RemoveContainer" containerID="4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b"
Jul 27 15:45:02.800017 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:45:02.799999    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b\": container with ID starting with 4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b not found: ID does not exist" containerID="4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b"
Jul 27 15:45:02.800060 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.800027    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b"} err="failed to get container status \"4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b\": rpc error: code = NotFound desc = could not find container \"4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b\": container with ID starting with 4a0363ad560144e623bf282a315d7a4f16e93a06048826d998e4b10d8fcb417b not found: ID does not exist"
Jul 27 15:45:02.810898 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.810874    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"]
Jul 27 15:45:02.816851 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.816831    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-0d2dee/test-model-0d2dee-kserve-b8d4bdcbf-jdkqb"]
Jul 27 15:45:02.938414 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:02.938370    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r" podUID="cc36ed85-38ff-4402-9675-30f3e199d756" containerName="main" containerID="cri-o://a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21" gracePeriod=45
Jul 27 15:45:03.169668 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.169646    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:45:03.306886 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.306829    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-dshm\") pod \"cc36ed85-38ff-4402-9675-30f3e199d756\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") "
Jul 27 15:45:03.306886 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.306858    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-model-cache\") pod \"cc36ed85-38ff-4402-9675-30f3e199d756\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") "
Jul 27 15:45:03.306886 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.306881    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-home\") pod \"cc36ed85-38ff-4402-9675-30f3e199d756\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") "
Jul 27 15:45:03.307120 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.306901    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnfkz\" (UniqueName: \"kubernetes.io/projected/cc36ed85-38ff-4402-9675-30f3e199d756-kube-api-access-rnfkz\") pod \"cc36ed85-38ff-4402-9675-30f3e199d756\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") "
Jul 27 15:45:03.307120 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.306924    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-tmp-dir\") pod \"cc36ed85-38ff-4402-9675-30f3e199d756\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") "
Jul 27 15:45:03.307120 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.307054    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc36ed85-38ff-4402-9675-30f3e199d756-tls-certs\") pod \"cc36ed85-38ff-4402-9675-30f3e199d756\" (UID: \"cc36ed85-38ff-4402-9675-30f3e199d756\") "
Jul 27 15:45:03.307263 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.307125    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-home" (OuterVolumeSpecName: "home") pod "cc36ed85-38ff-4402-9675-30f3e199d756" (UID: "cc36ed85-38ff-4402-9675-30f3e199d756"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:45:03.307263 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.307137    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-model-cache" (OuterVolumeSpecName: "model-cache") pod "cc36ed85-38ff-4402-9675-30f3e199d756" (UID: "cc36ed85-38ff-4402-9675-30f3e199d756"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:45:03.307263 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.307185    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cc36ed85-38ff-4402-9675-30f3e199d756" (UID: "cc36ed85-38ff-4402-9675-30f3e199d756"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:45:03.307399 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.307369    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-model-cache\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:03.307399 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.307386    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-home\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:03.307463 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.307400    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-tmp-dir\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:03.309020 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.309001    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-dshm" (OuterVolumeSpecName: "dshm") pod "cc36ed85-38ff-4402-9675-30f3e199d756" (UID: "cc36ed85-38ff-4402-9675-30f3e199d756"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:45:03.309077 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.309053    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc36ed85-38ff-4402-9675-30f3e199d756-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cc36ed85-38ff-4402-9675-30f3e199d756" (UID: "cc36ed85-38ff-4402-9675-30f3e199d756"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:45:03.309146 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.309133    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc36ed85-38ff-4402-9675-30f3e199d756-kube-api-access-rnfkz" (OuterVolumeSpecName: "kube-api-access-rnfkz") pod "cc36ed85-38ff-4402-9675-30f3e199d756" (UID: "cc36ed85-38ff-4402-9675-30f3e199d756"). InnerVolumeSpecName "kube-api-access-rnfkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:45:03.407872 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.407840    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc36ed85-38ff-4402-9675-30f3e199d756-dshm\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:03.407872 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.407871    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnfkz\" (UniqueName: \"kubernetes.io/projected/cc36ed85-38ff-4402-9675-30f3e199d756-kube-api-access-rnfkz\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:03.407997 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.407885    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc36ed85-38ff-4402-9675-30f3e199d756-tls-certs\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:03.798117 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.798089    2559 generic.go:356] "Generic (PLEG): container finished" podID="cc36ed85-38ff-4402-9675-30f3e199d756" containerID="a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21" exitCode=0
Jul 27 15:45:03.798284 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.798131    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"
Jul 27 15:45:03.798284 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.798136    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r" event={"ID":"cc36ed85-38ff-4402-9675-30f3e199d756","Type":"ContainerDied","Data":"a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21"}
Jul 27 15:45:03.798284 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.798170    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r" event={"ID":"cc36ed85-38ff-4402-9675-30f3e199d756","Type":"ContainerDied","Data":"6b1716fdc2ca8ffb08a620f3a5d2c12ed42b511de5b76959a97e56a653d4bc76"}
Jul 27 15:45:03.798284 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.798190    2559 scope.go:117] "RemoveContainer" containerID="a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21"
Jul 27 15:45:03.806851 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.806837    2559 scope.go:117] "RemoveContainer" containerID="a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21"
Jul 27 15:45:03.807096 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:45:03.807076    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21\": container with ID starting with a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21 not found: ID does not exist" containerID="a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21"
Jul 27 15:45:03.807145 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.807105    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21"} err="failed to get container status \"a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21\": rpc error: code = NotFound desc = could not find container \"a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21\": container with ID starting with a5f39c01e2403a8ea83acb5eb3c6e53ac02821e68967f3622cc6114d5d92be21 not found: ID does not exist"
Jul 27 15:45:03.826981 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.826958    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"]
Jul 27 15:45:03.831070 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:03.831047    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-664c72/test-model-664c72-kserve-59c5f47f8f-qsp7r"]
Jul 27 15:45:04.711768 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:04.711743    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70c1a76e-bc6c-41d7-aae5-e6211fc60b5e" path="/var/lib/kubelet/pods/70c1a76e-bc6c-41d7-aae5-e6211fc60b5e/volumes"
Jul 27 15:45:04.712094 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:04.712080    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc36ed85-38ff-4402-9675-30f3e199d756" path="/var/lib/kubelet/pods/cc36ed85-38ff-4402-9675-30f3e199d756/volumes"
Jul 27 15:45:21.015261 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.015228    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"]
Jul 27 15:45:21.015755 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.015481    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c" podUID="6c1d3a32-db62-4ee8-8fff-bacc694a999b" containerName="payload-processing" containerID="cri-o://725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431" gracePeriod=30
Jul 27 15:45:21.022926 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.022897    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"]
Jul 27 15:45:21.023129 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.023104    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp" podUID="5f481a8c-653e-403a-9386-de2152695dcd" containerName="payload-pre-processing" containerID="cri-o://d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6" gracePeriod=30
Jul 27 15:45:21.286557 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.286534    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"
Jul 27 15:45:21.289377 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.289356    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"
Jul 27 15:45:21.336199 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.336174    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c1d3a32-db62-4ee8-8fff-bacc694a999b-plugins-config-volume\") pod \"6c1d3a32-db62-4ee8-8fff-bacc694a999b\" (UID: \"6c1d3a32-db62-4ee8-8fff-bacc694a999b\") "
Jul 27 15:45:21.336339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.336236    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f481a8c-653e-403a-9386-de2152695dcd-plugins-config-volume\") pod \"5f481a8c-653e-403a-9386-de2152695dcd\" (UID: \"5f481a8c-653e-403a-9386-de2152695dcd\") "
Jul 27 15:45:21.336339 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.336278    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st8mc\" (UniqueName: \"kubernetes.io/projected/6c1d3a32-db62-4ee8-8fff-bacc694a999b-kube-api-access-st8mc\") pod \"6c1d3a32-db62-4ee8-8fff-bacc694a999b\" (UID: \"6c1d3a32-db62-4ee8-8fff-bacc694a999b\") "
Jul 27 15:45:21.336439 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.336367    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sgz4\" (UniqueName: \"kubernetes.io/projected/5f481a8c-653e-403a-9386-de2152695dcd-kube-api-access-2sgz4\") pod \"5f481a8c-653e-403a-9386-de2152695dcd\" (UID: \"5f481a8c-653e-403a-9386-de2152695dcd\") "
Jul 27 15:45:21.336635 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.336604    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c1d3a32-db62-4ee8-8fff-bacc694a999b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6c1d3a32-db62-4ee8-8fff-bacc694a999b" (UID: "6c1d3a32-db62-4ee8-8fff-bacc694a999b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:45:21.336706 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.336674    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f481a8c-653e-403a-9386-de2152695dcd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5f481a8c-653e-403a-9386-de2152695dcd" (UID: "5f481a8c-653e-403a-9386-de2152695dcd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:45:21.338418 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.338398    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1d3a32-db62-4ee8-8fff-bacc694a999b-kube-api-access-st8mc" (OuterVolumeSpecName: "kube-api-access-st8mc") pod "6c1d3a32-db62-4ee8-8fff-bacc694a999b" (UID: "6c1d3a32-db62-4ee8-8fff-bacc694a999b"). InnerVolumeSpecName "kube-api-access-st8mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:45:21.338580 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.338563    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f481a8c-653e-403a-9386-de2152695dcd-kube-api-access-2sgz4" (OuterVolumeSpecName: "kube-api-access-2sgz4") pod "5f481a8c-653e-403a-9386-de2152695dcd" (UID: "5f481a8c-653e-403a-9386-de2152695dcd"). InnerVolumeSpecName "kube-api-access-2sgz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:45:21.437627 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.437602    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sgz4\" (UniqueName: \"kubernetes.io/projected/5f481a8c-653e-403a-9386-de2152695dcd-kube-api-access-2sgz4\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:21.437627 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.437622    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c1d3a32-db62-4ee8-8fff-bacc694a999b-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:21.437744 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.437632    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f481a8c-653e-403a-9386-de2152695dcd-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:21.437744 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.437641    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st8mc\" (UniqueName: \"kubernetes.io/projected/6c1d3a32-db62-4ee8-8fff-bacc694a999b-kube-api-access-st8mc\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:45:21.901622 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.901595    2559 generic.go:356] "Generic (PLEG): container finished" podID="5f481a8c-653e-403a-9386-de2152695dcd" containerID="d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6" exitCode=0
Jul 27 15:45:21.901743 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.901641    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"
Jul 27 15:45:21.901743 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.901688    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp" event={"ID":"5f481a8c-653e-403a-9386-de2152695dcd","Type":"ContainerDied","Data":"d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6"}
Jul 27 15:45:21.901860 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.901743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp" event={"ID":"5f481a8c-653e-403a-9386-de2152695dcd","Type":"ContainerDied","Data":"cb8c4c3b1e1f335d5be9999d7dc7ce0ee62b960d4bfbab7fc25e0b977bd22363"}
Jul 27 15:45:21.901860 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.901772    2559 scope.go:117] "RemoveContainer" containerID="d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6"
Jul 27 15:45:21.903066 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.903025    2559 generic.go:356] "Generic (PLEG): container finished" podID="6c1d3a32-db62-4ee8-8fff-bacc694a999b" containerID="725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431" exitCode=0
Jul 27 15:45:21.903066 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.903061    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"
Jul 27 15:45:21.903066 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.903088    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c" event={"ID":"6c1d3a32-db62-4ee8-8fff-bacc694a999b","Type":"ContainerDied","Data":"725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431"}
Jul 27 15:45:21.903066 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.903118    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c" event={"ID":"6c1d3a32-db62-4ee8-8fff-bacc694a999b","Type":"ContainerDied","Data":"8874266c8938638fb7b03764950faa5cab839dc776aa817a4c03a027246f6edc"}
Jul 27 15:45:21.910427 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.910397    2559 scope.go:117] "RemoveContainer" containerID="d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6"
Jul 27 15:45:21.910781 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:45:21.910761    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6\": container with ID starting with d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6 not found: ID does not exist" containerID="d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6"
Jul 27 15:45:21.910881 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.910791    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6"} err="failed to get container status \"d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6\": rpc error: code = NotFound desc = could not find container \"d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6\": container with ID starting with d1a1d91914a32e05993c9aaefc663aeee4e67cb131833250fd260631544834e6 not found: ID does not exist"
Jul 27 15:45:21.910881 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.910808    2559 scope.go:117] "RemoveContainer" containerID="725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431"
Jul 27 15:45:21.918495 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.918482    2559 scope.go:117] "RemoveContainer" containerID="725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431"
Jul 27 15:45:21.918718 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:45:21.918700    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431\": container with ID starting with 725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431 not found: ID does not exist" containerID="725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431"
Jul 27 15:45:21.918759 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.918724    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431"} err="failed to get container status \"725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431\": rpc error: code = NotFound desc = could not find container \"725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431\": container with ID starting with 725b08cf2f9a84b4f455cb60aba997bf7584c483f2b461766fc53a178cfcd431 not found: ID does not exist"
Jul 27 15:45:21.927487 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.927466    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"]
Jul 27 15:45:21.931995 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.931975    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp"]
Jul 27 15:45:21.943497 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.943471    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"]
Jul 27 15:45:21.950564 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:21.950545    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c"]
Jul 27 15:45:22.713135 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:22.713106    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f481a8c-653e-403a-9386-de2152695dcd" path="/var/lib/kubelet/pods/5f481a8c-653e-403a-9386-de2152695dcd/volumes"
Jul 27 15:45:22.713497 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:22.713466    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c1d3a32-db62-4ee8-8fff-bacc694a999b" path="/var/lib/kubelet/pods/6c1d3a32-db62-4ee8-8fff-bacc694a999b/volumes"
Jul 27 15:45:36.572956 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.572921    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"]
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573233    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c267e87c-82d3-4c9f-b12f-665820eef759" containerName="payload-pre-processing"
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573243    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c267e87c-82d3-4c9f-b12f-665820eef759" containerName="payload-pre-processing"
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573253    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f481a8c-653e-403a-9386-de2152695dcd" containerName="payload-pre-processing"
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573258    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f481a8c-653e-403a-9386-de2152695dcd" containerName="payload-pre-processing"
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573269    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1d3a32-db62-4ee8-8fff-bacc694a999b" containerName="payload-processing"
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573274    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1d3a32-db62-4ee8-8fff-bacc694a999b" containerName="payload-processing"
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573279    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c1a76e-bc6c-41d7-aae5-e6211fc60b5e" containerName="main"
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573284    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c1a76e-bc6c-41d7-aae5-e6211fc60b5e" containerName="main"
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573296    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc36ed85-38ff-4402-9675-30f3e199d756" containerName="main"
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573300    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc36ed85-38ff-4402-9675-30f3e199d756" containerName="main"
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573385    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f481a8c-653e-403a-9386-de2152695dcd" containerName="payload-pre-processing"
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573395    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc36ed85-38ff-4402-9675-30f3e199d756" containerName="main"
Jul 27 15:45:36.573395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573401    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c267e87c-82d3-4c9f-b12f-665820eef759" containerName="payload-pre-processing"
Jul 27 15:45:36.573777 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573409    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1d3a32-db62-4ee8-8fff-bacc694a999b" containerName="payload-processing"
Jul 27 15:45:36.573777 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.573415    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="70c1a76e-bc6c-41d7-aae5-e6211fc60b5e" containerName="main"
Jul 27 15:45:36.577680 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.577664    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"
Jul 27 15:45:36.580352 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.580312    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-fcb199\""
Jul 27 15:45:36.590486 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.590459    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"]
Jul 27 15:45:36.652663 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.652638    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4c31e3-296a-4352-88bd-e66cdf936d2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f\" (UID: \"ef4c31e3-296a-4352-88bd-e66cdf936d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"
Jul 27 15:45:36.652769 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.652689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67956\" (UniqueName: \"kubernetes.io/projected/ef4c31e3-296a-4352-88bd-e66cdf936d2f-kube-api-access-67956\") pod \"payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f\" (UID: \"ef4c31e3-296a-4352-88bd-e66cdf936d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"
Jul 27 15:45:36.753274 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.753248    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67956\" (UniqueName: \"kubernetes.io/projected/ef4c31e3-296a-4352-88bd-e66cdf936d2f-kube-api-access-67956\") pod \"payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f\" (UID: \"ef4c31e3-296a-4352-88bd-e66cdf936d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"
Jul 27 15:45:36.753438 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.753306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4c31e3-296a-4352-88bd-e66cdf936d2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f\" (UID: \"ef4c31e3-296a-4352-88bd-e66cdf936d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"
Jul 27 15:45:36.753928 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.753910    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4c31e3-296a-4352-88bd-e66cdf936d2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f\" (UID: \"ef4c31e3-296a-4352-88bd-e66cdf936d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"
Jul 27 15:45:36.762710 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.762687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67956\" (UniqueName: \"kubernetes.io/projected/ef4c31e3-296a-4352-88bd-e66cdf936d2f-kube-api-access-67956\") pod \"payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f\" (UID: \"ef4c31e3-296a-4352-88bd-e66cdf936d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"
Jul 27 15:45:36.887024 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:36.886954    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"
Jul 27 15:45:37.020545 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:37.020519    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"]
Jul 27 15:45:37.022137 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:45:37.022110    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4c31e3_296a_4352_88bd_e66cdf936d2f.slice/crio-5d44ff8b9d4fd916353e20109b01e04a585999971221890457adfdfb6929593c WatchSource:0}: Error finding container 5d44ff8b9d4fd916353e20109b01e04a585999971221890457adfdfb6929593c: Status 404 returned error can't find the container with id 5d44ff8b9d4fd916353e20109b01e04a585999971221890457adfdfb6929593c
Jul 27 15:45:37.997535 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:37.997502    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f" event={"ID":"ef4c31e3-296a-4352-88bd-e66cdf936d2f","Type":"ContainerStarted","Data":"288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632"}
Jul 27 15:45:37.997930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:37.997556    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f" event={"ID":"ef4c31e3-296a-4352-88bd-e66cdf936d2f","Type":"ContainerStarted","Data":"5d44ff8b9d4fd916353e20109b01e04a585999971221890457adfdfb6929593c"}
Jul 27 15:45:37.997930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:37.997577    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"
Jul 27 15:45:38.014010 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:38.013961    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f" podStartSLOduration=2.013947532 podStartE2EDuration="2.013947532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:45:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:45:38.012730445 +0000 UTC m=+2393.877308311" watchObservedRunningTime="2026-07-27 15:45:38.013947532 +0000 UTC m=+2393.878525397"
Jul 27 15:45:44.729361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.729310    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"]
Jul 27 15:45:44.732707 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.732692    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"
Jul 27 15:45:44.735539 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.735505    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-fbf2d4\""
Jul 27 15:45:44.735664 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.735564    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-fbf2d4-dockercfg-kgc7d\""
Jul 27 15:45:44.741971 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.741948    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"]
Jul 27 15:45:44.752105 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.752067    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"]
Jul 27 15:45:44.755355 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.755337    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"
Jul 27 15:45:44.767968 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.767949    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"]
Jul 27 15:45:44.814950 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.814925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6b5f\" (UniqueName: \"kubernetes.io/projected/7fa32b47-fa61-4d75-8b51-5e8903e4af51-kube-api-access-f6b5f\") pod \"payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv\" (UID: \"7fa32b47-fa61-4d75-8b51-5e8903e4af51\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"
Jul 27 15:45:44.815044 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.814962    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4786defa-259e-44b7-b129-91c294101b65-plugins-config-volume\") pod \"payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm\" (UID: \"4786defa-259e-44b7-b129-91c294101b65\") " pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"
Jul 27 15:45:44.815044 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.815000    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jksbk\" (UniqueName: \"kubernetes.io/projected/4786defa-259e-44b7-b129-91c294101b65-kube-api-access-jksbk\") pod \"payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm\" (UID: \"4786defa-259e-44b7-b129-91c294101b65\") " pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"
Jul 27 15:45:44.815121 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.815039    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa32b47-fa61-4d75-8b51-5e8903e4af51-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv\" (UID: \"7fa32b47-fa61-4d75-8b51-5e8903e4af51\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"
Jul 27 15:45:44.916198 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.916168    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jksbk\" (UniqueName: \"kubernetes.io/projected/4786defa-259e-44b7-b129-91c294101b65-kube-api-access-jksbk\") pod \"payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm\" (UID: \"4786defa-259e-44b7-b129-91c294101b65\") " pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"
Jul 27 15:45:44.916292 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.916205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa32b47-fa61-4d75-8b51-5e8903e4af51-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv\" (UID: \"7fa32b47-fa61-4d75-8b51-5e8903e4af51\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"
Jul 27 15:45:44.916292 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.916264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6b5f\" (UniqueName: \"kubernetes.io/projected/7fa32b47-fa61-4d75-8b51-5e8903e4af51-kube-api-access-f6b5f\") pod \"payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv\" (UID: \"7fa32b47-fa61-4d75-8b51-5e8903e4af51\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"
Jul 27 15:45:44.916387 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.916308    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4786defa-259e-44b7-b129-91c294101b65-plugins-config-volume\") pod \"payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm\" (UID: \"4786defa-259e-44b7-b129-91c294101b65\") " pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"
Jul 27 15:45:44.916936 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.916918    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4786defa-259e-44b7-b129-91c294101b65-plugins-config-volume\") pod \"payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm\" (UID: \"4786defa-259e-44b7-b129-91c294101b65\") " pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"
Jul 27 15:45:44.916980 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.916968    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa32b47-fa61-4d75-8b51-5e8903e4af51-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv\" (UID: \"7fa32b47-fa61-4d75-8b51-5e8903e4af51\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"
Jul 27 15:45:44.925691 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.925669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6b5f\" (UniqueName: \"kubernetes.io/projected/7fa32b47-fa61-4d75-8b51-5e8903e4af51-kube-api-access-f6b5f\") pod \"payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv\" (UID: \"7fa32b47-fa61-4d75-8b51-5e8903e4af51\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"
Jul 27 15:45:44.925788 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:44.925765    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jksbk\" (UniqueName: \"kubernetes.io/projected/4786defa-259e-44b7-b129-91c294101b65-kube-api-access-jksbk\") pod \"payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm\" (UID: \"4786defa-259e-44b7-b129-91c294101b65\") " pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"
Jul 27 15:45:45.043075 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:45.043000    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"
Jul 27 15:45:45.064423 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:45.064392    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"
Jul 27 15:45:45.189607 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:45:45.189573    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa32b47_fa61_4d75_8b51_5e8903e4af51.slice/crio-20390fa48dce1f8b6c30a7c37d9c78a4fcac0ee8636e4d85213d5f61d0b849b7 WatchSource:0}: Error finding container 20390fa48dce1f8b6c30a7c37d9c78a4fcac0ee8636e4d85213d5f61d0b849b7: Status 404 returned error can't find the container with id 20390fa48dce1f8b6c30a7c37d9c78a4fcac0ee8636e4d85213d5f61d0b849b7
Jul 27 15:45:45.189607 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:45.189587    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"]
Jul 27 15:45:45.420970 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:45.420936    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"]
Jul 27 15:45:45.421759 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:45:45.421735    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4786defa_259e_44b7_b129_91c294101b65.slice/crio-eb18a13a8250aa631badb652896f4bbba48c83821d69a06c36c3533739e0a4a8 WatchSource:0}: Error finding container eb18a13a8250aa631badb652896f4bbba48c83821d69a06c36c3533739e0a4a8: Status 404 returned error can't find the container with id eb18a13a8250aa631badb652896f4bbba48c83821d69a06c36c3533739e0a4a8
Jul 27 15:45:46.039579 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:46.039535    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv" event={"ID":"7fa32b47-fa61-4d75-8b51-5e8903e4af51","Type":"ContainerStarted","Data":"4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140"}
Jul 27 15:45:46.040045 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:46.039620    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv" event={"ID":"7fa32b47-fa61-4d75-8b51-5e8903e4af51","Type":"ContainerStarted","Data":"20390fa48dce1f8b6c30a7c37d9c78a4fcac0ee8636e4d85213d5f61d0b849b7"}
Jul 27 15:45:46.040045 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:46.039650    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"
Jul 27 15:45:46.041291 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:46.041265    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm" event={"ID":"4786defa-259e-44b7-b129-91c294101b65","Type":"ContainerStarted","Data":"578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6"}
Jul 27 15:45:46.041406 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:46.041307    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm" event={"ID":"4786defa-259e-44b7-b129-91c294101b65","Type":"ContainerStarted","Data":"eb18a13a8250aa631badb652896f4bbba48c83821d69a06c36c3533739e0a4a8"}
Jul 27 15:45:46.041406 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:46.041357    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"
Jul 27 15:45:46.057941 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:46.057897    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv" podStartSLOduration=2.057884541 podStartE2EDuration="2.057884541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:45:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:45:46.054725689 +0000 UTC m=+2401.919303558" watchObservedRunningTime="2026-07-27 15:45:46.057884541 +0000 UTC m=+2401.922462406"
Jul 27 15:45:46.073279 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:46.073234    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm" podStartSLOduration=2.073218272 podStartE2EDuration="2.073218272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:45:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:45:46.07015343 +0000 UTC m=+2401.934731295" watchObservedRunningTime="2026-07-27 15:45:46.073218272 +0000 UTC m=+2401.937796141"
Jul 27 15:45:49.004991 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:49.004963    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"
Jul 27 15:45:57.047914 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:57.047869    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv" podUID="7fa32b47-fa61-4d75-8b51-5e8903e4af51" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.58:9004: connect: connection refused"
Jul 27 15:45:57.048387 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:45:57.048211    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"
Jul 27 15:46:07.047157 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:07.047081    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"
Jul 27 15:46:12.224231 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:12.224199    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"]
Jul 27 15:46:12.224785 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:12.224427    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f" podUID="ef4c31e3-296a-4352-88bd-e66cdf936d2f" containerName="payload-pre-processing" containerID="cri-o://288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632" gracePeriod=30
Jul 27 15:46:12.463191 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:12.463162    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"
Jul 27 15:46:12.634380 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:12.634292    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67956\" (UniqueName: \"kubernetes.io/projected/ef4c31e3-296a-4352-88bd-e66cdf936d2f-kube-api-access-67956\") pod \"ef4c31e3-296a-4352-88bd-e66cdf936d2f\" (UID: \"ef4c31e3-296a-4352-88bd-e66cdf936d2f\") "
Jul 27 15:46:12.634380 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:12.634349    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4c31e3-296a-4352-88bd-e66cdf936d2f-plugins-config-volume\") pod \"ef4c31e3-296a-4352-88bd-e66cdf936d2f\" (UID: \"ef4c31e3-296a-4352-88bd-e66cdf936d2f\") "
Jul 27 15:46:12.634719 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:12.634696    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef4c31e3-296a-4352-88bd-e66cdf936d2f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ef4c31e3-296a-4352-88bd-e66cdf936d2f" (UID: "ef4c31e3-296a-4352-88bd-e66cdf936d2f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:46:12.636389 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:12.636368    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef4c31e3-296a-4352-88bd-e66cdf936d2f-kube-api-access-67956" (OuterVolumeSpecName: "kube-api-access-67956") pod "ef4c31e3-296a-4352-88bd-e66cdf936d2f" (UID: "ef4c31e3-296a-4352-88bd-e66cdf936d2f"). InnerVolumeSpecName "kube-api-access-67956". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:46:12.735778 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:12.735749    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67956\" (UniqueName: \"kubernetes.io/projected/ef4c31e3-296a-4352-88bd-e66cdf936d2f-kube-api-access-67956\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:46:12.735778 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:12.735775    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4c31e3-296a-4352-88bd-e66cdf936d2f-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:46:13.176635 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:13.176600    2559 generic.go:356] "Generic (PLEG): container finished" podID="ef4c31e3-296a-4352-88bd-e66cdf936d2f" containerID="288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632" exitCode=0
Jul 27 15:46:13.176761 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:13.176637    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"
Jul 27 15:46:13.176761 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:13.176687    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f" event={"ID":"ef4c31e3-296a-4352-88bd-e66cdf936d2f","Type":"ContainerDied","Data":"288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632"}
Jul 27 15:46:13.176761 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:13.176735    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f" event={"ID":"ef4c31e3-296a-4352-88bd-e66cdf936d2f","Type":"ContainerDied","Data":"5d44ff8b9d4fd916353e20109b01e04a585999971221890457adfdfb6929593c"}
Jul 27 15:46:13.176761 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:13.176758    2559 scope.go:117] "RemoveContainer" containerID="288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632"
Jul 27 15:46:13.184716 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:13.184701    2559 scope.go:117] "RemoveContainer" containerID="288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632"
Jul 27 15:46:13.184951 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:46:13.184932    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632\": container with ID starting with 288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632 not found: ID does not exist" containerID="288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632"
Jul 27 15:46:13.185010 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:13.184959    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632"} err="failed to get container status \"288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632\": rpc error: code = NotFound desc = could not find container \"288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632\": container with ID starting with 288728ef12451a65b0725673981ec5bd6fc8a88d48f1fb468ad630c375c4b632 not found: ID does not exist"
Jul 27 15:46:13.195441 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:13.195420    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"]
Jul 27 15:46:13.199456 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:13.199437    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f"]
Jul 27 15:46:14.711585 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:14.711554    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef4c31e3-296a-4352-88bd-e66cdf936d2f" path="/var/lib/kubelet/pods/ef4c31e3-296a-4352-88bd-e66cdf936d2f/volumes"
Jul 27 15:46:38.938870 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:38.938821    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"]
Jul 27 15:46:38.939361 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:38.939061    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm" podUID="4786defa-259e-44b7-b129-91c294101b65" containerName="payload-processing" containerID="cri-o://578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6" gracePeriod=30
Jul 27 15:46:38.946247 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:38.946217    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"]
Jul 27 15:46:38.946481 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:38.946452    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv" podUID="7fa32b47-fa61-4d75-8b51-5e8903e4af51" containerName="payload-pre-processing" containerID="cri-o://4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140" gracePeriod=30
Jul 27 15:46:39.204792 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.204765    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"
Jul 27 15:46:39.207262 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.207242    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"
Jul 27 15:46:39.223421 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.223369    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6b5f\" (UniqueName: \"kubernetes.io/projected/7fa32b47-fa61-4d75-8b51-5e8903e4af51-kube-api-access-f6b5f\") pod \"7fa32b47-fa61-4d75-8b51-5e8903e4af51\" (UID: \"7fa32b47-fa61-4d75-8b51-5e8903e4af51\") "
Jul 27 15:46:39.223421 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.223417    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4786defa-259e-44b7-b129-91c294101b65-plugins-config-volume\") pod \"4786defa-259e-44b7-b129-91c294101b65\" (UID: \"4786defa-259e-44b7-b129-91c294101b65\") "
Jul 27 15:46:39.224061 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.223685    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa32b47-fa61-4d75-8b51-5e8903e4af51-plugins-config-volume\") pod \"7fa32b47-fa61-4d75-8b51-5e8903e4af51\" (UID: \"7fa32b47-fa61-4d75-8b51-5e8903e4af51\") "
Jul 27 15:46:39.224061 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.223740    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jksbk\" (UniqueName: \"kubernetes.io/projected/4786defa-259e-44b7-b129-91c294101b65-kube-api-access-jksbk\") pod \"4786defa-259e-44b7-b129-91c294101b65\" (UID: \"4786defa-259e-44b7-b129-91c294101b65\") "
Jul 27 15:46:39.224061 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.223783    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4786defa-259e-44b7-b129-91c294101b65-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4786defa-259e-44b7-b129-91c294101b65" (UID: "4786defa-259e-44b7-b129-91c294101b65"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:46:39.224061 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.224009    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4786defa-259e-44b7-b129-91c294101b65-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:46:39.224061 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.224036    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fa32b47-fa61-4d75-8b51-5e8903e4af51-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7fa32b47-fa61-4d75-8b51-5e8903e4af51" (UID: "7fa32b47-fa61-4d75-8b51-5e8903e4af51"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:46:39.226148 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.226120    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fa32b47-fa61-4d75-8b51-5e8903e4af51-kube-api-access-f6b5f" (OuterVolumeSpecName: "kube-api-access-f6b5f") pod "7fa32b47-fa61-4d75-8b51-5e8903e4af51" (UID: "7fa32b47-fa61-4d75-8b51-5e8903e4af51"). InnerVolumeSpecName "kube-api-access-f6b5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:46:39.226409 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.226386    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4786defa-259e-44b7-b129-91c294101b65-kube-api-access-jksbk" (OuterVolumeSpecName: "kube-api-access-jksbk") pod "4786defa-259e-44b7-b129-91c294101b65" (UID: "4786defa-259e-44b7-b129-91c294101b65"). InnerVolumeSpecName "kube-api-access-jksbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:46:39.307925 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.307895    2559 generic.go:356] "Generic (PLEG): container finished" podID="7fa32b47-fa61-4d75-8b51-5e8903e4af51" containerID="4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140" exitCode=0
Jul 27 15:46:39.308059 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.307945    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"
Jul 27 15:46:39.308059 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.307984    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv" event={"ID":"7fa32b47-fa61-4d75-8b51-5e8903e4af51","Type":"ContainerDied","Data":"4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140"}
Jul 27 15:46:39.308059 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.308035    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv" event={"ID":"7fa32b47-fa61-4d75-8b51-5e8903e4af51","Type":"ContainerDied","Data":"20390fa48dce1f8b6c30a7c37d9c78a4fcac0ee8636e4d85213d5f61d0b849b7"}
Jul 27 15:46:39.308194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.308064    2559 scope.go:117] "RemoveContainer" containerID="4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140"
Jul 27 15:46:39.309287 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.309262    2559 generic.go:356] "Generic (PLEG): container finished" podID="4786defa-259e-44b7-b129-91c294101b65" containerID="578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6" exitCode=0
Jul 27 15:46:39.309383 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.309304    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm" event={"ID":"4786defa-259e-44b7-b129-91c294101b65","Type":"ContainerDied","Data":"578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6"}
Jul 27 15:46:39.309383 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.309376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm" event={"ID":"4786defa-259e-44b7-b129-91c294101b65","Type":"ContainerDied","Data":"eb18a13a8250aa631badb652896f4bbba48c83821d69a06c36c3533739e0a4a8"}
Jul 27 15:46:39.309481 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.309307    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"
Jul 27 15:46:39.317008 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.316976    2559 scope.go:117] "RemoveContainer" containerID="4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140"
Jul 27 15:46:39.317282 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:46:39.317258    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140\": container with ID starting with 4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140 not found: ID does not exist" containerID="4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140"
Jul 27 15:46:39.317392 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.317292    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140"} err="failed to get container status \"4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140\": rpc error: code = NotFound desc = could not find container \"4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140\": container with ID starting with 4238a2cb48cda258815716db7be46aeb7237e294c850c8d1bca256fd71a71140 not found: ID does not exist"
Jul 27 15:46:39.317392 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.317340    2559 scope.go:117] "RemoveContainer" containerID="578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6"
Jul 27 15:46:39.324646 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.324623    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa32b47-fa61-4d75-8b51-5e8903e4af51-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:46:39.324646 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.324642    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jksbk\" (UniqueName: \"kubernetes.io/projected/4786defa-259e-44b7-b129-91c294101b65-kube-api-access-jksbk\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:46:39.324762 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.324652    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6b5f\" (UniqueName: \"kubernetes.io/projected/7fa32b47-fa61-4d75-8b51-5e8903e4af51-kube-api-access-f6b5f\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:46:39.325340 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.325327    2559 scope.go:117] "RemoveContainer" containerID="578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6"
Jul 27 15:46:39.325652 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:46:39.325630    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6\": container with ID starting with 578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6 not found: ID does not exist" containerID="578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6"
Jul 27 15:46:39.325722 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.325662    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6"} err="failed to get container status \"578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6\": rpc error: code = NotFound desc = could not find container \"578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6\": container with ID starting with 578c6afe6ae49aaa49e70b62d3b4d5f6d8ca0a199a94f11a2f29d0df8865ffa6 not found: ID does not exist"
Jul 27 15:46:39.338475 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.338456    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"]
Jul 27 15:46:39.342626 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.342605    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm"]
Jul 27 15:46:39.354081 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.354056    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"]
Jul 27 15:46:39.356481 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:39.356459    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv"]
Jul 27 15:46:40.711443 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:40.711407    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4786defa-259e-44b7-b129-91c294101b65" path="/var/lib/kubelet/pods/4786defa-259e-44b7-b129-91c294101b65/volumes"
Jul 27 15:46:40.711776 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:40.711745    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fa32b47-fa61-4d75-8b51-5e8903e4af51" path="/var/lib/kubelet/pods/7fa32b47-fa61-4d75-8b51-5e8903e4af51/volumes"
Jul 27 15:46:54.921398 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.921368    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"]
Jul 27 15:46:54.921818 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.921700    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef4c31e3-296a-4352-88bd-e66cdf936d2f" containerName="payload-pre-processing"
Jul 27 15:46:54.921818 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.921711    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef4c31e3-296a-4352-88bd-e66cdf936d2f" containerName="payload-pre-processing"
Jul 27 15:46:54.921818 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.921726    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa32b47-fa61-4d75-8b51-5e8903e4af51" containerName="payload-pre-processing"
Jul 27 15:46:54.921818 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.921732    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa32b47-fa61-4d75-8b51-5e8903e4af51" containerName="payload-pre-processing"
Jul 27 15:46:54.921818 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.921740    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4786defa-259e-44b7-b129-91c294101b65" containerName="payload-processing"
Jul 27 15:46:54.921818 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.921746    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4786defa-259e-44b7-b129-91c294101b65" containerName="payload-processing"
Jul 27 15:46:54.921818 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.921805    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef4c31e3-296a-4352-88bd-e66cdf936d2f" containerName="payload-pre-processing"
Jul 27 15:46:54.921818 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.921815    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fa32b47-fa61-4d75-8b51-5e8903e4af51" containerName="payload-pre-processing"
Jul 27 15:46:54.921818 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.921821    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4786defa-259e-44b7-b129-91c294101b65" containerName="payload-processing"
Jul 27 15:46:54.924612 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.924594    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"
Jul 27 15:46:54.927507 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.927474    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-f58a29\""
Jul 27 15:46:54.927618 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.927556    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-f58a29-dockercfg-t8kgw\""
Jul 27 15:46:54.937052 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.937029    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"]
Jul 27 15:46:54.961345 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.961302    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"]
Jul 27 15:46:54.964456 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.964441    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"
Jul 27 15:46:54.973230 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:54.973208    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"]
Jul 27 15:46:55.034582 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.034556    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71e702eb-ac04-41fb-920e-4540ae4f3c50-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8\" (UID: \"71e702eb-ac04-41fb-920e-4540ae4f3c50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"
Jul 27 15:46:55.034678 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.034584    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zt5g\" (UniqueName: \"kubernetes.io/projected/71e702eb-ac04-41fb-920e-4540ae4f3c50-kube-api-access-8zt5g\") pod \"payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8\" (UID: \"71e702eb-ac04-41fb-920e-4540ae4f3c50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"
Jul 27 15:46:55.034678 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.034635    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d8x8\" (UniqueName: \"kubernetes.io/projected/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a-kube-api-access-8d8x8\") pod \"payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m\" (UID: \"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"
Jul 27 15:46:55.034678 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.034665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m\" (UID: \"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"
Jul 27 15:46:55.135289 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.135264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d8x8\" (UniqueName: \"kubernetes.io/projected/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a-kube-api-access-8d8x8\") pod \"payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m\" (UID: \"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"
Jul 27 15:46:55.135411 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.135301    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m\" (UID: \"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"
Jul 27 15:46:55.135411 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.135349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71e702eb-ac04-41fb-920e-4540ae4f3c50-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8\" (UID: \"71e702eb-ac04-41fb-920e-4540ae4f3c50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"
Jul 27 15:46:55.135411 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.135375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zt5g\" (UniqueName: \"kubernetes.io/projected/71e702eb-ac04-41fb-920e-4540ae4f3c50-kube-api-access-8zt5g\") pod \"payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8\" (UID: \"71e702eb-ac04-41fb-920e-4540ae4f3c50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"
Jul 27 15:46:55.136008 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.135988    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m\" (UID: \"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"
Jul 27 15:46:55.136096 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.136051    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71e702eb-ac04-41fb-920e-4540ae4f3c50-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8\" (UID: \"71e702eb-ac04-41fb-920e-4540ae4f3c50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"
Jul 27 15:46:55.147233 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.147214    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zt5g\" (UniqueName: \"kubernetes.io/projected/71e702eb-ac04-41fb-920e-4540ae4f3c50-kube-api-access-8zt5g\") pod \"payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8\" (UID: \"71e702eb-ac04-41fb-920e-4540ae4f3c50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"
Jul 27 15:46:55.147332 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.147238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d8x8\" (UniqueName: \"kubernetes.io/projected/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a-kube-api-access-8d8x8\") pod \"payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m\" (UID: \"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"
Jul 27 15:46:55.235251 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.235203    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"
Jul 27 15:46:55.274807 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.274780    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"
Jul 27 15:46:55.380714 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.380686    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"]
Jul 27 15:46:55.381707 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:46:55.381682    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e702eb_ac04_41fb_920e_4540ae4f3c50.slice/crio-97fc1bb0a6e409600c66ac19c7ee4317da2d9ca69ef934d4b674c4fae44dcde5 WatchSource:0}: Error finding container 97fc1bb0a6e409600c66ac19c7ee4317da2d9ca69ef934d4b674c4fae44dcde5: Status 404 returned error can't find the container with id 97fc1bb0a6e409600c66ac19c7ee4317da2d9ca69ef934d4b674c4fae44dcde5
Jul 27 15:46:55.405831 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.405801    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8" event={"ID":"71e702eb-ac04-41fb-920e-4540ae4f3c50","Type":"ContainerStarted","Data":"97fc1bb0a6e409600c66ac19c7ee4317da2d9ca69ef934d4b674c4fae44dcde5"}
Jul 27 15:46:55.415665 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:55.415645    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"]
Jul 27 15:46:55.421291 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:46:55.421270    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eeefd2e_f5c8_4fcb_9d1f_07eaaf06be0a.slice/crio-90801fbc135100c90f5681692b822d5bd13d79c598fbb9ebe6ff64329e0772df WatchSource:0}: Error finding container 90801fbc135100c90f5681692b822d5bd13d79c598fbb9ebe6ff64329e0772df: Status 404 returned error can't find the container with id 90801fbc135100c90f5681692b822d5bd13d79c598fbb9ebe6ff64329e0772df
Jul 27 15:46:56.413673 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:56.413638    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m" event={"ID":"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a","Type":"ContainerStarted","Data":"8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13"}
Jul 27 15:46:56.414090 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:56.413687    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m" event={"ID":"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a","Type":"ContainerStarted","Data":"90801fbc135100c90f5681692b822d5bd13d79c598fbb9ebe6ff64329e0772df"}
Jul 27 15:46:56.414090 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:56.413724    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"
Jul 27 15:46:56.415200 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:56.415175    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8" event={"ID":"71e702eb-ac04-41fb-920e-4540ae4f3c50","Type":"ContainerStarted","Data":"d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8"}
Jul 27 15:46:56.415347 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:56.415273    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"
Jul 27 15:46:56.433594 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:56.433551    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m" podStartSLOduration=2.433538501 podStartE2EDuration="2.433538501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:46:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:46:56.431746921 +0000 UTC m=+2472.296324793" watchObservedRunningTime="2026-07-27 15:46:56.433538501 +0000 UTC m=+2472.298116380"
Jul 27 15:46:56.450628 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:46:56.450591    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8" podStartSLOduration=2.450581032 podStartE2EDuration="2.450581032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:46:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:46:56.448411943 +0000 UTC m=+2472.312990044" watchObservedRunningTime="2026-07-27 15:46:56.450581032 +0000 UTC m=+2472.315158897"
Jul 27 15:47:03.045792 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.045756    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"]
Jul 27 15:47:03.049269 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.049252    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"
Jul 27 15:47:03.052174 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.052148    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-052d16-dockercfg-f9w2z\""
Jul 27 15:47:03.052462 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.052441    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-052d16\""
Jul 27 15:47:03.061482 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.061463    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"]
Jul 27 15:47:03.081869 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.081841    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"]
Jul 27 15:47:03.085414 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.085398    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"
Jul 27 15:47:03.095091 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.095065    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"]
Jul 27 15:47:03.100619 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.100593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pglnf\" (UniqueName: \"kubernetes.io/projected/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1-kube-api-access-pglnf\") pod \"payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb\" (UID: \"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"
Jul 27 15:47:03.100737 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.100718    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb\" (UID: \"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"
Jul 27 15:47:03.201878 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.201838    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pglnf\" (UniqueName: \"kubernetes.io/projected/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1-kube-api-access-pglnf\") pod \"payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb\" (UID: \"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"
Jul 27 15:47:03.202018 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.201905    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e862058-d32d-461a-af3d-b323aecba9db-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7\" (UID: \"7e862058-d32d-461a-af3d-b323aecba9db\") " pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"
Jul 27 15:47:03.202018 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.201925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t27ng\" (UniqueName: \"kubernetes.io/projected/7e862058-d32d-461a-af3d-b323aecba9db-kube-api-access-t27ng\") pod \"payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7\" (UID: \"7e862058-d32d-461a-af3d-b323aecba9db\") " pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"
Jul 27 15:47:03.202018 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.201991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb\" (UID: \"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"
Jul 27 15:47:03.202637 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.202621    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb\" (UID: \"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"
Jul 27 15:47:03.214259 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.214234    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pglnf\" (UniqueName: \"kubernetes.io/projected/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1-kube-api-access-pglnf\") pod \"payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb\" (UID: \"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"
Jul 27 15:47:03.303115 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.303057    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e862058-d32d-461a-af3d-b323aecba9db-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7\" (UID: \"7e862058-d32d-461a-af3d-b323aecba9db\") " pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"
Jul 27 15:47:03.303115 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.303086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t27ng\" (UniqueName: \"kubernetes.io/projected/7e862058-d32d-461a-af3d-b323aecba9db-kube-api-access-t27ng\") pod \"payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7\" (UID: \"7e862058-d32d-461a-af3d-b323aecba9db\") " pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"
Jul 27 15:47:03.303697 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.303680    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e862058-d32d-461a-af3d-b323aecba9db-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7\" (UID: \"7e862058-d32d-461a-af3d-b323aecba9db\") " pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"
Jul 27 15:47:03.313059 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.313029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t27ng\" (UniqueName: \"kubernetes.io/projected/7e862058-d32d-461a-af3d-b323aecba9db-kube-api-access-t27ng\") pod \"payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7\" (UID: \"7e862058-d32d-461a-af3d-b323aecba9db\") " pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"
Jul 27 15:47:03.359922 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.359901    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"
Jul 27 15:47:03.395817 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.395794    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"
Jul 27 15:47:03.508049 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.508012    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"]
Jul 27 15:47:03.508997 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:47:03.508973    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38bfb2d_4ba3_4e71_a76b_81d9ce6a53d1.slice/crio-7b1ff0d3942099f79f0220a599f0f4b8e1e239a39fc7078970b259e6f085adec WatchSource:0}: Error finding container 7b1ff0d3942099f79f0220a599f0f4b8e1e239a39fc7078970b259e6f085adec: Status 404 returned error can't find the container with id 7b1ff0d3942099f79f0220a599f0f4b8e1e239a39fc7078970b259e6f085adec
Jul 27 15:47:03.545387 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:03.545360    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"]
Jul 27 15:47:03.545729 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:47:03.545710    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e862058_d32d_461a_af3d_b323aecba9db.slice/crio-bf7ba3e24cfd6dad8e9b2d4d4314d7d77eec477e35a90429e849d8d34a1b6e2e WatchSource:0}: Error finding container bf7ba3e24cfd6dad8e9b2d4d4314d7d77eec477e35a90429e849d8d34a1b6e2e: Status 404 returned error can't find the container with id bf7ba3e24cfd6dad8e9b2d4d4314d7d77eec477e35a90429e849d8d34a1b6e2e
Jul 27 15:47:04.457612 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:04.457575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7" event={"ID":"7e862058-d32d-461a-af3d-b323aecba9db","Type":"ContainerStarted","Data":"4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a"}
Jul 27 15:47:04.458012 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:04.457626    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7" event={"ID":"7e862058-d32d-461a-af3d-b323aecba9db","Type":"ContainerStarted","Data":"bf7ba3e24cfd6dad8e9b2d4d4314d7d77eec477e35a90429e849d8d34a1b6e2e"}
Jul 27 15:47:04.458012 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:04.457686    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"
Jul 27 15:47:04.459337 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:04.459281    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb" event={"ID":"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1","Type":"ContainerStarted","Data":"fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81"}
Jul 27 15:47:04.459457 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:04.459341    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb" event={"ID":"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1","Type":"ContainerStarted","Data":"7b1ff0d3942099f79f0220a599f0f4b8e1e239a39fc7078970b259e6f085adec"}
Jul 27 15:47:04.459457 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:04.459372    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"
Jul 27 15:47:04.488586 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:04.488543    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7" podStartSLOduration=1.4885315700000001 podStartE2EDuration="1.48853157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:47:04.48675001 +0000 UTC m=+2480.351327876" watchObservedRunningTime="2026-07-27 15:47:04.48853157 +0000 UTC m=+2480.353109436"
Jul 27 15:47:04.510740 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:04.510695    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb" podStartSLOduration=1.510684322 podStartE2EDuration="1.510684322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:47:04.510420983 +0000 UTC m=+2480.374998849" watchObservedRunningTime="2026-07-27 15:47:04.510684322 +0000 UTC m=+2480.375262188"
Jul 27 15:47:07.421857 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:07.421827    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"
Jul 27 15:47:07.422253 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:07.421910    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"
Jul 27 15:47:15.467119 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:15.467093    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"
Jul 27 15:47:15.467652 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:15.467221    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"
Jul 27 15:47:44.898527 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:47:44.898461    2559 scope.go:117] "RemoveContainer" containerID="ff5bad54b73fc3b7a210b2ec6fc219d1f70ed41704a592cf0668cdc663d94479"
Jul 27 15:48:03.898754 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.898723    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"]
Jul 27 15:48:03.902232 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.902217    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:03.906783 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.906756    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-052d16\"/\"kube-root-ca.crt\""
Jul 27 15:48:03.906912 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.906795    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-052d16\"/\"openshift-service-ca.crt\""
Jul 27 15:48:03.906912 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.906813    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-052d16\"/\"default-dockercfg-4l8kt\""
Jul 27 15:48:03.906912 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.906814    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-052d16\"/\"auth-test-model-052d16-kserve-self-signed-certs\""
Jul 27 15:48:03.915042 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.915019    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"]
Jul 27 15:48:03.948308 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.948273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-dshm\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:03.948308 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.948306    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-tmp-dir\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:03.948535 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.948384    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b446eef-7947-402a-a402-e41355a1191d-tls-certs\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:03.948535 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.948420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-model-cache\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:03.948535 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.948453    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-home\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:03.948666 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:03.948540    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrmqh\" (UniqueName: \"kubernetes.io/projected/1b446eef-7947-402a-a402-e41355a1191d-kube-api-access-rrmqh\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.049238 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.049208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrmqh\" (UniqueName: \"kubernetes.io/projected/1b446eef-7947-402a-a402-e41355a1191d-kube-api-access-rrmqh\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.049392 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.049263    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-dshm\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.049392 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.049288    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-tmp-dir\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.049392 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.049340    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b446eef-7947-402a-a402-e41355a1191d-tls-certs\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.049392 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.049366    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-model-cache\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.049595 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.049402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-home\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.049720 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.049694    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-model-cache\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.049843 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.049747    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-tmp-dir\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.049843 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.049790    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-home\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.051609 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.051578    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-dshm\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.051800 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.051778    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b446eef-7947-402a-a402-e41355a1191d-tls-certs\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.058482 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.058461    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrmqh\" (UniqueName: \"kubernetes.io/projected/1b446eef-7947-402a-a402-e41355a1191d-kube-api-access-rrmqh\") pod \"auth-test-model-052d16-kserve-66f8cc99bc-kdh47\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") " pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.211029 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.211009    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:04.341394 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.341363    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"]
Jul 27 15:48:04.341830 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:48:04.341804    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b446eef_7947_402a_a402_e41355a1191d.slice/crio-bd97414a17d3bfd661cf637755106d67dbfa934d452e22f5604a810fa0ce7fac WatchSource:0}: Error finding container bd97414a17d3bfd661cf637755106d67dbfa934d452e22f5604a810fa0ce7fac: Status 404 returned error can't find the container with id bd97414a17d3bfd661cf637755106d67dbfa934d452e22f5604a810fa0ce7fac
Jul 27 15:48:04.769152 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.769115    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47" event={"ID":"1b446eef-7947-402a-a402-e41355a1191d","Type":"ContainerStarted","Data":"98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7"}
Jul 27 15:48:04.769305 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.769160    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47" event={"ID":"1b446eef-7947-402a-a402-e41355a1191d","Type":"ContainerStarted","Data":"bd97414a17d3bfd661cf637755106d67dbfa934d452e22f5604a810fa0ce7fac"}
Jul 27 15:48:04.790669 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:04.790625    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47" podStartSLOduration=1.790612316 podStartE2EDuration="1.790612316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:48:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:04.78953609 +0000 UTC m=+2540.654113955" watchObservedRunningTime="2026-07-27 15:48:04.790612316 +0000 UTC m=+2540.655190178"
Jul 27 15:48:14.211260 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:14.211224    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:14.211648 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:14.211271    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:14.223113 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:14.223093    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:48:14.832896 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:48:14.832868    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:52:20.559929 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:20.559845    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"]
Jul 27 15:52:35.578810 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.578767    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47" podUID="1b446eef-7947-402a-a402-e41355a1191d" containerName="main" containerID="cri-o://98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7" gracePeriod=45
Jul 27 15:52:35.791905 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.791872    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"]
Jul 27 15:52:35.795329 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.795297    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.799916 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.799887    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f58a29\"/\"kube-root-ca.crt\""
Jul 27 15:52:35.800168 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.799937    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f58a29\"/\"openshift-service-ca.crt\""
Jul 27 15:52:35.800168 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.799955    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f58a29\"/\"sub-test-model-f58a29-kserve-self-signed-certs\""
Jul 27 15:52:35.800274 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.800234    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f58a29\"/\"default-dockercfg-8mfl7\""
Jul 27 15:52:35.813161 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.813134    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"]
Jul 27 15:52:35.833512 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.833445    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:52:35.891680 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.891647    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-model-cache\") pod \"1b446eef-7947-402a-a402-e41355a1191d\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") "
Jul 27 15:52:35.891876 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.891707    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-dshm\") pod \"1b446eef-7947-402a-a402-e41355a1191d\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") "
Jul 27 15:52:35.891876 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.891737    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-tmp-dir\") pod \"1b446eef-7947-402a-a402-e41355a1191d\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") "
Jul 27 15:52:35.891876 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.891761    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-home\") pod \"1b446eef-7947-402a-a402-e41355a1191d\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") "
Jul 27 15:52:35.891876 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.891781    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrmqh\" (UniqueName: \"kubernetes.io/projected/1b446eef-7947-402a-a402-e41355a1191d-kube-api-access-rrmqh\") pod \"1b446eef-7947-402a-a402-e41355a1191d\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") "
Jul 27 15:52:35.891876 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.891801    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b446eef-7947-402a-a402-e41355a1191d-tls-certs\") pod \"1b446eef-7947-402a-a402-e41355a1191d\" (UID: \"1b446eef-7947-402a-a402-e41355a1191d\") "
Jul 27 15:52:35.892124 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.891894    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-home\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.892124 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.891915    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-tls-certs\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.892124 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.891973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-model-cache\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.892124 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.892001    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-model-cache" (OuterVolumeSpecName: "model-cache") pod "1b446eef-7947-402a-a402-e41355a1191d" (UID: "1b446eef-7947-402a-a402-e41355a1191d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:52:35.892124 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.892017    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1b446eef-7947-402a-a402-e41355a1191d" (UID: "1b446eef-7947-402a-a402-e41355a1191d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:52:35.892124 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.892008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-tmp-dir\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.892124 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.892032    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-home" (OuterVolumeSpecName: "home") pod "1b446eef-7947-402a-a402-e41355a1191d" (UID: "1b446eef-7947-402a-a402-e41355a1191d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:52:35.892124 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.892086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-dshm\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.892124 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.892116    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdd6w\" (UniqueName: \"kubernetes.io/projected/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-kube-api-access-rdd6w\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.892496 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.892164    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-model-cache\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:52:35.892496 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.892181    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-tmp-dir\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:52:35.892496 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.892197    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-home\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:52:35.894193 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.894163    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-dshm" (OuterVolumeSpecName: "dshm") pod "1b446eef-7947-402a-a402-e41355a1191d" (UID: "1b446eef-7947-402a-a402-e41355a1191d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:52:35.894298 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.894208    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b446eef-7947-402a-a402-e41355a1191d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1b446eef-7947-402a-a402-e41355a1191d" (UID: "1b446eef-7947-402a-a402-e41355a1191d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:52:35.894298 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.894255    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b446eef-7947-402a-a402-e41355a1191d-kube-api-access-rrmqh" (OuterVolumeSpecName: "kube-api-access-rrmqh") pod "1b446eef-7947-402a-a402-e41355a1191d" (UID: "1b446eef-7947-402a-a402-e41355a1191d"). InnerVolumeSpecName "kube-api-access-rrmqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:52:35.993498 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.993450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-model-cache\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.993498 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.993500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-tmp-dir\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.993749 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.993530    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-dshm\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.993749 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.993554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdd6w\" (UniqueName: \"kubernetes.io/projected/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-kube-api-access-rdd6w\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.993749 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.993614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-home\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.993749 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.993635    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-tls-certs\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.993749 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.993695    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b446eef-7947-402a-a402-e41355a1191d-dshm\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:52:35.993749 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.993709    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrmqh\" (UniqueName: \"kubernetes.io/projected/1b446eef-7947-402a-a402-e41355a1191d-kube-api-access-rrmqh\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:52:35.993749 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.993721    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b446eef-7947-402a-a402-e41355a1191d-tls-certs\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:52:35.994060 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.993913    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-model-cache\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.994060 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.993941    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-tmp-dir\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.994060 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.993982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-home\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.995907 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.995881    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-dshm\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:35.996149 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:35.996133    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-tls-certs\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:36.003852 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.003831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdd6w\" (UniqueName: \"kubernetes.io/projected/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-kube-api-access-rdd6w\") pod \"sub-test-model-f58a29-kserve-75479b4f89-jkkgd\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") " pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:36.105599 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.105514    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:36.107027 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.107000    2559 generic.go:356] "Generic (PLEG): container finished" podID="1b446eef-7947-402a-a402-e41355a1191d" containerID="98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7" exitCode=0
Jul 27 15:52:36.107150 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.107048    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"
Jul 27 15:52:36.107150 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.107063    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47" event={"ID":"1b446eef-7947-402a-a402-e41355a1191d","Type":"ContainerDied","Data":"98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7"}
Jul 27 15:52:36.107150 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.107097    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47" event={"ID":"1b446eef-7947-402a-a402-e41355a1191d","Type":"ContainerDied","Data":"bd97414a17d3bfd661cf637755106d67dbfa934d452e22f5604a810fa0ce7fac"}
Jul 27 15:52:36.107150 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.107115    2559 scope.go:117] "RemoveContainer" containerID="98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7"
Jul 27 15:52:36.119233 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.119209    2559 scope.go:117] "RemoveContainer" containerID="98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7"
Jul 27 15:52:36.119553 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:52:36.119534    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7\": container with ID starting with 98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7 not found: ID does not exist" containerID="98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7"
Jul 27 15:52:36.119615 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.119563    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7"} err="failed to get container status \"98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7\": rpc error: code = NotFound desc = could not find container \"98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7\": container with ID starting with 98193440d42c077556868d25cf123b41553acaad2402f36bf3fc58862641acb7 not found: ID does not exist"
Jul 27 15:52:36.132194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.132139    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"]
Jul 27 15:52:36.135681 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.135656    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-052d16/auth-test-model-052d16-kserve-66f8cc99bc-kdh47"]
Jul 27 15:52:36.246095 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.246071    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"]
Jul 27 15:52:36.246938 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:52:36.246911    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff7ee227_8bf4_42ab_b7f3_895fb9e7fc21.slice/crio-0721a4ef83220de4dda81bf12fbbd360abbe83db2476f51a3784f47e7bfd5cbe WatchSource:0}: Error finding container 0721a4ef83220de4dda81bf12fbbd360abbe83db2476f51a3784f47e7bfd5cbe: Status 404 returned error can't find the container with id 0721a4ef83220de4dda81bf12fbbd360abbe83db2476f51a3784f47e7bfd5cbe
Jul 27 15:52:36.712711 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:36.712680    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b446eef-7947-402a-a402-e41355a1191d" path="/var/lib/kubelet/pods/1b446eef-7947-402a-a402-e41355a1191d/volumes"
Jul 27 15:52:37.113464 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:37.113358    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd" event={"ID":"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21","Type":"ContainerStarted","Data":"fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37"}
Jul 27 15:52:37.113464 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:37.113411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd" event={"ID":"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21","Type":"ContainerStarted","Data":"0721a4ef83220de4dda81bf12fbbd360abbe83db2476f51a3784f47e7bfd5cbe"}
Jul 27 15:52:37.132927 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:37.132871    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd" podStartSLOduration=2.132854547 podStartE2EDuration="2.132854547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:37.132011534 +0000 UTC m=+2812.996589401" watchObservedRunningTime="2026-07-27 15:52:37.132854547 +0000 UTC m=+2812.997432412"
Jul 27 15:52:46.106412 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:46.106378    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:46.106733 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:46.106423    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:46.118349 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:46.118311    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:52:46.170294 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:52:46.170275    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:54:00.490646 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:00.490615    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"]
Jul 27 15:54:11.085330 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.085290    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"]
Jul 27 15:54:11.085854 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.085834    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b446eef-7947-402a-a402-e41355a1191d" containerName="main"
Jul 27 15:54:11.085930 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.085857    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b446eef-7947-402a-a402-e41355a1191d" containerName="main"
Jul 27 15:54:11.085982 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.085958    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b446eef-7947-402a-a402-e41355a1191d" containerName="main"
Jul 27 15:54:11.088870 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.088847    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.091928 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.091903    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f58a29\"/\"rate-test-model-f58a29-kserve-self-signed-certs\""
Jul 27 15:54:11.099904 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.099876    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"]
Jul 27 15:54:11.145617 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.145579    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l75wl\" (UniqueName: \"kubernetes.io/projected/e741ff27-98e5-48d7-86b7-5cc7053728e1-kube-api-access-l75wl\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.145944 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.145921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e741ff27-98e5-48d7-86b7-5cc7053728e1-tls-certs\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.146138 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.146121    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-tmp-dir\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.146334 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.146279    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-model-cache\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.146458 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.146362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-home\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.146458 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.146426    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-dshm\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.247389 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.247352    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l75wl\" (UniqueName: \"kubernetes.io/projected/e741ff27-98e5-48d7-86b7-5cc7053728e1-kube-api-access-l75wl\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.247389 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.247391    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e741ff27-98e5-48d7-86b7-5cc7053728e1-tls-certs\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.247647 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.247521    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-tmp-dir\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.247647 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.247568    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-model-cache\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.247647 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.247594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-home\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.247647 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.247649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-dshm\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.247883 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.247867    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-tmp-dir\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.247956 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.247938    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-model-cache\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.248042 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.248024    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-home\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.249818 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.249800    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-dshm\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.249965 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.249948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e741ff27-98e5-48d7-86b7-5cc7053728e1-tls-certs\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.256669 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.256643    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l75wl\" (UniqueName: \"kubernetes.io/projected/e741ff27-98e5-48d7-86b7-5cc7053728e1-kube-api-access-l75wl\") pod \"rate-test-model-f58a29-kserve-5cdfd9d647-886sf\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") " pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.399631 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.399538    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:11.538501 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.538470    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"]
Jul 27 15:54:11.538775 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:54:11.538756    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode741ff27_98e5_48d7_86b7_5cc7053728e1.slice/crio-4153d8bf9e28eb9d37d518d050653c6ea36b5fb7025278bb967133d42c9d2419 WatchSource:0}: Error finding container 4153d8bf9e28eb9d37d518d050653c6ea36b5fb7025278bb967133d42c9d2419: Status 404 returned error can't find the container with id 4153d8bf9e28eb9d37d518d050653c6ea36b5fb7025278bb967133d42c9d2419
Jul 27 15:54:11.582377 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:11.582344    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf" event={"ID":"e741ff27-98e5-48d7-86b7-5cc7053728e1","Type":"ContainerStarted","Data":"4153d8bf9e28eb9d37d518d050653c6ea36b5fb7025278bb967133d42c9d2419"}
Jul 27 15:54:12.588859 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:12.588820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf" event={"ID":"e741ff27-98e5-48d7-86b7-5cc7053728e1","Type":"ContainerStarted","Data":"b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4"}
Jul 27 15:54:12.609655 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:12.609604    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf" podStartSLOduration=1.6095896710000002 podStartE2EDuration="1.609589671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:54:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:12.606475705 +0000 UTC m=+2908.471053589" watchObservedRunningTime="2026-07-27 15:54:12.609589671 +0000 UTC m=+2908.474167535"
Jul 27 15:54:15.508996 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.508938    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd" podUID="ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21" containerName="main" containerID="cri-o://fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37" gracePeriod=45
Jul 27 15:54:15.757936 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.757912    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:54:15.888651 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.888593    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdd6w\" (UniqueName: \"kubernetes.io/projected/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-kube-api-access-rdd6w\") pod \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") "
Jul 27 15:54:15.888651 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.888635    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-tls-certs\") pod \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") "
Jul 27 15:54:15.888836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.888665    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-tmp-dir\") pod \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") "
Jul 27 15:54:15.888836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.888708    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-dshm\") pod \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") "
Jul 27 15:54:15.888836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.888740    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-model-cache\") pod \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") "
Jul 27 15:54:15.888836 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.888804    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-home\") pod \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\" (UID: \"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21\") "
Jul 27 15:54:15.889039 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.888978    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21" (UID: "ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:54:15.889092 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.889059    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-model-cache" (OuterVolumeSpecName: "model-cache") pod "ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21" (UID: "ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:54:15.889217 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.889193    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-home" (OuterVolumeSpecName: "home") pod "ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21" (UID: "ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:54:15.890874 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.890847    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-dshm" (OuterVolumeSpecName: "dshm") pod "ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21" (UID: "ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:54:15.890874 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.890865    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21" (UID: "ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:54:15.890985 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.890903    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-kube-api-access-rdd6w" (OuterVolumeSpecName: "kube-api-access-rdd6w") pod "ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21" (UID: "ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21"). InnerVolumeSpecName "kube-api-access-rdd6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:54:15.989994 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.989967    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-home\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:54:15.989994 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.989990    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdd6w\" (UniqueName: \"kubernetes.io/projected/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-kube-api-access-rdd6w\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:54:15.990119 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.990003    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-tls-certs\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:54:15.990119 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.990016    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-tmp-dir\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:54:15.990119 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.990026    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-dshm\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:54:15.990119 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:15.990036    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21-model-cache\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:54:16.609684 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:16.609658    2559 generic.go:356] "Generic (PLEG): container finished" podID="ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21" containerID="fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37" exitCode=0
Jul 27 15:54:16.610010 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:16.609696    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"
Jul 27 15:54:16.610010 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:16.609712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd" event={"ID":"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21","Type":"ContainerDied","Data":"fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37"}
Jul 27 15:54:16.610010 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:16.609743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd" event={"ID":"ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21","Type":"ContainerDied","Data":"0721a4ef83220de4dda81bf12fbbd360abbe83db2476f51a3784f47e7bfd5cbe"}
Jul 27 15:54:16.610010 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:16.609760    2559 scope.go:117] "RemoveContainer" containerID="fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37"
Jul 27 15:54:16.618576 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:16.618558    2559 scope.go:117] "RemoveContainer" containerID="fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37"
Jul 27 15:54:16.618818 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:54:16.618801    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37\": container with ID starting with fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37 not found: ID does not exist" containerID="fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37"
Jul 27 15:54:16.618866 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:16.618825    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37"} err="failed to get container status \"fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37\": rpc error: code = NotFound desc = could not find container \"fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37\": container with ID starting with fb00039f83366288c3a72ba4484f408982ef939069680ab81a58c8540443db37 not found: ID does not exist"
Jul 27 15:54:16.633353 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:16.633330    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"]
Jul 27 15:54:16.637686 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:16.637662    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f58a29/sub-test-model-f58a29-kserve-75479b4f89-jkkgd"]
Jul 27 15:54:16.711868 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:16.711846    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21" path="/var/lib/kubelet/pods/ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21/volumes"
Jul 27 15:54:21.400106 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:21.400076    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:21.400106 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:21.400117    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:21.412048 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:21.412026    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:21.645890 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:21.645870    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:54:44.298955 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.298922    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"]
Jul 27 15:54:44.299397 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.299269    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21" containerName="main"
Jul 27 15:54:44.299397 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.299279    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21" containerName="main"
Jul 27 15:54:44.299397 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.299368    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7ee227-8bf4-42ab-b7f3-895fb9e7fc21" containerName="main"
Jul 27 15:54:44.302419 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.302391    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.305772 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.305749    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-052d16\"/\"default-dockercfg-4l8kt\""
Jul 27 15:54:44.307302 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.307282    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-052d16\"/\"rate-test-model-052d16-kserve-self-signed-certs\""
Jul 27 15:54:44.307423 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.307342    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-052d16\"/\"kube-root-ca.crt\""
Jul 27 15:54:44.307423 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.307287    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-052d16\"/\"openshift-service-ca.crt\""
Jul 27 15:54:44.315457 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.315432    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"]
Jul 27 15:54:44.402495 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.402466    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-tmp-dir\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.402621 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.402507    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-dshm\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.402662 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.402642    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-home\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.402714 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.402696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-model-cache\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.402753 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.402731    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mfwp\" (UniqueName: \"kubernetes.io/projected/1166f24b-c519-475c-8711-2ef353db4a0f-kube-api-access-9mfwp\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.402787 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.402760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1166f24b-c519-475c-8711-2ef353db4a0f-tls-certs\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.503579 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.503555    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-home\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.503679 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.503599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-model-cache\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.503679 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.503617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mfwp\" (UniqueName: \"kubernetes.io/projected/1166f24b-c519-475c-8711-2ef353db4a0f-kube-api-access-9mfwp\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.503679 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.503652    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1166f24b-c519-475c-8711-2ef353db4a0f-tls-certs\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.503817 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.503685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-tmp-dir\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.503868 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.503815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-dshm\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.503981 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.503959    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-home\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.504074 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.504002    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-model-cache\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.504153 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.504135    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-tmp-dir\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.505922 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.505890    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-dshm\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.506287 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.506267    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1166f24b-c519-475c-8711-2ef353db4a0f-tls-certs\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.513979 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.513958    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mfwp\" (UniqueName: \"kubernetes.io/projected/1166f24b-c519-475c-8711-2ef353db4a0f-kube-api-access-9mfwp\") pod \"rate-test-model-052d16-kserve-744c9444cf-289dm\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") " pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.617206 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.617154    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-052d16\"/\"default-dockercfg-4l8kt\""
Jul 27 15:54:44.624965 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.624949    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:44.757159 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:44.757135    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"]
Jul 27 15:54:44.757887 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:54:44.757864    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1166f24b_c519_475c_8711_2ef353db4a0f.slice/crio-91f47f45aec45ac333208f0863fe9dff52ab1cc8331f49ce1f2359ad22413b7d WatchSource:0}: Error finding container 91f47f45aec45ac333208f0863fe9dff52ab1cc8331f49ce1f2359ad22413b7d: Status 404 returned error can't find the container with id 91f47f45aec45ac333208f0863fe9dff52ab1cc8331f49ce1f2359ad22413b7d
Jul 27 15:54:45.755689 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:45.755661    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm" event={"ID":"1166f24b-c519-475c-8711-2ef353db4a0f","Type":"ContainerStarted","Data":"536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a"}
Jul 27 15:54:45.756027 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:45.755696    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm" event={"ID":"1166f24b-c519-475c-8711-2ef353db4a0f","Type":"ContainerStarted","Data":"91f47f45aec45ac333208f0863fe9dff52ab1cc8331f49ce1f2359ad22413b7d"}
Jul 27 15:54:45.776668 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:45.776624    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm" podStartSLOduration=1.776606452 podStartE2EDuration="1.776606452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:54:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:45.776015456 +0000 UTC m=+2941.640593323" watchObservedRunningTime="2026-07-27 15:54:45.776606452 +0000 UTC m=+2941.641184318"
Jul 27 15:54:54.625197 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:54.625162    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:54.625630 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:54.625209    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:54.636920 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:54.636899    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:54:54.808301 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:54:54.808277    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:56:03.861451 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:03.861420    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"]
Jul 27 15:56:04.770527 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:04.770490    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"]
Jul 27 15:56:18.879977 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:18.879929    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf" podUID="e741ff27-98e5-48d7-86b7-5cc7053728e1" containerName="main" containerID="cri-o://b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4" gracePeriod=45
Jul 27 15:56:19.124151 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.124128    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:56:19.216638 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.216617    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l75wl\" (UniqueName: \"kubernetes.io/projected/e741ff27-98e5-48d7-86b7-5cc7053728e1-kube-api-access-l75wl\") pod \"e741ff27-98e5-48d7-86b7-5cc7053728e1\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") "
Jul 27 15:56:19.216780 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.216659    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-dshm\") pod \"e741ff27-98e5-48d7-86b7-5cc7053728e1\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") "
Jul 27 15:56:19.216780 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.216686    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e741ff27-98e5-48d7-86b7-5cc7053728e1-tls-certs\") pod \"e741ff27-98e5-48d7-86b7-5cc7053728e1\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") "
Jul 27 15:56:19.216780 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.216710    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-tmp-dir\") pod \"e741ff27-98e5-48d7-86b7-5cc7053728e1\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") "
Jul 27 15:56:19.216780 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.216746    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-model-cache\") pod \"e741ff27-98e5-48d7-86b7-5cc7053728e1\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") "
Jul 27 15:56:19.216780 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.216763    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-home\") pod \"e741ff27-98e5-48d7-86b7-5cc7053728e1\" (UID: \"e741ff27-98e5-48d7-86b7-5cc7053728e1\") "
Jul 27 15:56:19.217051 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.217031    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e741ff27-98e5-48d7-86b7-5cc7053728e1" (UID: "e741ff27-98e5-48d7-86b7-5cc7053728e1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:56:19.217110 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.217062    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-model-cache" (OuterVolumeSpecName: "model-cache") pod "e741ff27-98e5-48d7-86b7-5cc7053728e1" (UID: "e741ff27-98e5-48d7-86b7-5cc7053728e1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:56:19.217162 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.217142    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-home" (OuterVolumeSpecName: "home") pod "e741ff27-98e5-48d7-86b7-5cc7053728e1" (UID: "e741ff27-98e5-48d7-86b7-5cc7053728e1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:56:19.218888 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.218859    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e741ff27-98e5-48d7-86b7-5cc7053728e1-kube-api-access-l75wl" (OuterVolumeSpecName: "kube-api-access-l75wl") pod "e741ff27-98e5-48d7-86b7-5cc7053728e1" (UID: "e741ff27-98e5-48d7-86b7-5cc7053728e1"). InnerVolumeSpecName "kube-api-access-l75wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:56:19.219013 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.218992    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-dshm" (OuterVolumeSpecName: "dshm") pod "e741ff27-98e5-48d7-86b7-5cc7053728e1" (UID: "e741ff27-98e5-48d7-86b7-5cc7053728e1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:56:19.219060 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.219026    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e741ff27-98e5-48d7-86b7-5cc7053728e1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e741ff27-98e5-48d7-86b7-5cc7053728e1" (UID: "e741ff27-98e5-48d7-86b7-5cc7053728e1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:56:19.222645 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.222625    2559 generic.go:356] "Generic (PLEG): container finished" podID="e741ff27-98e5-48d7-86b7-5cc7053728e1" containerID="b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4" exitCode=0
Jul 27 15:56:19.222743 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.222660    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"
Jul 27 15:56:19.222743 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.222710    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf" event={"ID":"e741ff27-98e5-48d7-86b7-5cc7053728e1","Type":"ContainerDied","Data":"b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4"}
Jul 27 15:56:19.222808 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.222749    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf" event={"ID":"e741ff27-98e5-48d7-86b7-5cc7053728e1","Type":"ContainerDied","Data":"4153d8bf9e28eb9d37d518d050653c6ea36b5fb7025278bb967133d42c9d2419"}
Jul 27 15:56:19.222808 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.222770    2559 scope.go:117] "RemoveContainer" containerID="b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4"
Jul 27 15:56:19.237194 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.237178    2559 scope.go:117] "RemoveContainer" containerID="b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4"
Jul 27 15:56:19.237465 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:56:19.237446    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4\": container with ID starting with b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4 not found: ID does not exist" containerID="b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4"
Jul 27 15:56:19.237526 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.237472    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4"} err="failed to get container status \"b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4\": rpc error: code = NotFound desc = could not find container \"b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4\": container with ID starting with b1ea45a1032e9ad91d3296762ef70a346646db21e3d0c2cf6630866a0445c5e4 not found: ID does not exist"
Jul 27 15:56:19.253816 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.253794    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"]
Jul 27 15:56:19.260204 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.260186    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f58a29/rate-test-model-f58a29-kserve-5cdfd9d647-886sf"]
Jul 27 15:56:19.317570 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.317546    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-dshm\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:56:19.317570 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.317568    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e741ff27-98e5-48d7-86b7-5cc7053728e1-tls-certs\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:56:19.317696 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.317582    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-tmp-dir\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:56:19.317696 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.317592    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-model-cache\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:56:19.317696 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.317602    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e741ff27-98e5-48d7-86b7-5cc7053728e1-home\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:56:19.317696 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.317614    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l75wl\" (UniqueName: \"kubernetes.io/projected/e741ff27-98e5-48d7-86b7-5cc7053728e1-kube-api-access-l75wl\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:56:19.788969 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:19.788942    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm" podUID="1166f24b-c519-475c-8711-2ef353db4a0f" containerName="main" containerID="cri-o://536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a" gracePeriod=45
Jul 27 15:56:20.026923 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.026900    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:56:20.122910 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.122847    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-dshm\") pod \"1166f24b-c519-475c-8711-2ef353db4a0f\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") "
Jul 27 15:56:20.122910 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.122888    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-model-cache\") pod \"1166f24b-c519-475c-8711-2ef353db4a0f\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") "
Jul 27 15:56:20.123066 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.122912    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-home\") pod \"1166f24b-c519-475c-8711-2ef353db4a0f\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") "
Jul 27 15:56:20.123066 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.122937    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mfwp\" (UniqueName: \"kubernetes.io/projected/1166f24b-c519-475c-8711-2ef353db4a0f-kube-api-access-9mfwp\") pod \"1166f24b-c519-475c-8711-2ef353db4a0f\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") "
Jul 27 15:56:20.123066 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.122964    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-tmp-dir\") pod \"1166f24b-c519-475c-8711-2ef353db4a0f\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") "
Jul 27 15:56:20.123066 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.123004    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1166f24b-c519-475c-8711-2ef353db4a0f-tls-certs\") pod \"1166f24b-c519-475c-8711-2ef353db4a0f\" (UID: \"1166f24b-c519-475c-8711-2ef353db4a0f\") "
Jul 27 15:56:20.123273 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.123108    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-model-cache" (OuterVolumeSpecName: "model-cache") pod "1166f24b-c519-475c-8711-2ef353db4a0f" (UID: "1166f24b-c519-475c-8711-2ef353db4a0f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:56:20.123273 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.123132    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-home" (OuterVolumeSpecName: "home") pod "1166f24b-c519-475c-8711-2ef353db4a0f" (UID: "1166f24b-c519-475c-8711-2ef353db4a0f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:56:20.123273 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.123233    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1166f24b-c519-475c-8711-2ef353db4a0f" (UID: "1166f24b-c519-475c-8711-2ef353db4a0f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:56:20.123463 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.123371    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-model-cache\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:56:20.123463 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.123387    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-home\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:56:20.123463 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.123399    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-tmp-dir\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:56:20.125107 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.125082    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1166f24b-c519-475c-8711-2ef353db4a0f-kube-api-access-9mfwp" (OuterVolumeSpecName: "kube-api-access-9mfwp") pod "1166f24b-c519-475c-8711-2ef353db4a0f" (UID: "1166f24b-c519-475c-8711-2ef353db4a0f"). InnerVolumeSpecName "kube-api-access-9mfwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:56:20.125107 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.125096    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-dshm" (OuterVolumeSpecName: "dshm") pod "1166f24b-c519-475c-8711-2ef353db4a0f" (UID: "1166f24b-c519-475c-8711-2ef353db4a0f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:56:20.125275 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.125217    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1166f24b-c519-475c-8711-2ef353db4a0f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1166f24b-c519-475c-8711-2ef353db4a0f" (UID: "1166f24b-c519-475c-8711-2ef353db4a0f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:56:20.224412 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.224389    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1166f24b-c519-475c-8711-2ef353db4a0f-dshm\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:56:20.224412 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.224409    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mfwp\" (UniqueName: \"kubernetes.io/projected/1166f24b-c519-475c-8711-2ef353db4a0f-kube-api-access-9mfwp\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:56:20.224535 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.224420    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1166f24b-c519-475c-8711-2ef353db4a0f-tls-certs\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:56:20.229203 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.229183    2559 generic.go:356] "Generic (PLEG): container finished" podID="1166f24b-c519-475c-8711-2ef353db4a0f" containerID="536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a" exitCode=0
Jul 27 15:56:20.229288 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.229223    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"
Jul 27 15:56:20.229288 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.229267    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm" event={"ID":"1166f24b-c519-475c-8711-2ef353db4a0f","Type":"ContainerDied","Data":"536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a"}
Jul 27 15:56:20.229385 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.229299    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm" event={"ID":"1166f24b-c519-475c-8711-2ef353db4a0f","Type":"ContainerDied","Data":"91f47f45aec45ac333208f0863fe9dff52ab1cc8331f49ce1f2359ad22413b7d"}
Jul 27 15:56:20.229385 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.229333    2559 scope.go:117] "RemoveContainer" containerID="536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a"
Jul 27 15:56:20.238462 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.238446    2559 scope.go:117] "RemoveContainer" containerID="536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a"
Jul 27 15:56:20.238697 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:56:20.238679    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a\": container with ID starting with 536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a not found: ID does not exist" containerID="536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a"
Jul 27 15:56:20.238745 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.238704    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a"} err="failed to get container status \"536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a\": rpc error: code = NotFound desc = could not find container \"536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a\": container with ID starting with 536431f242300b4a083c53d5682a50439bc9750c87929534e648206f62b5ea6a not found: ID does not exist"
Jul 27 15:56:20.253581 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.253561    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"]
Jul 27 15:56:20.257240 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.257217    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-052d16/rate-test-model-052d16-kserve-744c9444cf-289dm"]
Jul 27 15:56:20.711507 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.711478    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1166f24b-c519-475c-8711-2ef353db4a0f" path="/var/lib/kubelet/pods/1166f24b-c519-475c-8711-2ef353db4a0f/volumes"
Jul 27 15:56:20.711913 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:20.711894    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e741ff27-98e5-48d7-86b7-5cc7053728e1" path="/var/lib/kubelet/pods/e741ff27-98e5-48d7-86b7-5cc7053728e1/volumes"
Jul 27 15:56:48.263971 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.263943    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"]
Jul 27 15:56:48.264360 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.264308    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e741ff27-98e5-48d7-86b7-5cc7053728e1" containerName="main"
Jul 27 15:56:48.264360 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.264342    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e741ff27-98e5-48d7-86b7-5cc7053728e1" containerName="main"
Jul 27 15:56:48.264360 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.264350    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1166f24b-c519-475c-8711-2ef353db4a0f" containerName="main"
Jul 27 15:56:48.264360 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.264356    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1166f24b-c519-475c-8711-2ef353db4a0f" containerName="main"
Jul 27 15:56:48.264499 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.264415    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1166f24b-c519-475c-8711-2ef353db4a0f" containerName="main"
Jul 27 15:56:48.264499 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.264425    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e741ff27-98e5-48d7-86b7-5cc7053728e1" containerName="main"
Jul 27 15:56:48.268574 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.268558    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"
Jul 27 15:56:48.274049 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.274021    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-809b00\""
Jul 27 15:56:48.274175 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.274072    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-809b00-dockercfg-j57kw\""
Jul 27 15:56:48.297381 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.297358    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"]
Jul 27 15:56:48.300575 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.300561    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"
Jul 27 15:56:48.312960 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.312942    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"]
Jul 27 15:56:48.319872 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.319852    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb879d5-e717-4099-8dcf-9f59cfabc1bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc\" (UID: \"2bb879d5-e717-4099-8dcf-9f59cfabc1bf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"
Jul 27 15:56:48.319951 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.319886    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/578aea5f-a838-4ee3-b235-2c7bcbd2dab7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj\" (UID: \"578aea5f-a838-4ee3-b235-2c7bcbd2dab7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"
Jul 27 15:56:48.320004 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.319965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9shg6\" (UniqueName: \"kubernetes.io/projected/2bb879d5-e717-4099-8dcf-9f59cfabc1bf-kube-api-access-9shg6\") pod \"payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc\" (UID: \"2bb879d5-e717-4099-8dcf-9f59cfabc1bf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"
Jul 27 15:56:48.320041 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.320020    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xknq\" (UniqueName: \"kubernetes.io/projected/578aea5f-a838-4ee3-b235-2c7bcbd2dab7-kube-api-access-8xknq\") pod \"payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj\" (UID: \"578aea5f-a838-4ee3-b235-2c7bcbd2dab7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"
Jul 27 15:56:48.356145 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.356125    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"]
Jul 27 15:56:48.420759 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.420731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xknq\" (UniqueName: \"kubernetes.io/projected/578aea5f-a838-4ee3-b235-2c7bcbd2dab7-kube-api-access-8xknq\") pod \"payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj\" (UID: \"578aea5f-a838-4ee3-b235-2c7bcbd2dab7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"
Jul 27 15:56:48.420877 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.420792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb879d5-e717-4099-8dcf-9f59cfabc1bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc\" (UID: \"2bb879d5-e717-4099-8dcf-9f59cfabc1bf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"
Jul 27 15:56:48.420877 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.420835    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/578aea5f-a838-4ee3-b235-2c7bcbd2dab7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj\" (UID: \"578aea5f-a838-4ee3-b235-2c7bcbd2dab7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"
Jul 27 15:56:48.420991 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.420920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9shg6\" (UniqueName: \"kubernetes.io/projected/2bb879d5-e717-4099-8dcf-9f59cfabc1bf-kube-api-access-9shg6\") pod \"payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc\" (UID: \"2bb879d5-e717-4099-8dcf-9f59cfabc1bf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"
Jul 27 15:56:48.421502 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.421483    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb879d5-e717-4099-8dcf-9f59cfabc1bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc\" (UID: \"2bb879d5-e717-4099-8dcf-9f59cfabc1bf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"
Jul 27 15:56:48.421582 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.421547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/578aea5f-a838-4ee3-b235-2c7bcbd2dab7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj\" (UID: \"578aea5f-a838-4ee3-b235-2c7bcbd2dab7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"
Jul 27 15:56:48.429934 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.429911    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9shg6\" (UniqueName: \"kubernetes.io/projected/2bb879d5-e717-4099-8dcf-9f59cfabc1bf-kube-api-access-9shg6\") pod \"payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc\" (UID: \"2bb879d5-e717-4099-8dcf-9f59cfabc1bf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"
Jul 27 15:56:48.430221 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.430198    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xknq\" (UniqueName: \"kubernetes.io/projected/578aea5f-a838-4ee3-b235-2c7bcbd2dab7-kube-api-access-8xknq\") pod \"payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj\" (UID: \"578aea5f-a838-4ee3-b235-2c7bcbd2dab7\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"
Jul 27 15:56:48.578491 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.578435    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"
Jul 27 15:56:48.610290 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.610263    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"
Jul 27 15:56:48.735926 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.735894    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"]
Jul 27 15:56:48.737552 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:56:48.737526    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578aea5f_a838_4ee3_b235_2c7bcbd2dab7.slice/crio-40cf0a8d21165f39ea433d39252933c80191e6257b50f50f24082f921ddf5154 WatchSource:0}: Error finding container 40cf0a8d21165f39ea433d39252933c80191e6257b50f50f24082f921ddf5154: Status 404 returned error can't find the container with id 40cf0a8d21165f39ea433d39252933c80191e6257b50f50f24082f921ddf5154
Jul 27 15:56:48.960111 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:48.960077    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"]
Jul 27 15:56:48.961045 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:56:48.961021    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb879d5_e717_4099_8dcf_9f59cfabc1bf.slice/crio-f35597fdc04129f45655bcb5bddae9085ba4bf0fa6b3e7de831a49b31ee5fcb1 WatchSource:0}: Error finding container f35597fdc04129f45655bcb5bddae9085ba4bf0fa6b3e7de831a49b31ee5fcb1: Status 404 returned error can't find the container with id f35597fdc04129f45655bcb5bddae9085ba4bf0fa6b3e7de831a49b31ee5fcb1
Jul 27 15:56:49.382724 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:49.382648    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc" event={"ID":"2bb879d5-e717-4099-8dcf-9f59cfabc1bf","Type":"ContainerStarted","Data":"08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd"}
Jul 27 15:56:49.382724 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:49.382702    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc" event={"ID":"2bb879d5-e717-4099-8dcf-9f59cfabc1bf","Type":"ContainerStarted","Data":"f35597fdc04129f45655bcb5bddae9085ba4bf0fa6b3e7de831a49b31ee5fcb1"}
Jul 27 15:56:49.383121 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:49.382730    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"
Jul 27 15:56:49.384245 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:49.384222    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj" event={"ID":"578aea5f-a838-4ee3-b235-2c7bcbd2dab7","Type":"ContainerStarted","Data":"a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac"}
Jul 27 15:56:49.384369 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:49.384264    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj" event={"ID":"578aea5f-a838-4ee3-b235-2c7bcbd2dab7","Type":"ContainerStarted","Data":"40cf0a8d21165f39ea433d39252933c80191e6257b50f50f24082f921ddf5154"}
Jul 27 15:56:49.384369 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:49.384308    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"
Jul 27 15:56:49.405251 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:49.405207    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc" podStartSLOduration=1.405194314 podStartE2EDuration="1.405194314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:56:49.402190902 +0000 UTC m=+3065.266768769" watchObservedRunningTime="2026-07-27 15:56:49.405194314 +0000 UTC m=+3065.269772180"
Jul 27 15:56:49.424042 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:56:49.423995    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj" podStartSLOduration=1.423983459 podStartE2EDuration="1.423983459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:56:49.421744502 +0000 UTC m=+3065.286322370" watchObservedRunningTime="2026-07-27 15:56:49.423983459 +0000 UTC m=+3065.288561324"
Jul 27 15:57:00.390797 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:00.390769    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"
Jul 27 15:57:00.391366 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:00.390838    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"
Jul 27 15:57:08.982068 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:08.982030    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-j5jfp_c8a5c866-9604-4af5-b222-ac22c28b73d7/payload-processing/0.log"
Jul 27 15:57:09.109466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:09.109431    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj_578aea5f-a838-4ee3-b235-2c7bcbd2dab7/payload-processing/0.log"
Jul 27 15:57:20.929031 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:20.928998    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"]
Jul 27 15:57:20.932468 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:20.932450    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:20.936624 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:20.936589    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-c4dbeb\"/\"kube-root-ca.crt\""
Jul 27 15:57:20.937698 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:20.937675    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-c4dbeb\"/\"ipp-route-c4dbeb-kserve-self-signed-certs\""
Jul 27 15:57:20.937826 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:20.937749    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-c4dbeb\"/\"openshift-service-ca.crt\""
Jul 27 15:57:20.937941 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:20.937922    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-c4dbeb\"/\"default-dockercfg-bpb2s\""
Jul 27 15:57:20.952523 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:20.952498    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"]
Jul 27 15:57:21.053027 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.053009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-home\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.053120 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.053031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-dshm\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.053120 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.053089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-model-cache\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.053120 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.053111    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgf2w\" (UniqueName: \"kubernetes.io/projected/26c870a1-7d59-40b7-99f7-c7a9de79685f-kube-api-access-pgf2w\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.053235 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.053127    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-tmp-dir\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.053235 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.053145    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26c870a1-7d59-40b7-99f7-c7a9de79685f-tls-certs\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.154269 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.154244    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-home\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.154374 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.154271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-dshm\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.154374 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.154345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-model-cache\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.154374 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.154368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgf2w\" (UniqueName: \"kubernetes.io/projected/26c870a1-7d59-40b7-99f7-c7a9de79685f-kube-api-access-pgf2w\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.154479 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.154394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-tmp-dir\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.154479 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.154433    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26c870a1-7d59-40b7-99f7-c7a9de79685f-tls-certs\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.154682 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.154663    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-home\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.154722 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.154705    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-tmp-dir\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.154844 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.154821    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-model-cache\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.156628 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.156605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-dshm\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.156948 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.156931    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26c870a1-7d59-40b7-99f7-c7a9de79685f-tls-certs\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.162817 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.162799    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgf2w\" (UniqueName: \"kubernetes.io/projected/26c870a1-7d59-40b7-99f7-c7a9de79685f-kube-api-access-pgf2w\") pod \"ipp-route-c4dbeb-kserve-57f78999-bnqgp\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") " pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.243862 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.243814    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:21.382053 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.382026    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"]
Jul 27 15:57:21.383550 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:57:21.383527    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26c870a1_7d59_40b7_99f7_c7a9de79685f.slice/crio-275190229c728cd02606b90793ca68d313fed36390722500930f2a5dc0004c13 WatchSource:0}: Error finding container 275190229c728cd02606b90793ca68d313fed36390722500930f2a5dc0004c13: Status 404 returned error can't find the container with id 275190229c728cd02606b90793ca68d313fed36390722500930f2a5dc0004c13
Jul 27 15:57:21.546605 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.546525    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp" event={"ID":"26c870a1-7d59-40b7-99f7-c7a9de79685f","Type":"ContainerStarted","Data":"b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe"}
Jul 27 15:57:21.546605 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.546566    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp" event={"ID":"26c870a1-7d59-40b7-99f7-c7a9de79685f","Type":"ContainerStarted","Data":"275190229c728cd02606b90793ca68d313fed36390722500930f2a5dc0004c13"}
Jul 27 15:57:21.568791 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:21.568742    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp" podStartSLOduration=1.568728653 podStartE2EDuration="1.568728653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:21.567340766 +0000 UTC m=+3097.431918627" watchObservedRunningTime="2026-07-27 15:57:21.568728653 +0000 UTC m=+3097.433306517"
Jul 27 15:57:31.244588 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:31.244558    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:31.244588 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:31.244596    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:31.256136 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:31.256115    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:57:31.603589 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:57:31.603528    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:58:04.316609 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:04.316579    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-j5jfp_c8a5c866-9604-4af5-b222-ac22c28b73d7/payload-processing/0.log"
Jul 27 15:58:04.443709 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:04.443689    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj_578aea5f-a838-4ee3-b235-2c7bcbd2dab7/payload-processing/0.log"
Jul 27 15:58:09.751497 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.751423    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"]
Jul 27 15:58:09.754746 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.754730    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"
Jul 27 15:58:09.757508 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.757489    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-4cd197\""
Jul 27 15:58:09.765990 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.765969    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"]
Jul 27 15:58:09.799007 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.798985    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"]
Jul 27 15:58:09.802507 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.802490    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"
Jul 27 15:58:09.806471 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.806454    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-4cd197-dockercfg-4cgjw\""
Jul 27 15:58:09.812985 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.812958    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2\" (UID: \"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"
Jul 27 15:58:09.813149 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.813132    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzvjs\" (UniqueName: \"kubernetes.io/projected/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0-kube-api-access-mzvjs\") pod \"payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2\" (UID: \"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"
Jul 27 15:58:09.816413 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.816395    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"]
Jul 27 15:58:09.913884 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.913857    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rn26\" (UniqueName: \"kubernetes.io/projected/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf-kube-api-access-5rn26\") pod \"payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2\" (UID: \"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"
Jul 27 15:58:09.914016 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.913900    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2\" (UID: \"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"
Jul 27 15:58:09.914016 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.913923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2\" (UID: \"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"
Jul 27 15:58:09.914016 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.913953    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzvjs\" (UniqueName: \"kubernetes.io/projected/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0-kube-api-access-mzvjs\") pod \"payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2\" (UID: \"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"
Jul 27 15:58:09.914652 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.914634    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2\" (UID: \"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"
Jul 27 15:58:09.925623 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:09.925598    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzvjs\" (UniqueName: \"kubernetes.io/projected/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0-kube-api-access-mzvjs\") pod \"payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2\" (UID: \"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"
Jul 27 15:58:10.014863 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.014815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rn26\" (UniqueName: \"kubernetes.io/projected/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf-kube-api-access-5rn26\") pod \"payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2\" (UID: \"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"
Jul 27 15:58:10.014863 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.014847    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2\" (UID: \"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"
Jul 27 15:58:10.015458 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.015443    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2\" (UID: \"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"
Jul 27 15:58:10.023056 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.023035    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rn26\" (UniqueName: \"kubernetes.io/projected/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf-kube-api-access-5rn26\") pod \"payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2\" (UID: \"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"
Jul 27 15:58:10.064846 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.064829    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"
Jul 27 15:58:10.111738 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.111708    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"
Jul 27 15:58:10.422281 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.422253    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"]
Jul 27 15:58:10.423193 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:58:10.423170    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bf3057_df1a_4752_9cc8_6a3b4bed78c0.slice/crio-aa2380b0ce4a41d1b90982b865c26145c309d8e0172c994cf312ea1db2392470 WatchSource:0}: Error finding container aa2380b0ce4a41d1b90982b865c26145c309d8e0172c994cf312ea1db2392470: Status 404 returned error can't find the container with id aa2380b0ce4a41d1b90982b865c26145c309d8e0172c994cf312ea1db2392470
Jul 27 15:58:10.464570 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.464545    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"]
Jul 27 15:58:10.464662 ip-10-0-143-164 kubenswrapper[2559]: W0727 15:58:10.464563    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf996f5_8fff_4cd2_a175_ed8cbd05aecf.slice/crio-d5f1e87131081ef363c1b1e850b30ecf1669519a506d342f19b4aeb26ca63409 WatchSource:0}: Error finding container d5f1e87131081ef363c1b1e850b30ecf1669519a506d342f19b4aeb26ca63409: Status 404 returned error can't find the container with id d5f1e87131081ef363c1b1e850b30ecf1669519a506d342f19b4aeb26ca63409
Jul 27 15:58:10.797334 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.797224    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2" event={"ID":"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0","Type":"ContainerStarted","Data":"eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294"}
Jul 27 15:58:10.797334 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.797283    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2" event={"ID":"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0","Type":"ContainerStarted","Data":"aa2380b0ce4a41d1b90982b865c26145c309d8e0172c994cf312ea1db2392470"}
Jul 27 15:58:10.797758 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.797343    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"
Jul 27 15:58:10.798795 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.798779    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2" event={"ID":"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf","Type":"ContainerStarted","Data":"75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7"}
Jul 27 15:58:10.798848 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.798812    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2" event={"ID":"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf","Type":"ContainerStarted","Data":"d5f1e87131081ef363c1b1e850b30ecf1669519a506d342f19b4aeb26ca63409"}
Jul 27 15:58:10.798916 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.798899    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"
Jul 27 15:58:10.816432 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.816388    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2" podStartSLOduration=1.816375676 podStartE2EDuration="1.816375676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:58:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:58:10.815058329 +0000 UTC m=+3146.679636194" watchObservedRunningTime="2026-07-27 15:58:10.816375676 +0000 UTC m=+3146.680953540"
Jul 27 15:58:10.839798 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:10.839754    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2" podStartSLOduration=1.8397428329999999 podStartE2EDuration="1.839742833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:58:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:58:10.836654259 +0000 UTC m=+3146.701232124" watchObservedRunningTime="2026-07-27 15:58:10.839742833 +0000 UTC m=+3146.704320739"
Jul 27 15:58:21.805588 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:21.805553    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"
Jul 27 15:58:21.806076 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:21.805720    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"
Jul 27 15:58:34.953650 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:34.953611    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"]
Jul 27 15:58:34.954087 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:34.953866    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2" podUID="0cf996f5-8fff-4cd2-a175-ed8cbd05aecf" containerName="payload-processing" containerID="cri-o://75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7" gracePeriod=30
Jul 27 15:58:34.960040 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:34.960011    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"]
Jul 27 15:58:34.960341 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:34.960249    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2" podUID="a4bf3057-df1a-4752-9cc8-6a3b4bed78c0" containerName="payload-pre-processing" containerID="cri-o://eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294" gracePeriod=30
Jul 27 15:58:35.211858 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.211800    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"
Jul 27 15:58:35.231567 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.231542    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"
Jul 27 15:58:35.303239 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.303218    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzvjs\" (UniqueName: \"kubernetes.io/projected/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0-kube-api-access-mzvjs\") pod \"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0\" (UID: \"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0\") "
Jul 27 15:58:35.303378 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.303284    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rn26\" (UniqueName: \"kubernetes.io/projected/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf-kube-api-access-5rn26\") pod \"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf\" (UID: \"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf\") "
Jul 27 15:58:35.303378 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.303347    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0-plugins-config-volume\") pod \"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0\" (UID: \"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0\") "
Jul 27 15:58:35.303466 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.303380    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf-plugins-config-volume\") pod \"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf\" (UID: \"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf\") "
Jul 27 15:58:35.303713 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.303687    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a4bf3057-df1a-4752-9cc8-6a3b4bed78c0" (UID: "a4bf3057-df1a-4752-9cc8-6a3b4bed78c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:58:35.303816 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.303799    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0cf996f5-8fff-4cd2-a175-ed8cbd05aecf" (UID: "0cf996f5-8fff-4cd2-a175-ed8cbd05aecf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:58:35.305370 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.305351    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf-kube-api-access-5rn26" (OuterVolumeSpecName: "kube-api-access-5rn26") pod "0cf996f5-8fff-4cd2-a175-ed8cbd05aecf" (UID: "0cf996f5-8fff-4cd2-a175-ed8cbd05aecf"). InnerVolumeSpecName "kube-api-access-5rn26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:58:35.305370 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.305362    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0-kube-api-access-mzvjs" (OuterVolumeSpecName: "kube-api-access-mzvjs") pod "a4bf3057-df1a-4752-9cc8-6a3b4bed78c0" (UID: "a4bf3057-df1a-4752-9cc8-6a3b4bed78c0"). InnerVolumeSpecName "kube-api-access-mzvjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:58:35.404704 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.404683    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:58:35.404704 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.404703    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:58:35.404831 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.404713    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzvjs\" (UniqueName: \"kubernetes.io/projected/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0-kube-api-access-mzvjs\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:58:35.404831 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.404721    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rn26\" (UniqueName: \"kubernetes.io/projected/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf-kube-api-access-5rn26\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:58:35.926433 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.926407    2559 generic.go:356] "Generic (PLEG): container finished" podID="a4bf3057-df1a-4752-9cc8-6a3b4bed78c0" containerID="eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294" exitCode=0
Jul 27 15:58:35.926556 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.926454    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"
Jul 27 15:58:35.926556 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.926497    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2" event={"ID":"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0","Type":"ContainerDied","Data":"eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294"}
Jul 27 15:58:35.926556 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.926541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2" event={"ID":"a4bf3057-df1a-4752-9cc8-6a3b4bed78c0","Type":"ContainerDied","Data":"aa2380b0ce4a41d1b90982b865c26145c309d8e0172c994cf312ea1db2392470"}
Jul 27 15:58:35.926682 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.926572    2559 scope.go:117] "RemoveContainer" containerID="eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294"
Jul 27 15:58:35.927888 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.927862    2559 generic.go:356] "Generic (PLEG): container finished" podID="0cf996f5-8fff-4cd2-a175-ed8cbd05aecf" containerID="75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7" exitCode=0
Jul 27 15:58:35.927998 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.927898    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2" event={"ID":"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf","Type":"ContainerDied","Data":"75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7"}
Jul 27 15:58:35.927998 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.927918    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"
Jul 27 15:58:35.927998 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.927938    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2" event={"ID":"0cf996f5-8fff-4cd2-a175-ed8cbd05aecf","Type":"ContainerDied","Data":"d5f1e87131081ef363c1b1e850b30ecf1669519a506d342f19b4aeb26ca63409"}
Jul 27 15:58:35.939550 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.939537    2559 scope.go:117] "RemoveContainer" containerID="eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294"
Jul 27 15:58:35.939831 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:58:35.939812    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294\": container with ID starting with eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294 not found: ID does not exist" containerID="eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294"
Jul 27 15:58:35.939877 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.939839    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294"} err="failed to get container status \"eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294\": rpc error: code = NotFound desc = could not find container \"eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294\": container with ID starting with eb8b22f84ffe835444587579cf5c13ebd138cb493c741f8c9b79b2b47b150294 not found: ID does not exist"
Jul 27 15:58:35.939877 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.939856    2559 scope.go:117] "RemoveContainer" containerID="75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7"
Jul 27 15:58:35.947534 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.947518    2559 scope.go:117] "RemoveContainer" containerID="75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7"
Jul 27 15:58:35.947781 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:58:35.947761    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7\": container with ID starting with 75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7 not found: ID does not exist" containerID="75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7"
Jul 27 15:58:35.947841 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.947792    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7"} err="failed to get container status \"75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7\": rpc error: code = NotFound desc = could not find container \"75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7\": container with ID starting with 75cec5f7c85fdc61e519108abf746633dc6202b7e669fca8f1d09782495f51f7 not found: ID does not exist"
Jul 27 15:58:35.959080 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.959057    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"]
Jul 27 15:58:35.966620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.966601    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2"]
Jul 27 15:58:35.982184 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.982165    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"]
Jul 27 15:58:35.988706 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:35.988688    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2"]
Jul 27 15:58:36.712076 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:36.712049    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cf996f5-8fff-4cd2-a175-ed8cbd05aecf" path="/var/lib/kubelet/pods/0cf996f5-8fff-4cd2-a175-ed8cbd05aecf/volumes"
Jul 27 15:58:36.712395 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:58:36.712381    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4bf3057-df1a-4752-9cc8-6a3b4bed78c0" path="/var/lib/kubelet/pods/a4bf3057-df1a-4752-9cc8-6a3b4bed78c0/volumes"
Jul 27 15:59:14.761561 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:14.761528    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"]
Jul 27 15:59:29.780404 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:29.780372    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp" podUID="26c870a1-7d59-40b7-99f7-c7a9de79685f" containerName="main" containerID="cri-o://b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe" gracePeriod=45
Jul 27 15:59:30.023675 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.023653    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:59:30.131343 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.131240    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgf2w\" (UniqueName: \"kubernetes.io/projected/26c870a1-7d59-40b7-99f7-c7a9de79685f-kube-api-access-pgf2w\") pod \"26c870a1-7d59-40b7-99f7-c7a9de79685f\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") "
Jul 27 15:59:30.131343 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.131277    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-tmp-dir\") pod \"26c870a1-7d59-40b7-99f7-c7a9de79685f\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") "
Jul 27 15:59:30.131343 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.131303    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-model-cache\") pod \"26c870a1-7d59-40b7-99f7-c7a9de79685f\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") "
Jul 27 15:59:30.131620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.131366    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26c870a1-7d59-40b7-99f7-c7a9de79685f-tls-certs\") pod \"26c870a1-7d59-40b7-99f7-c7a9de79685f\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") "
Jul 27 15:59:30.131620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.131464    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-home\") pod \"26c870a1-7d59-40b7-99f7-c7a9de79685f\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") "
Jul 27 15:59:30.131620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.131535    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-dshm\") pod \"26c870a1-7d59-40b7-99f7-c7a9de79685f\" (UID: \"26c870a1-7d59-40b7-99f7-c7a9de79685f\") "
Jul 27 15:59:30.131620 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.131604    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26c870a1-7d59-40b7-99f7-c7a9de79685f" (UID: "26c870a1-7d59-40b7-99f7-c7a9de79685f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:59:30.131798 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.131623    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-model-cache" (OuterVolumeSpecName: "model-cache") pod "26c870a1-7d59-40b7-99f7-c7a9de79685f" (UID: "26c870a1-7d59-40b7-99f7-c7a9de79685f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:59:30.131798 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.131721    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-home" (OuterVolumeSpecName: "home") pod "26c870a1-7d59-40b7-99f7-c7a9de79685f" (UID: "26c870a1-7d59-40b7-99f7-c7a9de79685f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:59:30.131896 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.131871    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-tmp-dir\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:59:30.131896 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.131887    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-model-cache\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:59:30.131896 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.131895    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-home\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:59:30.133691 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.133666    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c870a1-7d59-40b7-99f7-c7a9de79685f-kube-api-access-pgf2w" (OuterVolumeSpecName: "kube-api-access-pgf2w") pod "26c870a1-7d59-40b7-99f7-c7a9de79685f" (UID: "26c870a1-7d59-40b7-99f7-c7a9de79685f"). InnerVolumeSpecName "kube-api-access-pgf2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:59:30.133789 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.133765    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c870a1-7d59-40b7-99f7-c7a9de79685f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26c870a1-7d59-40b7-99f7-c7a9de79685f" (UID: "26c870a1-7d59-40b7-99f7-c7a9de79685f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:59:30.133789 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.133770    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-dshm" (OuterVolumeSpecName: "dshm") pod "26c870a1-7d59-40b7-99f7-c7a9de79685f" (UID: "26c870a1-7d59-40b7-99f7-c7a9de79685f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:59:30.203938 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.203907    2559 generic.go:356] "Generic (PLEG): container finished" podID="26c870a1-7d59-40b7-99f7-c7a9de79685f" containerID="b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe" exitCode=0
Jul 27 15:59:30.204035 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.203959    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"
Jul 27 15:59:30.204035 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.203995    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp" event={"ID":"26c870a1-7d59-40b7-99f7-c7a9de79685f","Type":"ContainerDied","Data":"b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe"}
Jul 27 15:59:30.204105 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.204042    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp" event={"ID":"26c870a1-7d59-40b7-99f7-c7a9de79685f","Type":"ContainerDied","Data":"275190229c728cd02606b90793ca68d313fed36390722500930f2a5dc0004c13"}
Jul 27 15:59:30.204105 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.204062    2559 scope.go:117] "RemoveContainer" containerID="b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe"
Jul 27 15:59:30.214636 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.214614    2559 scope.go:117] "RemoveContainer" containerID="b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe"
Jul 27 15:59:30.215057 ip-10-0-143-164 kubenswrapper[2559]: E0727 15:59:30.215039    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe\": container with ID starting with b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe not found: ID does not exist" containerID="b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe"
Jul 27 15:59:30.215149 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.215063    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe"} err="failed to get container status \"b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe\": rpc error: code = NotFound desc = could not find container \"b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe\": container with ID starting with b03f65b1855e85b4eb397b7862ea69fa82e1ddbeeb228bb485630e9aedcdcefe not found: ID does not exist"
Jul 27 15:59:30.227663 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.227641    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"]
Jul 27 15:59:30.231360 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.231337    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-c4dbeb/ipp-route-c4dbeb-kserve-57f78999-bnqgp"]
Jul 27 15:59:30.232797 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.232782    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26c870a1-7d59-40b7-99f7-c7a9de79685f-tls-certs\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:59:30.232853 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.232801    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26c870a1-7d59-40b7-99f7-c7a9de79685f-dshm\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:59:30.232853 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.232810    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgf2w\" (UniqueName: \"kubernetes.io/projected/26c870a1-7d59-40b7-99f7-c7a9de79685f-kube-api-access-pgf2w\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 15:59:30.712237 ip-10-0-143-164 kubenswrapper[2559]: I0727 15:59:30.712210    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26c870a1-7d59-40b7-99f7-c7a9de79685f" path="/var/lib/kubelet/pods/26c870a1-7d59-40b7-99f7-c7a9de79685f/volumes"
Jul 27 16:00:10.606449 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:10.606411    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"]
Jul 27 16:00:10.606920 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:10.606682    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj" podUID="578aea5f-a838-4ee3-b235-2c7bcbd2dab7" containerName="payload-processing" containerID="cri-o://a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac" gracePeriod=30
Jul 27 16:00:10.615969 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:10.615947    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"]
Jul 27 16:00:10.616136 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:10.616116    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc" podUID="2bb879d5-e717-4099-8dcf-9f59cfabc1bf" containerName="payload-pre-processing" containerID="cri-o://08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd" gracePeriod=30
Jul 27 16:00:10.875423 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:10.875361    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"
Jul 27 16:00:10.893496 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:10.893468    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"
Jul 27 16:00:11.034859 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.034831    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9shg6\" (UniqueName: \"kubernetes.io/projected/2bb879d5-e717-4099-8dcf-9f59cfabc1bf-kube-api-access-9shg6\") pod \"2bb879d5-e717-4099-8dcf-9f59cfabc1bf\" (UID: \"2bb879d5-e717-4099-8dcf-9f59cfabc1bf\") "
Jul 27 16:00:11.035003 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.034870    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xknq\" (UniqueName: \"kubernetes.io/projected/578aea5f-a838-4ee3-b235-2c7bcbd2dab7-kube-api-access-8xknq\") pod \"578aea5f-a838-4ee3-b235-2c7bcbd2dab7\" (UID: \"578aea5f-a838-4ee3-b235-2c7bcbd2dab7\") "
Jul 27 16:00:11.035003 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.034960    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/578aea5f-a838-4ee3-b235-2c7bcbd2dab7-plugins-config-volume\") pod \"578aea5f-a838-4ee3-b235-2c7bcbd2dab7\" (UID: \"578aea5f-a838-4ee3-b235-2c7bcbd2dab7\") "
Jul 27 16:00:11.035124 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.035092    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb879d5-e717-4099-8dcf-9f59cfabc1bf-plugins-config-volume\") pod \"2bb879d5-e717-4099-8dcf-9f59cfabc1bf\" (UID: \"2bb879d5-e717-4099-8dcf-9f59cfabc1bf\") "
Jul 27 16:00:11.035483 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.035452    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/578aea5f-a838-4ee3-b235-2c7bcbd2dab7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "578aea5f-a838-4ee3-b235-2c7bcbd2dab7" (UID: "578aea5f-a838-4ee3-b235-2c7bcbd2dab7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:00:11.035748 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.035720    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bb879d5-e717-4099-8dcf-9f59cfabc1bf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2bb879d5-e717-4099-8dcf-9f59cfabc1bf" (UID: "2bb879d5-e717-4099-8dcf-9f59cfabc1bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:00:11.037173 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.037151    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/578aea5f-a838-4ee3-b235-2c7bcbd2dab7-kube-api-access-8xknq" (OuterVolumeSpecName: "kube-api-access-8xknq") pod "578aea5f-a838-4ee3-b235-2c7bcbd2dab7" (UID: "578aea5f-a838-4ee3-b235-2c7bcbd2dab7"). InnerVolumeSpecName "kube-api-access-8xknq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:00:11.037249 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.037187    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bb879d5-e717-4099-8dcf-9f59cfabc1bf-kube-api-access-9shg6" (OuterVolumeSpecName: "kube-api-access-9shg6") pod "2bb879d5-e717-4099-8dcf-9f59cfabc1bf" (UID: "2bb879d5-e717-4099-8dcf-9f59cfabc1bf"). InnerVolumeSpecName "kube-api-access-9shg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:00:11.136176 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.136127    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb879d5-e717-4099-8dcf-9f59cfabc1bf-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 16:00:11.136176 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.136149    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9shg6\" (UniqueName: \"kubernetes.io/projected/2bb879d5-e717-4099-8dcf-9f59cfabc1bf-kube-api-access-9shg6\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 16:00:11.136176 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.136159    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xknq\" (UniqueName: \"kubernetes.io/projected/578aea5f-a838-4ee3-b235-2c7bcbd2dab7-kube-api-access-8xknq\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 16:00:11.136176 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.136168    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/578aea5f-a838-4ee3-b235-2c7bcbd2dab7-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 16:00:11.413991 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.413967    2559 generic.go:356] "Generic (PLEG): container finished" podID="2bb879d5-e717-4099-8dcf-9f59cfabc1bf" containerID="08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd" exitCode=0
Jul 27 16:00:11.414093 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.414012    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"
Jul 27 16:00:11.414093 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.414052    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc" event={"ID":"2bb879d5-e717-4099-8dcf-9f59cfabc1bf","Type":"ContainerDied","Data":"08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd"}
Jul 27 16:00:11.414189 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.414105    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc" event={"ID":"2bb879d5-e717-4099-8dcf-9f59cfabc1bf","Type":"ContainerDied","Data":"f35597fdc04129f45655bcb5bddae9085ba4bf0fa6b3e7de831a49b31ee5fcb1"}
Jul 27 16:00:11.414189 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.414141    2559 scope.go:117] "RemoveContainer" containerID="08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd"
Jul 27 16:00:11.415339 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.415295    2559 generic.go:356] "Generic (PLEG): container finished" podID="578aea5f-a838-4ee3-b235-2c7bcbd2dab7" containerID="a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac" exitCode=0
Jul 27 16:00:11.415416 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.415382    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"
Jul 27 16:00:11.415514 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.415440    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj" event={"ID":"578aea5f-a838-4ee3-b235-2c7bcbd2dab7","Type":"ContainerDied","Data":"a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac"}
Jul 27 16:00:11.415696 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.415664    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj" event={"ID":"578aea5f-a838-4ee3-b235-2c7bcbd2dab7","Type":"ContainerDied","Data":"40cf0a8d21165f39ea433d39252933c80191e6257b50f50f24082f921ddf5154"}
Jul 27 16:00:11.423197 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.423180    2559 scope.go:117] "RemoveContainer" containerID="08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd"
Jul 27 16:00:11.423472 ip-10-0-143-164 kubenswrapper[2559]: E0727 16:00:11.423452    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd\": container with ID starting with 08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd not found: ID does not exist" containerID="08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd"
Jul 27 16:00:11.423570 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.423482    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd"} err="failed to get container status \"08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd\": rpc error: code = NotFound desc = could not find container \"08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd\": container with ID starting with 08d1e3918fc3a1daa6374120c636c110ad771e588a6ed50434afe1e0260d6dbd not found: ID does not exist"
Jul 27 16:00:11.423570 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.423515    2559 scope.go:117] "RemoveContainer" containerID="a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac"
Jul 27 16:00:11.431472 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.431452    2559 scope.go:117] "RemoveContainer" containerID="a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac"
Jul 27 16:00:11.431706 ip-10-0-143-164 kubenswrapper[2559]: E0727 16:00:11.431688    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac\": container with ID starting with a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac not found: ID does not exist" containerID="a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac"
Jul 27 16:00:11.431760 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.431712    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac"} err="failed to get container status \"a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac\": rpc error: code = NotFound desc = could not find container \"a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac\": container with ID starting with a66a35b7f86bd7063ca6668dacc45a42b4bdfa2a7e0b284d9b9c0f728760a4ac not found: ID does not exist"
Jul 27 16:00:11.439773 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.439754    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"]
Jul 27 16:00:11.443954 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.443936    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc"]
Jul 27 16:00:11.457436 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.457418    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"]
Jul 27 16:00:11.463874 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:11.463854    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj"]
Jul 27 16:00:12.712089 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:12.712053    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bb879d5-e717-4099-8dcf-9f59cfabc1bf" path="/var/lib/kubelet/pods/2bb879d5-e717-4099-8dcf-9f59cfabc1bf/volumes"
Jul 27 16:00:12.712589 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:12.712569    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="578aea5f-a838-4ee3-b235-2c7bcbd2dab7" path="/var/lib/kubelet/pods/578aea5f-a838-4ee3-b235-2c7bcbd2dab7/volumes"
Jul 27 16:00:31.916390 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:31.916355    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"]
Jul 27 16:00:31.916957 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:31.916892    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m" podUID="6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a" containerName="payload-processing" containerID="cri-o://8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13" gracePeriod=30
Jul 27 16:00:31.920842 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:31.920557    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"]
Jul 27 16:00:31.920842 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:31.920748    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8" podUID="71e702eb-ac04-41fb-920e-4540ae4f3c50" containerName="payload-pre-processing" containerID="cri-o://d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8" gracePeriod=30
Jul 27 16:00:32.168355 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.168270    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"
Jul 27 16:00:32.186546 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.186521    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"
Jul 27 16:00:32.288336 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.288225    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d8x8\" (UniqueName: \"kubernetes.io/projected/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a-kube-api-access-8d8x8\") pod \"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a\" (UID: \"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a\") "
Jul 27 16:00:32.288449 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.288400    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71e702eb-ac04-41fb-920e-4540ae4f3c50-plugins-config-volume\") pod \"71e702eb-ac04-41fb-920e-4540ae4f3c50\" (UID: \"71e702eb-ac04-41fb-920e-4540ae4f3c50\") "
Jul 27 16:00:32.288449 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.288427    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a-plugins-config-volume\") pod \"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a\" (UID: \"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a\") "
Jul 27 16:00:32.288528 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.288458    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zt5g\" (UniqueName: \"kubernetes.io/projected/71e702eb-ac04-41fb-920e-4540ae4f3c50-kube-api-access-8zt5g\") pod \"71e702eb-ac04-41fb-920e-4540ae4f3c50\" (UID: \"71e702eb-ac04-41fb-920e-4540ae4f3c50\") "
Jul 27 16:00:32.288859 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.288799    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e702eb-ac04-41fb-920e-4540ae4f3c50-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "71e702eb-ac04-41fb-920e-4540ae4f3c50" (UID: "71e702eb-ac04-41fb-920e-4540ae4f3c50"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:00:32.288859 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.288815    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a" (UID: "6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:00:32.290332 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.290297    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a-kube-api-access-8d8x8" (OuterVolumeSpecName: "kube-api-access-8d8x8") pod "6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a" (UID: "6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a"). InnerVolumeSpecName "kube-api-access-8d8x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:00:32.290572 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.290554    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71e702eb-ac04-41fb-920e-4540ae4f3c50-kube-api-access-8zt5g" (OuterVolumeSpecName: "kube-api-access-8zt5g") pod "71e702eb-ac04-41fb-920e-4540ae4f3c50" (UID: "71e702eb-ac04-41fb-920e-4540ae4f3c50"). InnerVolumeSpecName "kube-api-access-8zt5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:00:32.389979 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.389958    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d8x8\" (UniqueName: \"kubernetes.io/projected/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a-kube-api-access-8d8x8\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 16:00:32.389979 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.389977    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71e702eb-ac04-41fb-920e-4540ae4f3c50-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 16:00:32.390099 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.389986    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 16:00:32.390099 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.389995    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zt5g\" (UniqueName: \"kubernetes.io/projected/71e702eb-ac04-41fb-920e-4540ae4f3c50-kube-api-access-8zt5g\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 16:00:32.517109 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.517052    2559 generic.go:356] "Generic (PLEG): container finished" podID="71e702eb-ac04-41fb-920e-4540ae4f3c50" containerID="d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8" exitCode=0
Jul 27 16:00:32.517109 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.517090    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"
Jul 27 16:00:32.517223 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.517133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8" event={"ID":"71e702eb-ac04-41fb-920e-4540ae4f3c50","Type":"ContainerDied","Data":"d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8"}
Jul 27 16:00:32.517223 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.517185    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8" event={"ID":"71e702eb-ac04-41fb-920e-4540ae4f3c50","Type":"ContainerDied","Data":"97fc1bb0a6e409600c66ac19c7ee4317da2d9ca69ef934d4b674c4fae44dcde5"}
Jul 27 16:00:32.517223 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.517205    2559 scope.go:117] "RemoveContainer" containerID="d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8"
Jul 27 16:00:32.518535 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.518517    2559 generic.go:356] "Generic (PLEG): container finished" podID="6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a" containerID="8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13" exitCode=0
Jul 27 16:00:32.518635 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.518565    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"
Jul 27 16:00:32.518635 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.518576    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m" event={"ID":"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a","Type":"ContainerDied","Data":"8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13"}
Jul 27 16:00:32.518635 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.518612    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m" event={"ID":"6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a","Type":"ContainerDied","Data":"90801fbc135100c90f5681692b822d5bd13d79c598fbb9ebe6ff64329e0772df"}
Jul 27 16:00:32.527484 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.527470    2559 scope.go:117] "RemoveContainer" containerID="d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8"
Jul 27 16:00:32.527766 ip-10-0-143-164 kubenswrapper[2559]: E0727 16:00:32.527749    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8\": container with ID starting with d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8 not found: ID does not exist" containerID="d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8"
Jul 27 16:00:32.527832 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.527774    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8"} err="failed to get container status \"d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8\": rpc error: code = NotFound desc = could not find container \"d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8\": container with ID starting with d3542de5f8638aabb6dd373a07b86ee20bee2e76e9fdac6467aa089ceeb931f8 not found: ID does not exist"
Jul 27 16:00:32.527832 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.527789    2559 scope.go:117] "RemoveContainer" containerID="8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13"
Jul 27 16:00:32.536012 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.535993    2559 scope.go:117] "RemoveContainer" containerID="8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13"
Jul 27 16:00:32.536245 ip-10-0-143-164 kubenswrapper[2559]: E0727 16:00:32.536227    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13\": container with ID starting with 8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13 not found: ID does not exist" containerID="8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13"
Jul 27 16:00:32.536290 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.536253    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13"} err="failed to get container status \"8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13\": rpc error: code = NotFound desc = could not find container \"8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13\": container with ID starting with 8bbe97b4654a15ccf3511432efd9ee37872ceb3039f0ba296526d8ac5069fa13 not found: ID does not exist"
Jul 27 16:00:32.540567 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.540546    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"]
Jul 27 16:00:32.547459 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.547438    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8"]
Jul 27 16:00:32.559270 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.559250    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"]
Jul 27 16:00:32.563619 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.563602    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m"]
Jul 27 16:00:32.712116 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.712096    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a" path="/var/lib/kubelet/pods/6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a/volumes"
Jul 27 16:00:32.712430 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:32.712418    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71e702eb-ac04-41fb-920e-4540ae4f3c50" path="/var/lib/kubelet/pods/71e702eb-ac04-41fb-920e-4540ae4f3c50/volumes"
Jul 27 16:00:54.074860 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.074822    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"]
Jul 27 16:00:54.075806 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.075780    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7" podUID="7e862058-d32d-461a-af3d-b323aecba9db" containerName="payload-processing" containerID="cri-o://4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a" gracePeriod=30
Jul 27 16:00:54.079207 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.079185    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"]
Jul 27 16:00:54.079674 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.079645    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb" podUID="a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1" containerName="payload-pre-processing" containerID="cri-o://fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81" gracePeriod=30
Jul 27 16:00:54.336305 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.336283    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"
Jul 27 16:00:54.338750 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.338730    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"
Jul 27 16:00:54.343122 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.343101    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1-plugins-config-volume\") pod \"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1\" (UID: \"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1\") "
Jul 27 16:00:54.343206 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.343153    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e862058-d32d-461a-af3d-b323aecba9db-plugins-config-volume\") pod \"7e862058-d32d-461a-af3d-b323aecba9db\" (UID: \"7e862058-d32d-461a-af3d-b323aecba9db\") "
Jul 27 16:00:54.343367 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.343349    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pglnf\" (UniqueName: \"kubernetes.io/projected/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1-kube-api-access-pglnf\") pod \"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1\" (UID: \"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1\") "
Jul 27 16:00:54.343433 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.343411    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t27ng\" (UniqueName: \"kubernetes.io/projected/7e862058-d32d-461a-af3d-b323aecba9db-kube-api-access-t27ng\") pod \"7e862058-d32d-461a-af3d-b323aecba9db\" (UID: \"7e862058-d32d-461a-af3d-b323aecba9db\") "
Jul 27 16:00:54.343492 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.343442    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1" (UID: "a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:00:54.343554 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.343528    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e862058-d32d-461a-af3d-b323aecba9db-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7e862058-d32d-461a-af3d-b323aecba9db" (UID: "7e862058-d32d-461a-af3d-b323aecba9db"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:00:54.343687 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.343670    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 16:00:54.343736 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.343692    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e862058-d32d-461a-af3d-b323aecba9db-plugins-config-volume\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 16:00:54.345370 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.345349    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1-kube-api-access-pglnf" (OuterVolumeSpecName: "kube-api-access-pglnf") pod "a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1" (UID: "a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1"). InnerVolumeSpecName "kube-api-access-pglnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:00:54.345639 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.345617    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e862058-d32d-461a-af3d-b323aecba9db-kube-api-access-t27ng" (OuterVolumeSpecName: "kube-api-access-t27ng") pod "7e862058-d32d-461a-af3d-b323aecba9db" (UID: "7e862058-d32d-461a-af3d-b323aecba9db"). InnerVolumeSpecName "kube-api-access-t27ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:00:54.444026 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.443997    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pglnf\" (UniqueName: \"kubernetes.io/projected/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1-kube-api-access-pglnf\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 16:00:54.444026 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.444022    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t27ng\" (UniqueName: \"kubernetes.io/projected/7e862058-d32d-461a-af3d-b323aecba9db-kube-api-access-t27ng\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\""
Jul 27 16:00:54.620646 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.620585    2559 generic.go:356] "Generic (PLEG): container finished" podID="7e862058-d32d-461a-af3d-b323aecba9db" containerID="4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a" exitCode=0
Jul 27 16:00:54.620646 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.620629    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"
Jul 27 16:00:54.620799 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.620644    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7" event={"ID":"7e862058-d32d-461a-af3d-b323aecba9db","Type":"ContainerDied","Data":"4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a"}
Jul 27 16:00:54.620799 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.620714    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7" event={"ID":"7e862058-d32d-461a-af3d-b323aecba9db","Type":"ContainerDied","Data":"bf7ba3e24cfd6dad8e9b2d4d4314d7d77eec477e35a90429e849d8d34a1b6e2e"}
Jul 27 16:00:54.620799 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.620732    2559 scope.go:117] "RemoveContainer" containerID="4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a"
Jul 27 16:00:54.622053 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.622027    2559 generic.go:356] "Generic (PLEG): container finished" podID="a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1" containerID="fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81" exitCode=0
Jul 27 16:00:54.622146 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.622068    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"
Jul 27 16:00:54.622146 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.622121    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb" event={"ID":"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1","Type":"ContainerDied","Data":"fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81"}
Jul 27 16:00:54.622266 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.622176    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb" event={"ID":"a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1","Type":"ContainerDied","Data":"7b1ff0d3942099f79f0220a599f0f4b8e1e239a39fc7078970b259e6f085adec"}
Jul 27 16:00:54.630733 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.630718    2559 scope.go:117] "RemoveContainer" containerID="4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a"
Jul 27 16:00:54.631014 ip-10-0-143-164 kubenswrapper[2559]: E0727 16:00:54.630987    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a\": container with ID starting with 4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a not found: ID does not exist" containerID="4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a"
Jul 27 16:00:54.631106 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.631023    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a"} err="failed to get container status \"4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a\": rpc error: code = NotFound desc = could not find container \"4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a\": container with ID starting with 4e1fac4cf42f4b12906fb59624c7c5a0a19e734f459e07cd7b3c965035896e4a not found: ID does not exist"
Jul 27 16:00:54.631106 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.631044    2559 scope.go:117] "RemoveContainer" containerID="fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81"
Jul 27 16:00:54.640765 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.640742    2559 scope.go:117] "RemoveContainer" containerID="fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81"
Jul 27 16:00:54.641136 ip-10-0-143-164 kubenswrapper[2559]: E0727 16:00:54.641104    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81\": container with ID starting with fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81 not found: ID does not exist" containerID="fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81"
Jul 27 16:00:54.641270 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.641142    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81"} err="failed to get container status \"fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81\": rpc error: code = NotFound desc = could not find container \"fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81\": container with ID starting with fd6ea6c2bcd2b66ccd092fe78750cad22542dd2d098a50fdb1e1f8285056bc81 not found: ID does not exist"
Jul 27 16:00:54.644162 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.644141    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"]
Jul 27 16:00:54.648599 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.648578    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7"]
Jul 27 16:00:54.659907 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.659887    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"]
Jul 27 16:00:54.663790 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.663769    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb"]
Jul 27 16:00:54.712106 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.712086    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e862058-d32d-461a-af3d-b323aecba9db" path="/var/lib/kubelet/pods/7e862058-d32d-461a-af3d-b323aecba9db/volumes"
Jul 27 16:00:54.712421 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:00:54.712408    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1" path="/var/lib/kubelet/pods/a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1/volumes"
Jul 27 16:01:06.293547 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:06.293473    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66ccb7479f-jsclr_614d7994-6f5b-4a1d-a923-ac54fd357b86/authorino/0.log"
Jul 27 16:01:12.293943 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:12.293911    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nfljj_90530c29-62ea-4188-914d-460ee03ec048/manager/0.log"
Jul 27 16:01:12.553988 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:12.553930    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78959f89bb-n8pwg_2e6d87b4-3c2a-4af6-a2b7-27791fe55dad/copy-manifests/0.log"
Jul 27 16:01:12.561691 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:12.561668    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78959f89bb-n8pwg_2e6d87b4-3c2a-4af6-a2b7-27791fe55dad/manager/0.log"
Jul 27 16:01:14.272686 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.272658    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm_05704ac7-28bd-4315-9984-6d165c1c67cd/util/0.log"
Jul 27 16:01:14.280530 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.280507    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm_05704ac7-28bd-4315-9984-6d165c1c67cd/pull/0.log"
Jul 27 16:01:14.287694 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.287666    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm_05704ac7-28bd-4315-9984-6d165c1c67cd/extract/0.log"
Jul 27 16:01:14.396937 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.396910    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n_eb9f4643-8b2e-41ee-b324-662c4d868fd1/util/0.log"
Jul 27 16:01:14.403563 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.403540    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n_eb9f4643-8b2e-41ee-b324-662c4d868fd1/pull/0.log"
Jul 27 16:01:14.410608 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.410593    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n_eb9f4643-8b2e-41ee-b324-662c4d868fd1/extract/0.log"
Jul 27 16:01:14.523780 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.523722    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn_4a328329-e154-45e7-aef2-662926164df3/util/0.log"
Jul 27 16:01:14.537908 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.537893    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn_4a328329-e154-45e7-aef2-662926164df3/pull/0.log"
Jul 27 16:01:14.545631 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.545612    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn_4a328329-e154-45e7-aef2-662926164df3/extract/0.log"
Jul 27 16:01:14.656892 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.656872    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m_8876577d-480b-4999-bbfa-1f7bddc7baff/util/0.log"
Jul 27 16:01:14.664395 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.664379    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m_8876577d-480b-4999-bbfa-1f7bddc7baff/pull/0.log"
Jul 27 16:01:14.671569 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.671526    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m_8876577d-480b-4999-bbfa-1f7bddc7baff/extract/0.log"
Jul 27 16:01:14.791879 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:14.791826    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66ccb7479f-jsclr_614d7994-6f5b-4a1d-a923-ac54fd357b86/authorino/0.log"
Jul 27 16:01:15.149766 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:15.149718    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zkntj_7c41abb8-f4b7-42e9-a58c-5edf6e41199c/kuadrant-console-plugin/0.log"
Jul 27 16:01:16.265543 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:16.265521    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd65dd67b-vrwf2_6953c343-722a-4992-af21-708553023e89/kube-auth-proxy/0.log"
Jul 27 16:01:16.777730 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:16.777708    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-j5jfp_c8a5c866-9604-4af5-b222-ac22c28b73d7/payload-processing/0.log"
Jul 27 16:01:17.372383 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:17.372366    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-4q799_23a8d5c4-8669-40f5-ba64-b9325358f6c0/main/0.log"
Jul 27 16:01:17.603164 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:17.603145    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzl6cv_7ef741f5-47bc-4c07-a7f3-f5a507c006f2/main/0.log"
Jul 27 16:01:17.835126 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:17.835106    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-dhb7h_98af6b35-0888-4ee9-bbfb-2dd54cf50360/main/0.log"
Jul 27 16:01:29.568906 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:29.568875    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5rjcj_2f15adc1-27eb-40d4-98d0-ea2f32614a58/global-pull-secret-syncer/0.log"
Jul 27 16:01:29.743102 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:29.743068    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b8dzk_bedd3dda-9383-4cb1-86b5-56cb2089bc64/konnectivity-agent/0.log"
Jul 27 16:01:29.855711 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:29.855649    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-164.ec2.internal_9b8a60cdf8b1d315ea61b277dedead6a/haproxy/0.log"
Jul 27 16:01:34.685536 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:34.685506    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm_05704ac7-28bd-4315-9984-6d165c1c67cd/extract/0.log"
Jul 27 16:01:34.718122 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:34.718097    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm_05704ac7-28bd-4315-9984-6d165c1c67cd/util/0.log"
Jul 27 16:01:34.747802 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:34.747777    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592r5dm_05704ac7-28bd-4315-9984-6d165c1c67cd/pull/0.log"
Jul 27 16:01:34.782986 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:34.782961    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n_eb9f4643-8b2e-41ee-b324-662c4d868fd1/extract/0.log"
Jul 27 16:01:34.807534 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:34.807512    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n_eb9f4643-8b2e-41ee-b324-662c4d868fd1/util/0.log"
Jul 27 16:01:34.830520 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:34.830499    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2s2n_eb9f4643-8b2e-41ee-b324-662c4d868fd1/pull/0.log"
Jul 27 16:01:34.869976 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:34.869958    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn_4a328329-e154-45e7-aef2-662926164df3/extract/0.log"
Jul 27 16:01:34.894662 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:34.894636    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn_4a328329-e154-45e7-aef2-662926164df3/util/0.log"
Jul 27 16:01:34.924362 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:34.924344    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v4cvn_4a328329-e154-45e7-aef2-662926164df3/pull/0.log"
Jul 27 16:01:34.952739 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:34.952687    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m_8876577d-480b-4999-bbfa-1f7bddc7baff/extract/0.log"
Jul 27 16:01:34.978642 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:34.978626    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m_8876577d-480b-4999-bbfa-1f7bddc7baff/util/0.log"
Jul 27 16:01:35.003654 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:35.003637    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jjz9m_8876577d-480b-4999-bbfa-1f7bddc7baff/pull/0.log"
Jul 27 16:01:35.333667 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:35.333597    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66ccb7479f-jsclr_614d7994-6f5b-4a1d-a923-ac54fd357b86/authorino/0.log"
Jul 27 16:01:35.415090 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:35.415066    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zkntj_7c41abb8-f4b7-42e9-a58c-5edf6e41199c/kuadrant-console-plugin/0.log"
Jul 27 16:01:37.578678 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:37.578652    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c48aa6-ef4d-40eb-9e5b-930d45d81b58/alertmanager/0.log"
Jul 27 16:01:37.632555 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:37.632534    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c48aa6-ef4d-40eb-9e5b-930d45d81b58/config-reloader/0.log"
Jul 27 16:01:37.670824 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:37.670810    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c48aa6-ef4d-40eb-9e5b-930d45d81b58/kube-rbac-proxy-web/0.log"
Jul 27 16:01:37.725518 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:37.725498    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c48aa6-ef4d-40eb-9e5b-930d45d81b58/kube-rbac-proxy/0.log"
Jul 27 16:01:37.763428 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:37.763408    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c48aa6-ef4d-40eb-9e5b-930d45d81b58/kube-rbac-proxy-metric/0.log"
Jul 27 16:01:37.811460 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:37.811444    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c48aa6-ef4d-40eb-9e5b-930d45d81b58/prom-label-proxy/0.log"
Jul 27 16:01:37.854624 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:37.854576    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c48aa6-ef4d-40eb-9e5b-930d45d81b58/init-config-reloader/0.log"
Jul 27 16:01:37.944269 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:37.944248    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-ss4lr_01a105ac-7909-496d-9f6c-ff1e034017e9/kube-state-metrics/0.log"
Jul 27 16:01:37.979547 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:37.979523    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-ss4lr_01a105ac-7909-496d-9f6c-ff1e034017e9/kube-rbac-proxy-main/0.log"
Jul 27 16:01:38.035574 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:38.035557    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-ss4lr_01a105ac-7909-496d-9f6c-ff1e034017e9/kube-rbac-proxy-self/0.log"
Jul 27 16:01:38.348177 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:38.348160    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-txtcn_8f3174ad-4bca-4de7-bd65-43645ba80120/node-exporter/0.log"
Jul 27 16:01:38.381643 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:38.381628    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-txtcn_8f3174ad-4bca-4de7-bd65-43645ba80120/kube-rbac-proxy/0.log"
Jul 27 16:01:38.412552 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:38.412535    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-txtcn_8f3174ad-4bca-4de7-bd65-43645ba80120/init-textfile/0.log"
Jul 27 16:01:38.959675 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:38.959658    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845f496fc-6cflc_1cf29fde-926b-486b-89f1-8d968b8e351d/thanos-query/0.log"
Jul 27 16:01:38.998656 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:38.998633    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845f496fc-6cflc_1cf29fde-926b-486b-89f1-8d968b8e351d/kube-rbac-proxy-web/0.log"
Jul 27 16:01:39.042069 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:39.042047    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845f496fc-6cflc_1cf29fde-926b-486b-89f1-8d968b8e351d/kube-rbac-proxy/0.log"
Jul 27 16:01:39.096685 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:39.096658    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845f496fc-6cflc_1cf29fde-926b-486b-89f1-8d968b8e351d/prom-label-proxy/0.log"
Jul 27 16:01:39.146460 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:39.146444    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845f496fc-6cflc_1cf29fde-926b-486b-89f1-8d968b8e351d/kube-rbac-proxy-rules/0.log"
Jul 27 16:01:39.191984 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:39.191965    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845f496fc-6cflc_1cf29fde-926b-486b-89f1-8d968b8e351d/kube-rbac-proxy-metrics/0.log"
Jul 27 16:01:41.510465 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.510429    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"]
Jul 27 16:01:41.510907 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.510885    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c870a1-7d59-40b7-99f7-c7a9de79685f" containerName="main"
Jul 27 16:01:41.510984 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.510911    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c870a1-7d59-40b7-99f7-c7a9de79685f" containerName="main"
Jul 27 16:01:41.510984 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.510928    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1" containerName="payload-pre-processing"
Jul 27 16:01:41.510984 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.510936    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1" containerName="payload-pre-processing"
Jul 27 16:01:41.510984 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.510948    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a" containerName="payload-processing"
Jul 27 16:01:41.510984 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.510958    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a" containerName="payload-processing"
Jul 27 16:01:41.510984 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.510971    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e862058-d32d-461a-af3d-b323aecba9db" containerName="payload-processing"
Jul 27 16:01:41.510984 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.510979    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e862058-d32d-461a-af3d-b323aecba9db" containerName="payload-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.510989    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4bf3057-df1a-4752-9cc8-6a3b4bed78c0" containerName="payload-pre-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.510997    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4bf3057-df1a-4752-9cc8-6a3b4bed78c0" containerName="payload-pre-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511013    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb879d5-e717-4099-8dcf-9f59cfabc1bf" containerName="payload-pre-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511021    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb879d5-e717-4099-8dcf-9f59cfabc1bf" containerName="payload-pre-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511035    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e702eb-ac04-41fb-920e-4540ae4f3c50" containerName="payload-pre-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511043    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e702eb-ac04-41fb-920e-4540ae4f3c50" containerName="payload-pre-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511051    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cf996f5-8fff-4cd2-a175-ed8cbd05aecf" containerName="payload-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511058    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cf996f5-8fff-4cd2-a175-ed8cbd05aecf" containerName="payload-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511075    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="578aea5f-a838-4ee3-b235-2c7bcbd2dab7" containerName="payload-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511083    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="578aea5f-a838-4ee3-b235-2c7bcbd2dab7" containerName="payload-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511172    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="26c870a1-7d59-40b7-99f7-c7a9de79685f" containerName="main"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511183    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eeefd2e-f5c8-4fcb-9d1f-07eaaf06be0a" containerName="payload-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511194    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e862058-d32d-461a-af3d-b323aecba9db" containerName="payload-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511203    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4bf3057-df1a-4752-9cc8-6a3b4bed78c0" containerName="payload-pre-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511215    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bb879d5-e717-4099-8dcf-9f59cfabc1bf" containerName="payload-pre-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511224    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e702eb-ac04-41fb-920e-4540ae4f3c50" containerName="payload-pre-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511231    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cf996f5-8fff-4cd2-a175-ed8cbd05aecf" containerName="payload-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511240    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a38bfb2d-4ba3-4e71-a76b-81d9ce6a53d1" containerName="payload-pre-processing"
Jul 27 16:01:41.511369 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.511248    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="578aea5f-a838-4ee3-b235-2c7bcbd2dab7" containerName="payload-processing"
Jul 27 16:01:41.514587 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.514568    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.517537 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.517517    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6fjkv\"/\"openshift-service-ca.crt\""
Jul 27 16:01:41.517660 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.517644    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6fjkv\"/\"kube-root-ca.crt\""
Jul 27 16:01:41.519235 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.518980    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6fjkv\"/\"default-dockercfg-65s6n\""
Jul 27 16:01:41.522593 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.522574    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"]
Jul 27 16:01:41.577565 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.577540    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-265jf\" (UniqueName: \"kubernetes.io/projected/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-kube-api-access-265jf\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.577664 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.577569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-lib-modules\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.577664 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.577588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-sys\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.577664 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.577611    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-proc\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.577765 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.577729    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-podres\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.678379 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.678354    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-265jf\" (UniqueName: \"kubernetes.io/projected/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-kube-api-access-265jf\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.678459 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.678388    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-lib-modules\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.678459 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.678409    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-sys\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.678459 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.678447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-proc\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.678596 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.678508    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-podres\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.678596 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.678538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-lib-modules\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.678596 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.678542    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-sys\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.678596 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.678569    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-proc\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.678596 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.678593    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-podres\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.688578 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.688562    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-265jf\" (UniqueName: \"kubernetes.io/projected/dbd08223-3fb7-4c8a-b2a8-af01e205f8fd-kube-api-access-265jf\") pod \"perf-node-gather-daemonset-pfp4n\" (UID: \"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd\") " pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.825554 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.825505    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:41.953124 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:41.953096    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"]
Jul 27 16:01:41.954096 ip-10-0-143-164 kubenswrapper[2559]: W0727 16:01:41.954072    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddbd08223_3fb7_4c8a_b2a8_af01e205f8fd.slice/crio-9f91cfa9d4e49408c1aa6e134d5c85caebb1b05e160e0968556950e1c43ffbc1 WatchSource:0}: Error finding container 9f91cfa9d4e49408c1aa6e134d5c85caebb1b05e160e0968556950e1c43ffbc1: Status 404 returned error can't find the container with id 9f91cfa9d4e49408c1aa6e134d5c85caebb1b05e160e0968556950e1c43ffbc1
Jul 27 16:01:42.848275 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:42.848241    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n" event={"ID":"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd","Type":"ContainerStarted","Data":"21a439e42bc9197c1778068c916083e69d4a6b18378ffdd2b3386291826bafde"}
Jul 27 16:01:42.848688 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:42.848295    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n" event={"ID":"dbd08223-3fb7-4c8a-b2a8-af01e205f8fd","Type":"ContainerStarted","Data":"9f91cfa9d4e49408c1aa6e134d5c85caebb1b05e160e0968556950e1c43ffbc1"}
Jul 27 16:01:42.848688 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:42.848362    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:42.865613 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:42.865573    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n" podStartSLOduration=1.865562701 podStartE2EDuration="1.865562701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:01:42.863900256 +0000 UTC m=+3358.728478122" watchObservedRunningTime="2026-07-27 16:01:42.865562701 +0000 UTC m=+3358.730140566"
Jul 27 16:01:43.168632 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:43.168610    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fsnvq_c23491c4-1cba-4e6d-8c33-68a952e9c9f6/dns/0.log"
Jul 27 16:01:43.194014 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:43.193993    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fsnvq_c23491c4-1cba-4e6d-8c33-68a952e9c9f6/kube-rbac-proxy/0.log"
Jul 27 16:01:43.315696 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:43.315679    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z7jm2_3c38f52d-338f-4a06-a385-3276421472ce/dns-node-resolver/0.log"
Jul 27 16:01:43.854703 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:43.854679    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69749f9fc8-zvp5v_1bddbbe6-38b7-43d0-86c7-5325c3bddc50/registry/0.log"
Jul 27 16:01:43.877722 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:43.877697    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9w9v7_5d3d8faf-d3dc-4f04-b9e4-6e8bd98a5a57/node-ca/0.log"
Jul 27 16:01:45.092545 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:45.092525    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd65dd67b-vrwf2_6953c343-722a-4992-af21-708553023e89/kube-auth-proxy/0.log"
Jul 27 16:01:45.247202 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:45.247178    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-j5jfp_c8a5c866-9604-4af5-b222-ac22c28b73d7/payload-processing/0.log"
Jul 27 16:01:46.117476 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:46.117456    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pdfx8_763a6fcc-a76b-48b2-94fd-e941083b9ec5/serve-healthcheck-canary/0.log"
Jul 27 16:01:46.794495 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:46.794443    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hknd7_886d40c5-29b2-4b59-934c-7f65021ca978/kube-rbac-proxy/0.log"
Jul 27 16:01:46.817399 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:46.817381    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hknd7_886d40c5-29b2-4b59-934c-7f65021ca978/exporter/0.log"
Jul 27 16:01:46.840293 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:46.840273    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hknd7_886d40c5-29b2-4b59-934c-7f65021ca978/extractor/0.log"
Jul 27 16:01:48.862990 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:48.862966    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6fjkv/perf-node-gather-daemonset-pfp4n"
Jul 27 16:01:49.510272 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:49.510240    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nfljj_90530c29-62ea-4188-914d-460ee03ec048/manager/0.log"
Jul 27 16:01:49.681827 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:49.681806    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78959f89bb-n8pwg_2e6d87b4-3c2a-4af6-a2b7-27791fe55dad/manager/0.log"
Jul 27 16:01:49.706672 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:49.706646    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78959f89bb-n8pwg_2e6d87b4-3c2a-4af6-a2b7-27791fe55dad/copy-manifests/0.log"
Jul 27 16:01:50.223717 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:50.223698    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd65dd67b-vrwf2_6953c343-722a-4992-af21-708553023e89/kube-auth-proxy/0.log"
Jul 27 16:01:50.359024 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:50.359000    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-j5jfp_c8a5c866-9604-4af5-b222-ac22c28b73d7/payload-processing/0.log"
Jul 27 16:01:51.162870 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:51.162845    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-964ddd7d8-zvhlt_b396b6ba-1d71-42a8-a974-fb1abcc7a571/manager/0.log"
Jul 27 16:01:51.195239 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:51.195219    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-m4fs5_d84cfc40-e0c6-4f77-b43a-6050cc277592/openshift-lws-operator/0.log"
Jul 27 16:01:52.205514 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:52.205484    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd65dd67b-vrwf2_6953c343-722a-4992-af21-708553023e89/kube-auth-proxy/0.log"
Jul 27 16:01:52.333750 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:52.333724    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-j5jfp_c8a5c866-9604-4af5-b222-ac22c28b73d7/payload-processing/0.log"
Jul 27 16:01:57.975046 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:57.975012    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9fhlm_509524ea-252e-4068-9426-33f81a298f39/kube-multus/0.log"
Jul 27 16:01:58.495585 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:58.495562    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp4j8_ba429ab7-bc35-4e30-9dcf-cf87fe20e90b/kube-multus-additional-cni-plugins/0.log"
Jul 27 16:01:58.537062 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:58.537041    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp4j8_ba429ab7-bc35-4e30-9dcf-cf87fe20e90b/egress-router-binary-copy/0.log"
Jul 27 16:01:58.568358 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:58.568337    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp4j8_ba429ab7-bc35-4e30-9dcf-cf87fe20e90b/cni-plugins/0.log"
Jul 27 16:01:58.601361 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:58.601342    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp4j8_ba429ab7-bc35-4e30-9dcf-cf87fe20e90b/bond-cni-plugin/0.log"
Jul 27 16:01:58.632800 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:58.632782    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp4j8_ba429ab7-bc35-4e30-9dcf-cf87fe20e90b/routeoverride-cni/0.log"
Jul 27 16:01:58.658204 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:58.658190    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp4j8_ba429ab7-bc35-4e30-9dcf-cf87fe20e90b/whereabouts-cni-bincopy/0.log"
Jul 27 16:01:58.683671 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:58.683649    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp4j8_ba429ab7-bc35-4e30-9dcf-cf87fe20e90b/whereabouts-cni/0.log"
Jul 27 16:01:58.797264 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:58.797214    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5vv4s_0ec80f44-9dda-4e50-ab28-bf61b499eb0b/network-metrics-daemon/0.log"
Jul 27 16:01:58.818936 ip-10-0-143-164 kubenswrapper[2559]: I0727 16:01:58.818912    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5vv4s_0ec80f44-9dda-4e50-ab28-bf61b499eb0b/kube-rbac-proxy/0.log"