Jul 27 20:15:36.409077 ip-10-0-139-20 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 27 20:15:36.409086 ip-10-0-139-20 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 27 20:15:36.409093 ip-10-0-139-20 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 27 20:15:36.409345 ip-10-0-139-20 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 27 20:15:46.530680 ip-10-0-139-20 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 27 20:15:46.530696 ip-10-0-139-20 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 214b07284e8d468ca36a2ba98418da89 --
Jul 27 20:17:24.222082 ip-10-0-139-20 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 20:17:24.650896 ip-10-0-139-20 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:17:24.651964 ip-10-0-139-20 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 20:17:24.651964 ip-10-0-139-20 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:17:24.652136 ip-10-0-139-20 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 20:17:24.652136 ip-10-0-139-20 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:17:24.652222 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.652056    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 20:17:24.656839 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656818    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:17:24.656839 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656835    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:17:24.656839 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656840    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:17:24.656839 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656845    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656850    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656854    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656858    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656862    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656865    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656869    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656873    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656876    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656882    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656886    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656890    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656894    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656900    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656904    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656907    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656911    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656915    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656920    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656924    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:17:24.657086 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656929    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656933    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656937    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656941    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656945    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656949    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656953    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656957    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656961    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656966    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656970    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656974    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656978    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656983    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656989    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656994    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.656998    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657003    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657007    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657013    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:17:24.657954 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657018    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657027    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657033    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657038    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657042    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657047    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657052    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657059    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657066    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657075    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657079    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657084    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657089    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657093    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657097    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657101    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657106    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657111    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657115    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:17:24.658880 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657120    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657124    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657128    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657132    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657136    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657141    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657148    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657153    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657157    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657162    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657166    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657170    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657175    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657180    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657184    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657188    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657192    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657196    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657201    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657205    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:17:24.659662 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657209    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657213    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657218    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657222    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657226    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657230    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657234    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657239    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657243    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657247    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657251    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657256    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657260    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657264    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657268    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657272    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.657276    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658481    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658491    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658495    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:17:24.660526 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658501    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658506    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658511    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658517    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658522    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658526    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658531    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658536    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658540    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658544    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658549    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658553    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658557    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658562    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658566    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658572    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658578    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658583    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658588    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658592    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:17:24.661318 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658596    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658601    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658605    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658609    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658614    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658618    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658622    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658626    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658630    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658637    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658644    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658651    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658657    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658661    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658666    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658671    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658676    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658680    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:17:24.661844 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658685    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658690    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658695    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658700    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658704    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658709    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658713    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658717    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658721    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658725    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658729    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658733    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658737    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658759    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658764    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658768    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658772    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658776    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658781    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658785    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:17:24.662460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658789    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658793    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658799    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658803    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658808    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658813    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658818    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658822    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658826    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658830    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658835    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658839    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658843    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658847    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658853    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658858    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658862    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658867    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658871    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658875    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:17:24.663118 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658879    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658883    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658888    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658892    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658896    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658900    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658904    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658908    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658912    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658917    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658924    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658929    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658933    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658938    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658942    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658946    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658951    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.658956    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659646    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659657    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:17:24.663709 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659662    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659667    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659671    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659675    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659680    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659684    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659689    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659696    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659702    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659707    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659712    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659716    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659720    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659725    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659729    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659733    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659738    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659757    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659763    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659767    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:17:24.664353 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659772    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659776    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659781    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659786    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659790    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659794    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659799    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659803    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659807    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659811    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659816    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659820    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659826    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659832    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659840    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659845    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659851    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659855    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659859    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659864    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:17:24.665000 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659869    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659873    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659877    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659882    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659886    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659890    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659894    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659898    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659902    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659907    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659911    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659915    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659920    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659924    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659929    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659935    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659940    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659944    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659948    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659955    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:17:24.665487 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659960    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659965    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659970    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659974    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659981    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659985    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659989    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659993    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.659998    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660002    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660006    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660010    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660016    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660021    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660025    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660029    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660033    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660038    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660043    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660048    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:17:24.666106 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660052    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660056    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660060    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660065    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660069    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660073    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660077    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660083    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660088    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660092    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660096    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660101    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660105    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660109    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660113    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660118    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.660122    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660224    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660237    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660254    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 20:17:24.666618 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660261    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660268    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660274    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660281    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660289    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660295    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660301    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660306    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660312    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660317    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660322    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660326    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660332    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660336    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660341    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660349    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660354    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660359    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660364    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660372    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660379    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660384    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660389    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 20:17:24.667149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660395    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660399    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660404    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660409    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660414    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660419    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660426    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660431    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660436    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660441    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660446    2580 flags.go:64] FLAG: --enable-server="true"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660451    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660458    2580 flags.go:64] FLAG: --event-burst="100"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660463    2580 flags.go:64] FLAG: --event-qps="50"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660468    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660474    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660480    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660486    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660491    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660496    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660501    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660506    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660511    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660516    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660521    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 20:17:24.667712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660526    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660530    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660535    2580 flags.go:64] FLAG: --feature-gates=""
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660543    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660548    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660553    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660559    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660564    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660569    2580 flags.go:64] FLAG: --help="false"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660574    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-139-20.ec2.internal"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660579    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660584    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660589    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660594    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660600    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660605    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660610    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660615    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660619    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660625    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660630    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660635    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660640    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660647    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 20:17:24.668342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660653    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660658    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660663    2580 flags.go:64] FLAG: --lock-file=""
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660668    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660672    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660677    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660687    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660692    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660697    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660702    2580 flags.go:64] FLAG: --logging-format="text"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660706    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660714    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660718    2580 flags.go:64] FLAG: --manifest-url=""
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660723    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660730    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660735    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660761    2580 flags.go:64] FLAG: --max-pods="110"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660767    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660772    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660776    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660781    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660785    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660790    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660795    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660807    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 20:17:24.668959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660812    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660817    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660823    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660827    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660837    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660842    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660849    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660856    2580 flags.go:64] FLAG: --port="10250"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660861    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660866    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a1dc1b1637d8110d"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660871    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660876    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660881    2580 flags.go:64] FLAG: --register-node="true"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660886    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660892    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660896    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660901    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660906    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660911    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660920    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660926    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660931    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660935    2580 flags.go:64] FLAG: --runonce="false"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660941    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660946    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 20:17:24.670039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660951    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660956    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660960    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660965    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660970    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660975    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660980    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660985    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660990    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.660995    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661000    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661005    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661010    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661021    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661025    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661030    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661044    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661049    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661053    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661058    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661063    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661067    2580 flags.go:64] FLAG: --v="2"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661074    2580 flags.go:64] FLAG: --version="false"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661081    2580 flags.go:64] FLAG: --vmodule=""
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661087    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 20:17:24.671191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.661093    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662242    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662251    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662256    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662262    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662266    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662271    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662275    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662280    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662287    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662292    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662298    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662303    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662308    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662312    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662317    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662322    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662326    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662330    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662335    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:17:24.672280 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662342    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662346    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662350    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662356    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662360    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662364    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662368    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662373    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662377    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662381    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662386    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662390    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662395    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662401    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662405    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662410    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662414    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662418    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662422    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:17:24.673196 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662426    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662433    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662439    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662443    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662448    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662452    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662456    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662460    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662465    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662468    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662473    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662477    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662481    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662489    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662495    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662500    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662505    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662511    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662515    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:17:24.673723 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662519    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662524    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662528    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662532    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662537    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662541    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662545    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662551    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662555    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662559    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662564    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662568    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662573    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662577    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662581    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662585    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662589    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662594    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662598    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662604    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:17:24.674576 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662609    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662614    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662618    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662622    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662627    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662633    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662638    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662643    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662647    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662651    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662655    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662660    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662665    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662669    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662674    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662678    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662682    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662686    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662690    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662696    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:17:24.675389 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662701    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.662706    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.663430    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.671592    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.671612    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.671639    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.671647    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671764    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671772    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671777    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671782    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671786    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671790    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671795    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:17:24.676002 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671799    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671806    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671812    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671817    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671822    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671827    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671832    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671837    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671841    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671847    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671851    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671855    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671859    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671864    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671868    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671873    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671877    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671881    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671886    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:17:24.676423 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671891    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671895    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671900    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671904    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671908    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671912    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671917    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671921    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671925    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671929    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671934    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671938    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671942    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671947    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671951    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671955    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671959    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671964    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671968    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671972    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:17:24.676948 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671976    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671981    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671987    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671994    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.671999    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672004    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672010    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672014    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672018    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672023    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672026    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672031    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672035    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672039    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672044    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672048    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672053    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672057    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672061    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:17:24.677465 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672066    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672070    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672075    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672079    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672083    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672087    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672092    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672096    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672102    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672108    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672112    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672117    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672122    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672127    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672132    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672136    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672141    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672146    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672152    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:17:24.678112 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672156    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672161    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672165    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672170    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672175    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672179    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672183    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672188    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672192    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672197    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672201    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672205    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672209    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672214    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672218    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:17:24.678654 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.672226    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672412    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672420    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672425    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672429    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672433    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672437    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672441    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672446    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672450    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672455    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672459    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672463    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672468    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672472    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672476    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672481    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672485    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672490    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672494    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:17:24.679087 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672498    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672502    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672507    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672513    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672516    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672520    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672524    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672529    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672534    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672538    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672542    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672546    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672550    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672554    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672558    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672562    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672566    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672570    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672575    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672580    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:17:24.679640 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672584    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672589    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672593    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672597    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672602    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672606    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672610    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672614    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672619    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672624    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672628    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672632    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672637    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672641    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672645    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672650    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672654    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672658    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672662    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:17:24.680384 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672666    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672671    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672675    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672680    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672684    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672688    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672693    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672697    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672701    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672705    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672712    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672718    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672722    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672728    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672733    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672738    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672758    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672763    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672766    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672770    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:17:24.681066 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672774    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672777    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672781    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672785    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672789    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672793    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672796    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672801    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672804    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672808    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672812    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672818    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672822    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672827    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672832    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672837    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672842    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672847    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672852    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:17:24.681863 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672856    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:17:24.682590 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:24.672861    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:17:24.682590 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.672869    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:17:24.682590 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.673058    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 20:17:24.682590 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.675921    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 20:17:24.682590 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.677417    2580 server.go:1019] "Starting client certificate rotation"
Jul 27 20:17:24.682590 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.677528    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:17:24.682590 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.677570    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:17:24.682590 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.680505    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:17:24.684478 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.684455    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:17:24.697217 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.697195    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 27 20:17:24.699597 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.699580    2580 log.go:25] "Validated CRI v1 image API"
Jul 27 20:17:24.701108 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.701089    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 20:17:24.705500 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.705469    2580 fs.go:135] Filesystem UUIDs: map[19577d40-a3f6-4787-b4b9-509a9c32d1d0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8f48c651-5a6b-4afb-8e1b-155a0e9190f1:/dev/nvme0n1p4]
Jul 27 20:17:24.705601 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.705498    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 20:17:24.708226 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.708207    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:17:24.710879 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.710759    2580 manager.go:216] Machine: {Timestamp:2026-07-27 20:17:24.709356173 +0000 UTC m=+0.365511506 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100305 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25fee5fe849b686343aa832fac929e SystemUUID:ec25fee5-fe84-9b68-6343-aa832fac929e BootID:214b0728-4e8d-468c-a36a-2ba98418da89 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:45:a3:0a:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:45:a3:0a:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:b8:42:ed:4c:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 20:17:24.710879 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.710875    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 20:17:24.711016 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.710964    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 20:17:24.713757 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.713717    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 20:17:24.713906 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.713761    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-20.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 20:17:24.714583 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.714574    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 20:17:24.714614 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.714586    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 20:17:24.714614 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.714594    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:17:24.715463 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.715452    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:17:24.716266 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.716254    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 20:17:24.718881 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.718867    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:17:24.719016 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.719006    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 20:17:24.719049 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.719037    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 20:17:24.719049 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.719047    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 20:17:24.719110 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.719065    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 20:17:24.719110 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.719074    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 27 20:17:24.719110 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.719083    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 20:17:24.719544 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.719503    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:17:24.719544 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.719521    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:17:24.721437 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.721417    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 20:17:24.723666 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.723647    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 20:17:24.723796 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.723686    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 20:17:24.725427 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.725412    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 20:17:24.725528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.725432    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 20:17:24.725528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.725442    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 20:17:24.725528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.725451    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 20:17:24.725528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.725464    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 20:17:24.725528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.725472    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 20:17:24.725528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.725484    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 20:17:24.725528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.725492    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 20:17:24.725528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.725501    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 20:17:24.725528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.725509    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 20:17:24.725528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.725522    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 20:17:24.725528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.725532    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 20:17:24.726545 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.726533    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 20:17:24.726597 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.726547    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 20:17:24.729288 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.729262    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 20:17:24.729288 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.729264    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-20.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 20:17:24.729434 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.729288    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-20.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 20:17:24.730077 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.729973    2580 server.go:1268] "Started kubelet"
Jul 27 20:17:24.734006 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.733962    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 20:17:24.734182 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.734124    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 20:17:24.734269 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.734229    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 20:17:24.735337 ip-10-0-139-20 systemd[1]: Started Kubernetes Kubelet.
Jul 27 20:17:24.735970 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.735950    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 20:17:24.737999 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.737983    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 20:17:24.743582 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.743559    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 20:17:24.746209 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.746191    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 20:17:24.746209 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.746198    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 20:17:24.746335 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.746310    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:24.746796 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.746775    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 20:17:24.746796 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.746779    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 20:17:24.746926 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.746805    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 20:17:24.746926 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.746871    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 20:17:24.746926 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.746881    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 20:17:24.747210 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.747196    2580 factory.go:55] Registering systemd factory
Jul 27 20:17:24.747268 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.747226    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 27 20:17:24.747526 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.747510    2580 factory.go:153] Registering CRI-O factory
Jul 27 20:17:24.747615 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.747529    2580 factory.go:223] Registration of the crio container factory successfully
Jul 27 20:17:24.747615 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.747584    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 20:17:24.747615 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.747603    2580 factory.go:103] Registering Raw factory
Jul 27 20:17:24.747615 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.747614    2580 manager.go:1196] Started watching for new ooms in manager
Jul 27 20:17:24.748034 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.748015    2580 manager.go:349] Starting recovery of all containers
Jul 27 20:17:24.748662 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.748640    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-20.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 20:17:24.748774 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.748735    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 20:17:24.749428 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.748213    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-20.ec2.internal.18c63ee27a0639eb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-20.ec2.internal,UID:ip-10-0-139-20.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-20.ec2.internal,},FirstTimestamp:2026-07-27 20:17:24.729739755 +0000 UTC m=+0.385895089,LastTimestamp:2026-07-27 20:17:24.729739755 +0000 UTC m=+0.385895089,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-20.ec2.internal,}"
Jul 27 20:17:24.758825 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.758804    2580 manager.go:354] Recovery completed
Jul 27 20:17:24.758919 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.758866    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w7pvj"
Jul 27 20:17:24.763261 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.763247    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:17:24.764775 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.764733    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w7pvj"
Jul 27 20:17:24.765253 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.765239    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:17:24.765339 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.765270    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:17:24.765339 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.765286    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:17:24.765880 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.765867    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 20:17:24.765880 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.765879    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 20:17:24.765992 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.765897    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:17:24.765992 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.765903    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:17:24.766616 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.766602    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:17:24.766670 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.766627    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:17:24.766670 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.766639    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:17:24.768922 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.768903    2580 policy_none.go:49] "None policy: Start"
Jul 27 20:17:24.768984 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.768932    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 20:17:24.768984 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.768948    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 20:17:24.771027 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.771014    2580 policy_none.go:47] "Start"
Jul 27 20:17:24.811534 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.811324    2580 manager.go:337] "Starting Device Plugin manager"
Jul 27 20:17:24.811534 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.811506    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 20:17:24.811534 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.811517    2580 server.go:87] "Starting device plugin registration server"
Jul 27 20:17:24.811805 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.811793    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 20:17:24.811843 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.811807    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 20:17:24.811934 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.811908    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 20:17:24.812040 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.812006    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 20:17:24.812040 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.812015    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 20:17:24.812550 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.812532    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 20:17:24.812636 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.812584    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:24.894119 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.894071    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 20:17:24.895381 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.895362    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 20:17:24.895448 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.895402    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 20:17:24.895448 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.895427    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 20:17:24.895534 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.895469    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 20:17:24.898044 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.898019    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:17:24.912208 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.912150    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:17:24.913098 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.913077    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:17:24.913213 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.913114    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:17:24.913213 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.913129    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:17:24.913213 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.913158    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-20.ec2.internal"
Jul 27 20:17:24.922777 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.922758    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-20.ec2.internal"
Jul 27 20:17:24.922895 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.922789    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-20.ec2.internal\": node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:24.949830 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:24.949799    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:24.995597 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.995558    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-20.ec2.internal"]
Jul 27 20:17:24.995784 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.995655    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:17:24.997300 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.997282    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:17:24.997421 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.997313    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:17:24.997421 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.997323    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:17:24.999373 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.999359    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:17:24.999494 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.999464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:24.999549 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:24.999494    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:17:25.000115 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.000097    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:17:25.000210 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.000132    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:17:25.000210 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.000143    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:17:25.000210 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.000099    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:17:25.000348 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.000213    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:17:25.000348 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.000229    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:17:25.002223 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.002205    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.002314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.002232    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:17:25.002955 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.002937    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:17:25.003060 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.002965    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:17:25.003060 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.002976    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:17:25.021404 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:25.021380    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-20.ec2.internal\" not found" node="ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.025028 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:25.025011    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-20.ec2.internal\" not found" node="ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.048366 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.048338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af3d60c9b11aaaeeb11265e50a7701a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal\" (UID: \"af3d60c9b11aaaeeb11265e50a7701a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.048499 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.048371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af3d60c9b11aaaeeb11265e50a7701a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal\" (UID: \"af3d60c9b11aaaeeb11265e50a7701a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.048499 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.048391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ef9ae45a7bae6d28e2a06a2229f4e588-config\") pod \"kube-apiserver-proxy-ip-10-0-139-20.ec2.internal\" (UID: \"ef9ae45a7bae6d28e2a06a2229f4e588\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.050438 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:25.050420    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:25.149015 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.148981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af3d60c9b11aaaeeb11265e50a7701a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal\" (UID: \"af3d60c9b11aaaeeb11265e50a7701a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.149015 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.149021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af3d60c9b11aaaeeb11265e50a7701a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal\" (UID: \"af3d60c9b11aaaeeb11265e50a7701a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.149207 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.149062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ef9ae45a7bae6d28e2a06a2229f4e588-config\") pod \"kube-apiserver-proxy-ip-10-0-139-20.ec2.internal\" (UID: \"ef9ae45a7bae6d28e2a06a2229f4e588\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.149207 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.149093    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af3d60c9b11aaaeeb11265e50a7701a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal\" (UID: \"af3d60c9b11aaaeeb11265e50a7701a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.149207 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.149108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ef9ae45a7bae6d28e2a06a2229f4e588-config\") pod \"kube-apiserver-proxy-ip-10-0-139-20.ec2.internal\" (UID: \"ef9ae45a7bae6d28e2a06a2229f4e588\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.149207 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.149093    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af3d60c9b11aaaeeb11265e50a7701a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal\" (UID: \"af3d60c9b11aaaeeb11265e50a7701a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.151080 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:25.151057    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:25.251912 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:25.251844    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:25.326544 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.326501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.328851 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.328827    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.353069 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:25.353039    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:25.453556 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:25.453514    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:25.554667 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:25.554604    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:25.655303 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:25.655255    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:25.662764 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.662741    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:17:25.677098 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.677075    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 20:17:25.677218 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.677197    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:17:25.677262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.677246    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:17:25.755482 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:25.755452    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:25.770415 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.770382    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 20:12:25 +0000 UTC" deadline="2028-03-17 22:37:37.855579185 +0000 UTC"
Jul 27 20:17:25.770415 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.770413    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14378h20m12.085169855s"
Jul 27 20:17:25.856521 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:25.856454    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-20.ec2.internal\" not found"
Jul 27 20:17:25.875193 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.875166    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:17:25.946886 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.946851    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.966887 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.966858    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:17:25.968706 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.968687    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-20.ec2.internal"
Jul 27 20:17:25.977933 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:25.977911    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:17:26.025226 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:26.025192    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9ae45a7bae6d28e2a06a2229f4e588.slice/crio-49dbd0da845784f59560def914fe2f628bf6286de1bcd1201ce1f686feffcdd2 WatchSource:0}: Error finding container 49dbd0da845784f59560def914fe2f628bf6286de1bcd1201ce1f686feffcdd2: Status 404 returned error can't find the container with id 49dbd0da845784f59560def914fe2f628bf6286de1bcd1201ce1f686feffcdd2
Jul 27 20:17:26.025561 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:26.025540    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3d60c9b11aaaeeb11265e50a7701a1.slice/crio-23120ed8b829653e52d30d26d7f30dd1a3f493a3f0c804196dc9377c2778b034 WatchSource:0}: Error finding container 23120ed8b829653e52d30d26d7f30dd1a3f493a3f0c804196dc9377c2778b034: Status 404 returned error can't find the container with id 23120ed8b829653e52d30d26d7f30dd1a3f493a3f0c804196dc9377c2778b034
Jul 27 20:17:26.031068 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.031052    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:17:26.252222 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.252131    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:17:26.722047 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.721958    2580 apiserver.go:52] "Watching apiserver"
Jul 27 20:17:26.730441 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.730215    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 20:17:26.733055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.733017    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-k7v72","kube-system/konnectivity-agent-zllw5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft","openshift-dns/node-resolver-xlqmn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal","openshift-multus/multus-rznfm","openshift-multus/network-metrics-daemon-xbhcs","openshift-network-operator/iptables-alerter-cgtkq","kube-system/kube-apiserver-proxy-ip-10-0-139-20.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qhflc","openshift-image-registry/node-ca-vx29c","openshift-multus/multus-additional-cni-plugins-78fk7","openshift-network-diagnostics/network-check-target-6txrr","openshift-ovn-kubernetes/ovnkube-node-4f87c"]
Jul 27 20:17:26.736085 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.736060    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:26.736200 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:26.736152    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:26.738444 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.738417    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vx29c"
Jul 27 20:17:26.740886 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.740858    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 20:17:26.741116 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.741099    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 20:17:26.742849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.741403    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 20:17:26.742849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.741606    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cvq2r\""
Jul 27 20:17:26.742849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.742154    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.743231 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.743216    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xlqmn"
Jul 27 20:17:26.744107 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.744082    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 20:17:26.744636 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.744514    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 20:17:26.744820 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.744797    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 20:17:26.744898 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.744828    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lsmrb\""
Jul 27 20:17:26.745342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.745312    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 20:17:26.745586 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.745569    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 20:17:26.745662 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.745621    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.745840 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.745808    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pq5r5\""
Jul 27 20:17:26.747040 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.747022    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 20:17:26.748147 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.748092    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 20:17:26.748534 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.748515    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-462gb\""
Jul 27 20:17:26.748972 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.748817    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 20:17:26.749248 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.749229    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 20:17:26.749470 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.749428    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 20:17:26.749537 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.749523    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 20:17:26.749635 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.749619    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 20:17:26.749786 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.749770    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.751239 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.751222    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cgtkq"
Jul 27 20:17:26.751770 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.751732    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 20:17:26.752064 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.752046    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 20:17:26.752269 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.752250    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 20:17:26.752495 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.752478    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 20:17:26.752687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.752670    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r7cj7\""
Jul 27 20:17:26.753461 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.753442    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 20:17:26.753821 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.753773    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:17:26.754101 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.754084    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 20:17:26.754259 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.754241    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l8fvh\""
Jul 27 20:17:26.754465 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.754448    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:26.754556 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:26.754525    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:26.756995 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.756958    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zllw5"
Jul 27 20:17:26.759947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.759920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-etc-kubernetes\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.760047 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.759966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vzf\" (UniqueName: \"kubernetes.io/projected/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-kube-api-access-49vzf\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:26.760047 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.759999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-socket-dir\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.760047 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-etc-selinux\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.760219 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-kubelet\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.760219 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6n4r\" (UniqueName: \"kubernetes.io/projected/bcf5f54d-e823-465f-a27d-155cbecd8d00-kube-api-access-m6n4r\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.760219 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-multus-conf-dir\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.760219 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760114    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9134f898-53ea-442c-a679-527eedd58c2f-multus-daemon-config\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.760219 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6-serviceca\") pod \"node-ca-vx29c\" (UID: \"f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6\") " pod="openshift-image-registry/node-ca-vx29c"
Jul 27 20:17:26.760219 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-device-dir\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.760219 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75c6df92-2bce-4b1e-9e2d-e0ca0812f9de-hosts-file\") pod \"node-resolver-xlqmn\" (UID: \"75c6df92-2bce-4b1e-9e2d-e0ca0812f9de\") " pod="openshift-dns/node-resolver-xlqmn"
Jul 27 20:17:26.760219 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-log-socket\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.760219 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760229    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bcf5f54d-e823-465f-a27d-155cbecd8d00-env-overrides\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-cnibin\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-var-lib-kubelet\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drxk4\" (UniqueName: \"kubernetes.io/projected/75c6df92-2bce-4b1e-9e2d-e0ca0812f9de-kube-api-access-drxk4\") pod \"node-resolver-xlqmn\" (UID: \"75c6df92-2bce-4b1e-9e2d-e0ca0812f9de\") " pod="openshift-dns/node-resolver-xlqmn"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-node-log\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bcf5f54d-e823-465f-a27d-155cbecd8d00-ovnkube-config\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bcf5f54d-e823-465f-a27d-155cbecd8d00-ovn-node-metrics-cert\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760377    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-hostroot\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760393    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-run-multus-certs\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760421    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-sys-fs\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bcf5f54d-e823-465f-a27d-155cbecd8d00-ovnkube-script-lib\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760506    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-run-netns\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760550    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-registration-dir\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760562    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4qrw9\""
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c6df92-2bce-4b1e-9e2d-e0ca0812f9de-tmp-dir\") pod \"node-resolver-xlqmn\" (UID: \"75c6df92-2bce-4b1e-9e2d-e0ca0812f9de\") " pod="openshift-dns/node-resolver-xlqmn"
Jul 27 20:17:26.760687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-run-ovn\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760632    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-system-cni-dir\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-run-k8s-cni-cncf-io\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-var-lib-cni-bin\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2r7l\" (UniqueName: \"kubernetes.io/projected/9134f898-53ea-442c-a679-527eedd58c2f-kube-api-access-m2r7l\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7tbn\" (UniqueName: \"kubernetes.io/projected/f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6-kube-api-access-t7tbn\") pod \"node-ca-vx29c\" (UID: \"f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6\") " pod="openshift-image-registry/node-ca-vx29c"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghv9j\" (UniqueName: \"kubernetes.io/projected/12ae015f-e09d-4457-ad64-b06b68251d3b-kube-api-access-ghv9j\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760790    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-run-systemd\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760818    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-run-openvswitch\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-cni-bin\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6-host\") pod \"node-ca-vx29c\" (UID: \"f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6\") " pod="openshift-image-registry/node-ca-vx29c"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-systemd-units\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760923    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-slash\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-run-netns\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.760982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-var-lib-openvswitch\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.761021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-etc-openvswitch\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.761026    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 20:17:26.761384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.761046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-cni-netd\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.762275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.761071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-multus-cni-dir\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.762275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.761095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.762275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.761121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-run-ovn-kubernetes\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.762275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.761190    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-os-release\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.762275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.761371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9134f898-53ea-442c-a679-527eedd58c2f-cni-binary-copy\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.762275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.761402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-multus-socket-dir-parent\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.762275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.761457    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-var-lib-cni-multus\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.762626 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.762515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:26.762626 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:26.762576    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:26.762626 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.762606    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:17:26.762967 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.762947    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mhpbk\""
Jul 27 20:17:26.762967 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.762965    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 20:17:26.763506 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.763311    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:17:26.765053 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.765031    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.767318 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.767298    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 20:17:26.767566 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.767552    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 20:17:26.767711 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.767697    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6xfn5\""
Jul 27 20:17:26.779947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.779922    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hz77q"
Jul 27 20:17:26.787291 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.787265    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hz77q"
Jul 27 20:17:26.849398 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.849367    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c6df92-2bce-4b1e-9e2d-e0ca0812f9de-tmp-dir\") pod \"node-resolver-xlqmn\" (UID: \"75c6df92-2bce-4b1e-9e2d-e0ca0812f9de\") " pod="openshift-dns/node-resolver-xlqmn"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-run-ovn\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2r7l\" (UniqueName: \"kubernetes.io/projected/9134f898-53ea-442c-a679-527eedd58c2f-kube-api-access-m2r7l\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3459e0f1-bf89-482c-96cd-dbd50ea26125-konnectivity-ca\") pod \"konnectivity-agent-zllw5\" (UID: \"3459e0f1-bf89-482c-96cd-dbd50ea26125\") " pod="kube-system/konnectivity-agent-zllw5"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-modprobe-d\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-sys\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghv9j\" (UniqueName: \"kubernetes.io/projected/12ae015f-e09d-4457-ad64-b06b68251d3b-kube-api-access-ghv9j\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-run-openvswitch\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6-host\") pod \"node-ca-vx29c\" (UID: \"f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6\") " pod="openshift-image-registry/node-ca-vx29c"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-slash\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-var-lib-openvswitch\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-cni-netd\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-multus-cni-dir\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-os-release\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-etc-kubernetes\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-kubernetes\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.865849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9134f898-53ea-442c-a679-527eedd58c2f-cni-binary-copy\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-multus-socket-dir-parent\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-sysctl-d\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-lib-modules\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhg7d\" (UniqueName: \"kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d\") pod \"network-check-target-6txrr\" (UID: \"76cf7b6f-a97e-44af-ab23-f8d3ef30955a\") " pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-socket-dir\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-etc-selinux\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-kubelet\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6n4r\" (UniqueName: \"kubernetes.io/projected/bcf5f54d-e823-465f-a27d-155cbecd8d00-kube-api-access-m6n4r\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-multus-conf-dir\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-sysconfig\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/204e7972-20a7-442a-a4c3-c29f8e78c3f7-system-cni-dir\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/204e7972-20a7-442a-a4c3-c29f8e78c3f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-device-dir\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862934    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-log-socket\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.862978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bcf5f54d-e823-465f-a27d-155cbecd8d00-env-overrides\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.866839 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-cnibin\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-var-lib-kubelet\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3459e0f1-bf89-482c-96cd-dbd50ea26125-agent-certs\") pod \"konnectivity-agent-zllw5\" (UID: \"3459e0f1-bf89-482c-96cd-dbd50ea26125\") " pod="kube-system/konnectivity-agent-zllw5"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drxk4\" (UniqueName: \"kubernetes.io/projected/75c6df92-2bce-4b1e-9e2d-e0ca0812f9de-kube-api-access-drxk4\") pod \"node-resolver-xlqmn\" (UID: \"75c6df92-2bce-4b1e-9e2d-e0ca0812f9de\") " pod="openshift-dns/node-resolver-xlqmn"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-node-log\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/204e7972-20a7-442a-a4c3-c29f8e78c3f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bcf5f54d-e823-465f-a27d-155cbecd8d00-ovnkube-script-lib\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-run-netns\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-run\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863311    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-registration-dir\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-system-cni-dir\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-run-k8s-cni-cncf-io\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-var-lib-cni-bin\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7tbn\" (UniqueName: \"kubernetes.io/projected/f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6-kube-api-access-t7tbn\") pod \"node-ca-vx29c\" (UID: \"f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6\") " pod="openshift-image-registry/node-ca-vx29c"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-var-lib-kubelet\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863481    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-tuned\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.867754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-run-systemd\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863583    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-cni-bin\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca-iptables-alerter-script\") pod \"iptables-alerter-cgtkq\" (UID: \"90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca\") " pod="openshift-network-operator/iptables-alerter-cgtkq"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/204e7972-20a7-442a-a4c3-c29f8e78c3f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/204e7972-20a7-442a-a4c3-c29f8e78c3f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-systemd-units\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-run-netns\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-etc-openvswitch\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-var-lib-cni-multus\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca-host-slash\") pod \"iptables-alerter-cgtkq\" (UID: \"90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca\") " pod="openshift-network-operator/iptables-alerter-cgtkq"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-node-log\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-run-ovn-kubernetes\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863935    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-run-openvswitch\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863937    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-run-ovn-kubernetes\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vzf\" (UniqueName: \"kubernetes.io/projected/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-kube-api-access-49vzf\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6-host\") pod \"node-ca-vx29c\" (UID: \"f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6\") " pod="openshift-image-registry/node-ca-vx29c"
Jul 27 20:17:26.868657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6-serviceca\") pod \"node-ca-vx29c\" (UID: \"f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6\") " pod="openshift-image-registry/node-ca-vx29c"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864035    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-slash\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864085    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-var-lib-openvswitch\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864098    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-cni-netd\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864203    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-os-release\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864248    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-etc-kubernetes\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-host\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/018163d0-e356-4286-b3e3-2b32e0afdf23-dbus\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9134f898-53ea-442c-a679-527eedd58c2f-multus-daemon-config\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864351    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stwjp\" (UniqueName: \"kubernetes.io/projected/204e7972-20a7-442a-a4c3-c29f8e78c3f7-kube-api-access-stwjp\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75c6df92-2bce-4b1e-9e2d-e0ca0812f9de-hosts-file\") pod \"node-resolver-xlqmn\" (UID: \"75c6df92-2bce-4b1e-9e2d-e0ca0812f9de\") " pod="openshift-dns/node-resolver-xlqmn"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59519d9b-8d2e-4f95-a099-480b47b7d6f0-tmp\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/204e7972-20a7-442a-a4c3-c29f8e78c3f7-cnibin\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bcf5f54d-e823-465f-a27d-155cbecd8d00-ovnkube-config\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bcf5f54d-e823-465f-a27d-155cbecd8d00-ovn-node-metrics-cert\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.869530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-hostroot\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-run-multus-certs\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864604    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bcf5f54d-e823-465f-a27d-155cbecd8d00-ovnkube-script-lib\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6zrc\" (UniqueName: \"kubernetes.io/projected/90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca-kube-api-access-w6zrc\") pod \"iptables-alerter-cgtkq\" (UID: \"90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca\") " pod="openshift-network-operator/iptables-alerter-cgtkq"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864647    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-sysctl-conf\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-systemd\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864699    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-run-netns\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgxx6\" (UniqueName: \"kubernetes.io/projected/59519d9b-8d2e-4f95-a099-480b47b7d6f0-kube-api-access-jgxx6\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-sys-fs\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9134f898-53ea-442c-a679-527eedd58c2f-cni-binary-copy\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/018163d0-e356-4286-b3e3-2b32e0afdf23-kubelet-config\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864770    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-registration-dir\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.863310    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c6df92-2bce-4b1e-9e2d-e0ca0812f9de-tmp-dir\") pod \"node-resolver-xlqmn\" (UID: \"75c6df92-2bce-4b1e-9e2d-e0ca0812f9de\") " pod="openshift-dns/node-resolver-xlqmn"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/204e7972-20a7-442a-a4c3-c29f8e78c3f7-os-release\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864852    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-run-ovn\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864913    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-var-lib-cni-bin\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.870411 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75c6df92-2bce-4b1e-9e2d-e0ca0812f9de-hosts-file\") pod \"node-resolver-xlqmn\" (UID: \"75c6df92-2bce-4b1e-9e2d-e0ca0812f9de\") " pod="openshift-dns/node-resolver-xlqmn"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.864987    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-multus-cni-dir\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-sys-fs\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-run-systemd\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865052    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-multus-socket-dir-parent\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-systemd-units\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865190    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-run-netns\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-system-cni-dir\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865289    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-socket-dir\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865326    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-etc-openvswitch\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-var-lib-cni-multus\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865368    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-multus-conf-dir\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865451    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-device-dir\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/12ae015f-e09d-4457-ad64-b06b68251d3b-etc-selinux\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865497    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-kubelet\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865531    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-log-socket\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9134f898-53ea-442c-a679-527eedd58c2f-multus-daemon-config\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-run-k8s-cni-cncf-io\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.871364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865839    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcf5f54d-e823-465f-a27d-155cbecd8d00-host-cni-bin\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.872338 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-run-multus-certs\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.872338 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bcf5f54d-e823-465f-a27d-155cbecd8d00-env-overrides\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.872338 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.865960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-cnibin\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.872338 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.866005    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-host-var-lib-kubelet\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.872338 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:26.866093    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:26.872338 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.866186    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 20:17:26.872338 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:26.866242    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs podName:9b574f99-44fb-4a34-b645-ef5aa1bbaf1e nodeName:}" failed. No retries permitted until 2026-07-27 20:17:27.366141936 +0000 UTC m=+3.022297263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs") pod "network-metrics-daemon-xbhcs" (UID: "9b574f99-44fb-4a34-b645-ef5aa1bbaf1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:26.872338 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.866476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9134f898-53ea-442c-a679-527eedd58c2f-hostroot\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.872338 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.866803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6-serviceca\") pod \"node-ca-vx29c\" (UID: \"f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6\") " pod="openshift-image-registry/node-ca-vx29c"
Jul 27 20:17:26.872338 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.867114    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bcf5f54d-e823-465f-a27d-155cbecd8d00-ovnkube-config\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.876247 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.876181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bcf5f54d-e823-465f-a27d-155cbecd8d00-ovn-node-metrics-cert\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.876416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.876389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7tbn\" (UniqueName: \"kubernetes.io/projected/f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6-kube-api-access-t7tbn\") pod \"node-ca-vx29c\" (UID: \"f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6\") " pod="openshift-image-registry/node-ca-vx29c"
Jul 27 20:17:26.877260 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.877234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2r7l\" (UniqueName: \"kubernetes.io/projected/9134f898-53ea-442c-a679-527eedd58c2f-kube-api-access-m2r7l\") pod \"multus-rznfm\" (UID: \"9134f898-53ea-442c-a679-527eedd58c2f\") " pod="openshift-multus/multus-rznfm"
Jul 27 20:17:26.877515 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.877486    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6n4r\" (UniqueName: \"kubernetes.io/projected/bcf5f54d-e823-465f-a27d-155cbecd8d00-kube-api-access-m6n4r\") pod \"ovnkube-node-4f87c\" (UID: \"bcf5f54d-e823-465f-a27d-155cbecd8d00\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:26.879053 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.879022    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drxk4\" (UniqueName: \"kubernetes.io/projected/75c6df92-2bce-4b1e-9e2d-e0ca0812f9de-kube-api-access-drxk4\") pod \"node-resolver-xlqmn\" (UID: \"75c6df92-2bce-4b1e-9e2d-e0ca0812f9de\") " pod="openshift-dns/node-resolver-xlqmn"
Jul 27 20:17:26.879631 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.879609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vzf\" (UniqueName: \"kubernetes.io/projected/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-kube-api-access-49vzf\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:26.887271 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.887241    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghv9j\" (UniqueName: \"kubernetes.io/projected/12ae015f-e09d-4457-ad64-b06b68251d3b-kube-api-access-ghv9j\") pod \"aws-ebs-csi-driver-node-2shft\" (UID: \"12ae015f-e09d-4457-ad64-b06b68251d3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:26.903578 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.903520    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-20.ec2.internal" event={"ID":"ef9ae45a7bae6d28e2a06a2229f4e588","Type":"ContainerStarted","Data":"49dbd0da845784f59560def914fe2f628bf6286de1bcd1201ce1f686feffcdd2"}
Jul 27 20:17:26.905473 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.905435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal" event={"ID":"af3d60c9b11aaaeeb11265e50a7701a1","Type":"ContainerStarted","Data":"23120ed8b829653e52d30d26d7f30dd1a3f493a3f0c804196dc9377c2778b034"}
Jul 27 20:17:26.963310 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.963270    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:17:26.965168 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-host\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.965309 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/018163d0-e356-4286-b3e3-2b32e0afdf23-dbus\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:26.965309 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stwjp\" (UniqueName: \"kubernetes.io/projected/204e7972-20a7-442a-a4c3-c29f8e78c3f7-kube-api-access-stwjp\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.965309 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-host\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.965482 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59519d9b-8d2e-4f95-a099-480b47b7d6f0-tmp\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.965482 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/204e7972-20a7-442a-a4c3-c29f8e78c3f7-cnibin\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.965482 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6zrc\" (UniqueName: \"kubernetes.io/projected/90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca-kube-api-access-w6zrc\") pod \"iptables-alerter-cgtkq\" (UID: \"90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca\") " pod="openshift-network-operator/iptables-alerter-cgtkq"
Jul 27 20:17:26.965482 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-sysctl-conf\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.965752 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-systemd\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.965752 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965504    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/018163d0-e356-4286-b3e3-2b32e0afdf23-dbus\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:26.965752 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgxx6\" (UniqueName: \"kubernetes.io/projected/59519d9b-8d2e-4f95-a099-480b47b7d6f0-kube-api-access-jgxx6\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.965752 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/018163d0-e356-4286-b3e3-2b32e0afdf23-kubelet-config\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:26.965752 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965579    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/204e7972-20a7-442a-a4c3-c29f8e78c3f7-os-release\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.965752 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3459e0f1-bf89-482c-96cd-dbd50ea26125-konnectivity-ca\") pod \"konnectivity-agent-zllw5\" (UID: \"3459e0f1-bf89-482c-96cd-dbd50ea26125\") " pod="kube-system/konnectivity-agent-zllw5"
Jul 27 20:17:26.965752 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-modprobe-d\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.965752 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-sys\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.965752 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-kubernetes\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.965752 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-sysctl-d\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.965752 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-lib-modules\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhg7d\" (UniqueName: \"kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d\") pod \"network-check-target-6txrr\" (UID: \"76cf7b6f-a97e-44af-ab23-f8d3ef30955a\") " pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-sysconfig\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/204e7972-20a7-442a-a4c3-c29f8e78c3f7-system-cni-dir\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/204e7972-20a7-442a-a4c3-c29f8e78c3f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3459e0f1-bf89-482c-96cd-dbd50ea26125-agent-certs\") pod \"konnectivity-agent-zllw5\" (UID: \"3459e0f1-bf89-482c-96cd-dbd50ea26125\") " pod="kube-system/konnectivity-agent-zllw5"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/204e7972-20a7-442a-a4c3-c29f8e78c3f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.965986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-run\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-var-lib-kubelet\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966039    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-tuned\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca-iptables-alerter-script\") pod \"iptables-alerter-cgtkq\" (UID: \"90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca\") " pod="openshift-network-operator/iptables-alerter-cgtkq"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/204e7972-20a7-442a-a4c3-c29f8e78c3f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/204e7972-20a7-442a-a4c3-c29f8e78c3f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca-host-slash\") pod \"iptables-alerter-cgtkq\" (UID: \"90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca\") " pod="openshift-network-operator/iptables-alerter-cgtkq"
Jul 27 20:17:26.966327 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca-host-slash\") pod \"iptables-alerter-cgtkq\" (UID: \"90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca\") " pod="openshift-network-operator/iptables-alerter-cgtkq"
Jul 27 20:17:26.967097 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966391    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-sysconfig\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.967097 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966400    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/204e7972-20a7-442a-a4c3-c29f8e78c3f7-cnibin\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.967097 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-sysctl-conf\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.967097 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966450    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-systemd\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.967097 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966431    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-var-lib-kubelet\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.967097 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/204e7972-20a7-442a-a4c3-c29f8e78c3f7-system-cni-dir\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.967097 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-run\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.967097 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:26.966539    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:26.967097 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:26.966618    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret podName:018163d0-e356-4286-b3e3-2b32e0afdf23 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:27.466598807 +0000 UTC m=+3.122754153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret") pod "global-pull-secret-syncer-k7v72" (UID: "018163d0-e356-4286-b3e3-2b32e0afdf23") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:26.967097 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-kubernetes\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.967097 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/204e7972-20a7-442a-a4c3-c29f8e78c3f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.967097 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.966542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/204e7972-20a7-442a-a4c3-c29f8e78c3f7-os-release\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.967755 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.967132    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/204e7972-20a7-442a-a4c3-c29f8e78c3f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.967755 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.967152    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca-iptables-alerter-script\") pod \"iptables-alerter-cgtkq\" (UID: \"90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca\") " pod="openshift-network-operator/iptables-alerter-cgtkq"
Jul 27 20:17:26.967755 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.967209    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/018163d0-e356-4286-b3e3-2b32e0afdf23-kubelet-config\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:26.967755 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.967247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-modprobe-d\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.967755 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.967269    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-sys\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.967755 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.967270    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-lib-modules\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.967755 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.967354    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-sysctl-d\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.968150 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.967883    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/204e7972-20a7-442a-a4c3-c29f8e78c3f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.968150 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.968094    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3459e0f1-bf89-482c-96cd-dbd50ea26125-konnectivity-ca\") pod \"konnectivity-agent-zllw5\" (UID: \"3459e0f1-bf89-482c-96cd-dbd50ea26125\") " pod="kube-system/konnectivity-agent-zllw5"
Jul 27 20:17:26.971880 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.968522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/204e7972-20a7-442a-a4c3-c29f8e78c3f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.971880 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.968714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59519d9b-8d2e-4f95-a099-480b47b7d6f0-tmp\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.971880 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.970351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3459e0f1-bf89-482c-96cd-dbd50ea26125-agent-certs\") pod \"konnectivity-agent-zllw5\" (UID: \"3459e0f1-bf89-482c-96cd-dbd50ea26125\") " pod="kube-system/konnectivity-agent-zllw5"
Jul 27 20:17:26.971880 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.971185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59519d9b-8d2e-4f95-a099-480b47b7d6f0-etc-tuned\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:26.977657 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:26.977587    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:17:26.977657 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:26.977627    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:17:26.977657 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:26.977643    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhg7d for pod openshift-network-diagnostics/network-check-target-6txrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:26.977947 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:26.977729    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d podName:76cf7b6f-a97e-44af-ab23-f8d3ef30955a nodeName:}" failed. No retries permitted until 2026-07-27 20:17:27.477708162 +0000 UTC m=+3.133863512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xhg7d" (UniqueName: "kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d") pod "network-check-target-6txrr" (UID: "76cf7b6f-a97e-44af-ab23-f8d3ef30955a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:26.980248 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.980224    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stwjp\" (UniqueName: \"kubernetes.io/projected/204e7972-20a7-442a-a4c3-c29f8e78c3f7-kube-api-access-stwjp\") pod \"multus-additional-cni-plugins-78fk7\" (UID: \"204e7972-20a7-442a-a4c3-c29f8e78c3f7\") " pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:26.980609 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.980583    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6zrc\" (UniqueName: \"kubernetes.io/projected/90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca-kube-api-access-w6zrc\") pod \"iptables-alerter-cgtkq\" (UID: \"90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca\") " pod="openshift-network-operator/iptables-alerter-cgtkq"
Jul 27 20:17:26.981383 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:26.981365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgxx6\" (UniqueName: \"kubernetes.io/projected/59519d9b-8d2e-4f95-a099-480b47b7d6f0-kube-api-access-jgxx6\") pod \"tuned-qhflc\" (UID: \"59519d9b-8d2e-4f95-a099-480b47b7d6f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:27.053898 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.053855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vx29c"
Jul 27 20:17:27.065294 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.065228    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft"
Jul 27 20:17:27.066171 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:27.066137    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4cdb38f_eb44_4a04_9e14_5ff2e5c0cbd6.slice/crio-02284ce1b0c459f9e88bc63e0da0283a3f3aa0d5ca83e13b176eaa640c8d93f2 WatchSource:0}: Error finding container 02284ce1b0c459f9e88bc63e0da0283a3f3aa0d5ca83e13b176eaa640c8d93f2: Status 404 returned error can't find the container with id 02284ce1b0c459f9e88bc63e0da0283a3f3aa0d5ca83e13b176eaa640c8d93f2
Jul 27 20:17:27.080222 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:27.080188    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ae015f_e09d_4457_ad64_b06b68251d3b.slice/crio-3ba8c4e95cccae7a2d35d00d2af2d5992cb63070736d0b3cdaa5060e770a6962 WatchSource:0}: Error finding container 3ba8c4e95cccae7a2d35d00d2af2d5992cb63070736d0b3cdaa5060e770a6962: Status 404 returned error can't find the container with id 3ba8c4e95cccae7a2d35d00d2af2d5992cb63070736d0b3cdaa5060e770a6962
Jul 27 20:17:27.081524 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.081330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xlqmn"
Jul 27 20:17:27.089340 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.089148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:27.092962 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:27.092939    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c6df92_2bce_4b1e_9e2d_e0ca0812f9de.slice/crio-917e9836205663c3ea8427a06e67f445311f3a0bef04d89acc81b2e58e24c57d WatchSource:0}: Error finding container 917e9836205663c3ea8427a06e67f445311f3a0bef04d89acc81b2e58e24c57d: Status 404 returned error can't find the container with id 917e9836205663c3ea8427a06e67f445311f3a0bef04d89acc81b2e58e24c57d
Jul 27 20:17:27.100174 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.099988    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rznfm"
Jul 27 20:17:27.100447 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:27.100401    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf5f54d_e823_465f_a27d_155cbecd8d00.slice/crio-e6dac191faf26e7c15f728b38a79cf42c73dcb915fee28717808415d506efc41 WatchSource:0}: Error finding container e6dac191faf26e7c15f728b38a79cf42c73dcb915fee28717808415d506efc41: Status 404 returned error can't find the container with id e6dac191faf26e7c15f728b38a79cf42c73dcb915fee28717808415d506efc41
Jul 27 20:17:27.108679 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.108653    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cgtkq"
Jul 27 20:17:27.110870 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:27.110784    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9134f898_53ea_442c_a679_527eedd58c2f.slice/crio-9fbc249560cce57970f34f09ddac78ed2d2ffe6db13324ef1ee78de913f91b77 WatchSource:0}: Error finding container 9fbc249560cce57970f34f09ddac78ed2d2ffe6db13324ef1ee78de913f91b77: Status 404 returned error can't find the container with id 9fbc249560cce57970f34f09ddac78ed2d2ffe6db13324ef1ee78de913f91b77
Jul 27 20:17:27.118689 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.118653    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zllw5"
Jul 27 20:17:27.129083 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.129050    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qhflc"
Jul 27 20:17:27.137112 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.137090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-78fk7"
Jul 27 20:17:27.370249 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.370143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:27.370430 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:27.370315    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:27.370430 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:27.370381    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs podName:9b574f99-44fb-4a34-b645-ef5aa1bbaf1e nodeName:}" failed. No retries permitted until 2026-07-27 20:17:28.370365829 +0000 UTC m=+4.026521157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs") pod "network-metrics-daemon-xbhcs" (UID: "9b574f99-44fb-4a34-b645-ef5aa1bbaf1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:27.470882 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.470841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:27.471053 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:27.471030    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:27.471138 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:27.471124    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret podName:018163d0-e356-4286-b3e3-2b32e0afdf23 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:28.471102418 +0000 UTC m=+4.127257760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret") pod "global-pull-secret-syncer-k7v72" (UID: "018163d0-e356-4286-b3e3-2b32e0afdf23") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:27.572216 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.572172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhg7d\" (UniqueName: \"kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d\") pod \"network-check-target-6txrr\" (UID: \"76cf7b6f-a97e-44af-ab23-f8d3ef30955a\") " pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:27.572393 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:27.572333    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:17:27.572393 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:27.572353    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:17:27.572393 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:27.572362    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhg7d for pod openshift-network-diagnostics/network-check-target-6txrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:27.572577 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:27.572430    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d podName:76cf7b6f-a97e-44af-ab23-f8d3ef30955a nodeName:}" failed. No retries permitted until 2026-07-27 20:17:28.572407222 +0000 UTC m=+4.228562555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhg7d" (UniqueName: "kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d") pod "network-check-target-6txrr" (UID: "76cf7b6f-a97e-44af-ab23-f8d3ef30955a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:27.790655 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.790551    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:12:27 +0000 UTC" deadline="2028-02-29 02:32:18.731750781 +0000 UTC"
Jul 27 20:17:27.790655 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.790601    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13950h14m50.94115939s"
Jul 27 20:17:27.895914 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.895873    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:27.896071 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.895873    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:27.896071 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:27.895992    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:27.896189 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:27.896101    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:27.896189 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.895883    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:27.896274 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:27.896201    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:27.907794 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.907747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c" event={"ID":"bcf5f54d-e823-465f-a27d-155cbecd8d00","Type":"ContainerStarted","Data":"e6dac191faf26e7c15f728b38a79cf42c73dcb915fee28717808415d506efc41"}
Jul 27 20:17:27.908819 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.908794    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xlqmn" event={"ID":"75c6df92-2bce-4b1e-9e2d-e0ca0812f9de","Type":"ContainerStarted","Data":"917e9836205663c3ea8427a06e67f445311f3a0bef04d89acc81b2e58e24c57d"}
Jul 27 20:17:27.909857 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.909829    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft" event={"ID":"12ae015f-e09d-4457-ad64-b06b68251d3b","Type":"ContainerStarted","Data":"3ba8c4e95cccae7a2d35d00d2af2d5992cb63070736d0b3cdaa5060e770a6962"}
Jul 27 20:17:27.911063 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.911035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vx29c" event={"ID":"f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6","Type":"ContainerStarted","Data":"02284ce1b0c459f9e88bc63e0da0283a3f3aa0d5ca83e13b176eaa640c8d93f2"}
Jul 27 20:17:27.912244 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:27.912219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rznfm" event={"ID":"9134f898-53ea-442c-a679-527eedd58c2f","Type":"ContainerStarted","Data":"9fbc249560cce57970f34f09ddac78ed2d2ffe6db13324ef1ee78de913f91b77"}
Jul 27 20:17:28.171882 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:28.171844    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b3dc0b_c10d_4ade_9e52_9a57ea56b6ca.slice/crio-7a95a69da78d44b294c1d7a6e1d1fa729111d1b9335f36ea85cd6e9919cfda82 WatchSource:0}: Error finding container 7a95a69da78d44b294c1d7a6e1d1fa729111d1b9335f36ea85cd6e9919cfda82: Status 404 returned error can't find the container with id 7a95a69da78d44b294c1d7a6e1d1fa729111d1b9335f36ea85cd6e9919cfda82
Jul 27 20:17:28.174939 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:28.174911    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59519d9b_8d2e_4f95_a099_480b47b7d6f0.slice/crio-a497f43861b223a06da2797c0dec2b92c3526df1502bb6847b4a57ad7dd7cbda WatchSource:0}: Error finding container a497f43861b223a06da2797c0dec2b92c3526df1502bb6847b4a57ad7dd7cbda: Status 404 returned error can't find the container with id a497f43861b223a06da2797c0dec2b92c3526df1502bb6847b4a57ad7dd7cbda
Jul 27 20:17:28.179278 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:28.179252    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204e7972_20a7_442a_a4c3_c29f8e78c3f7.slice/crio-46e89c588b3080e9f90b17e4ff962e2bf284d6ca5c7f12a9ec0f9c34c4d05143 WatchSource:0}: Error finding container 46e89c588b3080e9f90b17e4ff962e2bf284d6ca5c7f12a9ec0f9c34c4d05143: Status 404 returned error can't find the container with id 46e89c588b3080e9f90b17e4ff962e2bf284d6ca5c7f12a9ec0f9c34c4d05143
Jul 27 20:17:28.180372 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:17:28.180350    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3459e0f1_bf89_482c_96cd_dbd50ea26125.slice/crio-65574568dcbbd08da032b46740906c3f0d5e0e6dc0763b0b41f8bea552ad5c05 WatchSource:0}: Error finding container 65574568dcbbd08da032b46740906c3f0d5e0e6dc0763b0b41f8bea552ad5c05: Status 404 returned error can't find the container with id 65574568dcbbd08da032b46740906c3f0d5e0e6dc0763b0b41f8bea552ad5c05
Jul 27 20:17:28.378996 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.378361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:28.378996 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:28.378515    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:28.378996 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:28.378590    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs podName:9b574f99-44fb-4a34-b645-ef5aa1bbaf1e nodeName:}" failed. No retries permitted until 2026-07-27 20:17:30.378568755 +0000 UTC m=+6.034724089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs") pod "network-metrics-daemon-xbhcs" (UID: "9b574f99-44fb-4a34-b645-ef5aa1bbaf1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:28.479277 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.479232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:28.479449 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:28.479381    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:28.479449 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:28.479433    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret podName:018163d0-e356-4286-b3e3-2b32e0afdf23 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:30.479419118 +0000 UTC m=+6.135574455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret") pod "global-pull-secret-syncer-k7v72" (UID: "018163d0-e356-4286-b3e3-2b32e0afdf23") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:28.579934 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.579890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhg7d\" (UniqueName: \"kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d\") pod \"network-check-target-6txrr\" (UID: \"76cf7b6f-a97e-44af-ab23-f8d3ef30955a\") " pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:28.580123 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:28.580087    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:17:28.580123 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:28.580109    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:17:28.580123 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:28.580122    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhg7d for pod openshift-network-diagnostics/network-check-target-6txrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:28.580289 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:28.580187    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d podName:76cf7b6f-a97e-44af-ab23-f8d3ef30955a nodeName:}" failed. No retries permitted until 2026-07-27 20:17:30.580167349 +0000 UTC m=+6.236322694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhg7d" (UniqueName: "kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d") pod "network-check-target-6txrr" (UID: "76cf7b6f-a97e-44af-ab23-f8d3ef30955a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:28.615142 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.615110    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:17:28.791932 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.791775    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:12:27 +0000 UTC" deadline="2028-01-21 07:11:36.043645745 +0000 UTC"
Jul 27 20:17:28.791932 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.791843    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13018h54m7.251808s"
Jul 27 20:17:28.930454 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.930415    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zllw5" event={"ID":"3459e0f1-bf89-482c-96cd-dbd50ea26125","Type":"ContainerStarted","Data":"65574568dcbbd08da032b46740906c3f0d5e0e6dc0763b0b41f8bea552ad5c05"}
Jul 27 20:17:28.953605 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.953517    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78fk7" event={"ID":"204e7972-20a7-442a-a4c3-c29f8e78c3f7","Type":"ContainerStarted","Data":"46e89c588b3080e9f90b17e4ff962e2bf284d6ca5c7f12a9ec0f9c34c4d05143"}
Jul 27 20:17:28.964261 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.964144    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qhflc" event={"ID":"59519d9b-8d2e-4f95-a099-480b47b7d6f0","Type":"ContainerStarted","Data":"a497f43861b223a06da2797c0dec2b92c3526df1502bb6847b4a57ad7dd7cbda"}
Jul 27 20:17:28.969025 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.968928    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cgtkq" event={"ID":"90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca","Type":"ContainerStarted","Data":"7a95a69da78d44b294c1d7a6e1d1fa729111d1b9335f36ea85cd6e9919cfda82"}
Jul 27 20:17:28.973935 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.973098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-20.ec2.internal" event={"ID":"ef9ae45a7bae6d28e2a06a2229f4e588","Type":"ContainerStarted","Data":"59cb849f95e45d5561377f50aba7cb2f115be4b87a83aca7c8c0bc75a93b8016"}
Jul 27 20:17:28.981711 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.981679    2580 generic.go:356] "Generic (PLEG): container finished" podID="af3d60c9b11aaaeeb11265e50a7701a1" containerID="7a929945f81ffddc5f7e9409191c8a30769ad8268abfeb086ec1589ff5cc671a" exitCode=0
Jul 27 20:17:28.981889 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.981728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal" event={"ID":"af3d60c9b11aaaeeb11265e50a7701a1","Type":"ContainerDied","Data":"7a929945f81ffddc5f7e9409191c8a30769ad8268abfeb086ec1589ff5cc671a"}
Jul 27 20:17:28.991565 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:28.991508    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-20.ec2.internal" podStartSLOduration=2.991491657 podStartE2EDuration="2.991491657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:28.991112823 +0000 UTC m=+4.647268173" watchObservedRunningTime="2026-07-27 20:17:28.991491657 +0000 UTC m=+4.647647005"
Jul 27 20:17:29.896428 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:29.896388    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:29.897085 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:29.896553    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:29.897085 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:29.896976    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:29.897203 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:29.897096    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:29.897203 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:29.897156    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:29.897270 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:29.897231    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:30.025018 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:30.024816    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal" event={"ID":"af3d60c9b11aaaeeb11265e50a7701a1","Type":"ContainerStarted","Data":"500d230452bb582b60f30b689aebb029fe8e784c10cb704ec56c592459ca5815"}
Jul 27 20:17:30.395599 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:30.394962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:30.395599 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:30.395180    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:30.395599 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:30.395247    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs podName:9b574f99-44fb-4a34-b645-ef5aa1bbaf1e nodeName:}" failed. No retries permitted until 2026-07-27 20:17:34.39522756 +0000 UTC m=+10.051382888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs") pod "network-metrics-daemon-xbhcs" (UID: "9b574f99-44fb-4a34-b645-ef5aa1bbaf1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:30.496358 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:30.496290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:30.496575 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:30.496446    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:30.496575 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:30.496530    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret podName:018163d0-e356-4286-b3e3-2b32e0afdf23 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:34.496507152 +0000 UTC m=+10.152662494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret") pod "global-pull-secret-syncer-k7v72" (UID: "018163d0-e356-4286-b3e3-2b32e0afdf23") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:30.596889 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:30.596846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhg7d\" (UniqueName: \"kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d\") pod \"network-check-target-6txrr\" (UID: \"76cf7b6f-a97e-44af-ab23-f8d3ef30955a\") " pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:30.597129 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:30.597086    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:17:30.597129 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:30.597113    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:17:30.597129 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:30.597126    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhg7d for pod openshift-network-diagnostics/network-check-target-6txrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:30.597328 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:30.597191    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d podName:76cf7b6f-a97e-44af-ab23-f8d3ef30955a nodeName:}" failed. No retries permitted until 2026-07-27 20:17:34.597170617 +0000 UTC m=+10.253325943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhg7d" (UniqueName: "kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d") pod "network-check-target-6txrr" (UID: "76cf7b6f-a97e-44af-ab23-f8d3ef30955a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:31.895804 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:31.895746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:31.896261 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:31.895915    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:31.896261 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:31.896015    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:31.896261 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:31.896022    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:31.896261 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:31.896114    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:31.896261 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:31.896242    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:33.895709 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:33.895666    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:33.896109 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:33.895802    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:33.896182 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:33.896165    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:33.896251 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:33.896236    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:33.896296 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:33.896280    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:33.896363 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:33.896349    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:34.431193 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:34.431152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:34.431390 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:34.431343    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:34.431453 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:34.431426    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs podName:9b574f99-44fb-4a34-b645-ef5aa1bbaf1e nodeName:}" failed. No retries permitted until 2026-07-27 20:17:42.431404449 +0000 UTC m=+18.087559784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs") pod "network-metrics-daemon-xbhcs" (UID: "9b574f99-44fb-4a34-b645-ef5aa1bbaf1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:34.532269 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:34.532229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:34.532436 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:34.532421    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:34.532508 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:34.532482    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret podName:018163d0-e356-4286-b3e3-2b32e0afdf23 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:42.532463927 +0000 UTC m=+18.188619255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret") pod "global-pull-secret-syncer-k7v72" (UID: "018163d0-e356-4286-b3e3-2b32e0afdf23") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:34.633303 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:34.633195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhg7d\" (UniqueName: \"kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d\") pod \"network-check-target-6txrr\" (UID: \"76cf7b6f-a97e-44af-ab23-f8d3ef30955a\") " pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:34.633487 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:34.633388    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:17:34.633487 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:34.633410    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:17:34.633487 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:34.633425    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhg7d for pod openshift-network-diagnostics/network-check-target-6txrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:34.633644 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:34.633503    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d podName:76cf7b6f-a97e-44af-ab23-f8d3ef30955a nodeName:}" failed. No retries permitted until 2026-07-27 20:17:42.633483583 +0000 UTC m=+18.289638905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhg7d" (UniqueName: "kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d") pod "network-check-target-6txrr" (UID: "76cf7b6f-a97e-44af-ab23-f8d3ef30955a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:35.895783 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:35.895735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:35.896231 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:35.895800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:35.896231 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:35.895889    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:35.896231 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:35.896176    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:35.896360 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:35.896260    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:35.896360 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:35.896346    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:37.895835 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:37.895793    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:37.895835 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:37.895822    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:37.896350 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:37.895822    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:37.896350 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:37.895924    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:37.896350 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:37.896018    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:37.896350 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:37.896106    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:39.895635 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:39.895603    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:39.895635 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:39.895627    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:39.896134 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:39.895728    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:39.896134 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:39.895786    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:39.896134 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:39.895900    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:39.896134 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:39.896003    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:41.895697 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:41.895656    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:41.896263 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:41.895665    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:41.896263 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:41.895810    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:41.896263 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:41.895666    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:41.896263 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:41.895882    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:41.896263 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:41.895970    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:42.490772 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:42.490722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:42.490940 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:42.490876    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:42.490979 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:42.490945    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs podName:9b574f99-44fb-4a34-b645-ef5aa1bbaf1e nodeName:}" failed. No retries permitted until 2026-07-27 20:17:58.49092883 +0000 UTC m=+34.147084151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs") pod "network-metrics-daemon-xbhcs" (UID: "9b574f99-44fb-4a34-b645-ef5aa1bbaf1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:42.591088 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:42.591048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:42.591235 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:42.591189    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:42.591276 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:42.591246    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret podName:018163d0-e356-4286-b3e3-2b32e0afdf23 nodeName:}" failed. No retries permitted until 2026-07-27 20:17:58.591231758 +0000 UTC m=+34.247387083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret") pod "global-pull-secret-syncer-k7v72" (UID: "018163d0-e356-4286-b3e3-2b32e0afdf23") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:42.692158 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:42.692117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhg7d\" (UniqueName: \"kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d\") pod \"network-check-target-6txrr\" (UID: \"76cf7b6f-a97e-44af-ab23-f8d3ef30955a\") " pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:42.692309 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:42.692292    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:17:42.692345 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:42.692316    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:17:42.692345 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:42.692327    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhg7d for pod openshift-network-diagnostics/network-check-target-6txrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:42.692597 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:42.692379    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d podName:76cf7b6f-a97e-44af-ab23-f8d3ef30955a nodeName:}" failed. No retries permitted until 2026-07-27 20:17:58.692364683 +0000 UTC m=+34.348520003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhg7d" (UniqueName: "kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d") pod "network-check-target-6txrr" (UID: "76cf7b6f-a97e-44af-ab23-f8d3ef30955a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:43.896489 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:43.896456    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:43.896934 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:43.896456    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:43.896934 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:43.896587    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:43.896934 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:43.896456    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:43.896934 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:43.896685    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:43.896934 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:43.896757    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:45.895922 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:45.895886    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:45.896364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:45.895881    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:45.896364 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:45.896018    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:45.896364 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:45.896121    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:45.896364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:45.895893    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:45.896364 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:45.896225    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:47.062040 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:47.061157    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qhflc" event={"ID":"59519d9b-8d2e-4f95-a099-480b47b7d6f0","Type":"ContainerStarted","Data":"744311710c39cc3f87809e2afc2e3a76bbefc29c9b8377d07cc25f0d301f1de9"}
Jul 27 20:17:47.066248 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:47.066223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rznfm" event={"ID":"9134f898-53ea-442c-a679-527eedd58c2f","Type":"ContainerStarted","Data":"e2ec3eb54918e927fd25acb25674f906df9783c10bae356000a50e17d814e509"}
Jul 27 20:17:47.076684 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:47.076174    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vx29c" event={"ID":"f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6","Type":"ContainerStarted","Data":"19eff35440fe346d43a79feb0d8b6aa6710e2c91b19b90d20c1223a0ecb4239b"}
Jul 27 20:17:47.086859 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:47.084594    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-20.ec2.internal" podStartSLOduration=21.084571822 podStartE2EDuration="21.084571822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:30.040613294 +0000 UTC m=+5.696768648" watchObservedRunningTime="2026-07-27 20:17:47.084571822 +0000 UTC m=+22.740727166"
Jul 27 20:17:47.086859 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:47.085058    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qhflc" podStartSLOduration=3.377666334 podStartE2EDuration="22.085037088s" totalImagesPullingTime="18.707370754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:47.084115892 +0000 UTC m=+22.740271236" watchObservedRunningTime="2026-07-27 20:17:47.085037088 +0000 UTC m=+22.741192432"
Jul 27 20:17:47.103276 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:47.103205    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rznfm" podStartSLOduration=2.2728875139999998 podStartE2EDuration="22.103188815s" totalImagesPullingTime="19.830301301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:47.102203332 +0000 UTC m=+22.758358738" watchObservedRunningTime="2026-07-27 20:17:47.103188815 +0000 UTC m=+22.759344158"
Jul 27 20:17:47.132853 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:47.132291    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vx29c" podStartSLOduration=10.365066411 podStartE2EDuration="22.132274001s" totalImagesPullingTime="11.76720759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:47.131928373 +0000 UTC m=+22.788083716" watchObservedRunningTime="2026-07-27 20:17:47.132274001 +0000 UTC m=+22.788429343"
Jul 27 20:17:47.146338 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:47.146285    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xlqmn" podStartSLOduration=2.357837033 podStartE2EDuration="22.146269619s" totalImagesPullingTime="19.788432586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:47.145559495 +0000 UTC m=+22.801714838" watchObservedRunningTime="2026-07-27 20:17:47.146269619 +0000 UTC m=+22.802424962"
Jul 27 20:17:47.896688 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:47.896504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:47.896900 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:47.896504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:47.896900 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:47.896504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:47.896900 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:47.896805    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:47.897060 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:47.896910    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:47.897060 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:47.896980    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:48.080847 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.080810    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c" event={"ID":"bcf5f54d-e823-465f-a27d-155cbecd8d00","Type":"ContainerStarted","Data":"eb3ab2e81f4c26fc6b89984f4c85a5cab478ca23665549217d5bcd17fe66b154"}
Jul 27 20:17:48.081808 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.080893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c" event={"ID":"bcf5f54d-e823-465f-a27d-155cbecd8d00","Type":"ContainerStarted","Data":"6bf3e2e9e8a6a71cb006693bb4f38e2bbe67db5e6664096c302f6d459bf4cce7"}
Jul 27 20:17:48.081808 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.080936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c" event={"ID":"bcf5f54d-e823-465f-a27d-155cbecd8d00","Type":"ContainerStarted","Data":"dfbb2794caceeb3ffec21b254b84c6fed4ff81a28ec566abf0315c4e5ae20b8c"}
Jul 27 20:17:48.081808 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.080975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c" event={"ID":"bcf5f54d-e823-465f-a27d-155cbecd8d00","Type":"ContainerStarted","Data":"8b95b8c95135a61a6b3f6f6d1c6b74ed667d2d8adb3d7562c7e3efa0861733ae"}
Jul 27 20:17:48.081808 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.081014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c" event={"ID":"bcf5f54d-e823-465f-a27d-155cbecd8d00","Type":"ContainerStarted","Data":"d18ecb07fbed2987e69c7bd36c9a332a6ed1aca3b282f6e8f1657d77ea9199d2"}
Jul 27 20:17:48.081808 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.081061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c" event={"ID":"bcf5f54d-e823-465f-a27d-155cbecd8d00","Type":"ContainerStarted","Data":"b8281b310d8b38d84a139b36ed1d5680e957fac4d85429f1f2d0e6476efb23ab"}
Jul 27 20:17:48.082108 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.082087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xlqmn" event={"ID":"75c6df92-2bce-4b1e-9e2d-e0ca0812f9de","Type":"ContainerStarted","Data":"6436a8163d69f0c7977e400c9feea1b66ae21b59b17d241538b1e7a5df353667"}
Jul 27 20:17:48.083479 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.083455    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft" event={"ID":"12ae015f-e09d-4457-ad64-b06b68251d3b","Type":"ContainerStarted","Data":"385c0b4b5b237d4c78666f2aea6d09e8b3e096b83ed760855ecc85921b5f5f45"}
Jul 27 20:17:48.084759 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.084726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zllw5" event={"ID":"3459e0f1-bf89-482c-96cd-dbd50ea26125","Type":"ContainerStarted","Data":"bd7efbf301a92ef9e065ad8ea8929007c72abcc89f1bd29ad186caaae589d6c7"}
Jul 27 20:17:48.086188 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.086167    2580 generic.go:356] "Generic (PLEG): container finished" podID="204e7972-20a7-442a-a4c3-c29f8e78c3f7" containerID="f10bfca515f2ac631ee1066df9edbfaa90a6a8b9e1b0091d6d4ed30c4b60c23b" exitCode=0
Jul 27 20:17:48.086271 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.086236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78fk7" event={"ID":"204e7972-20a7-442a-a4c3-c29f8e78c3f7","Type":"ContainerDied","Data":"f10bfca515f2ac631ee1066df9edbfaa90a6a8b9e1b0091d6d4ed30c4b60c23b"}
Jul 27 20:17:48.118725 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.118682    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zllw5" podStartSLOduration=4.414872355 podStartE2EDuration="23.118668603s" totalImagesPullingTime="18.703796248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:48.098990978 +0000 UTC m=+23.755146344" watchObservedRunningTime="2026-07-27 20:17:48.118668603 +0000 UTC m=+23.774824019"
Jul 27 20:17:48.161189 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.161167    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zllw5"
Jul 27 20:17:48.161736 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.161717    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zllw5"
Jul 27 20:17:48.277165 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.277132    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 20:17:48.823796 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.823688    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T20:17:48.27715851Z","UUID":"9164e2c2-1985-425c-8800-3d5e2c6a1282","Handler":null,"Name":"","Endpoint":""}
Jul 27 20:17:48.825477 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.825451    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 20:17:48.825619 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:48.825498    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 20:17:49.090870 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:49.090780    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft" event={"ID":"12ae015f-e09d-4457-ad64-b06b68251d3b","Type":"ContainerStarted","Data":"8c551b5d6a1076228cbeb0164fa80b238cd07ec0b0dd72cebcd8cab0c8b16e21"}
Jul 27 20:17:49.092406 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:49.092376    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cgtkq" event={"ID":"90b3dc0b-c10d-4ade-9e52-9a57ea56b6ca","Type":"ContainerStarted","Data":"edcf0278057bff9311268fd40389dfadf0c273f63caaefde49e32a2b3676ba58"}
Jul 27 20:17:49.092825 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:49.092608    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zllw5"
Jul 27 20:17:49.093282 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:49.093267    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zllw5"
Jul 27 20:17:49.107257 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:49.107216    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cgtkq" podStartSLOduration=5.4000092760000005 podStartE2EDuration="24.107200279s" totalImagesPullingTime="18.707191003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:49.106894461 +0000 UTC m=+24.763049804" watchObservedRunningTime="2026-07-27 20:17:49.107200279 +0000 UTC m=+24.763355621"
Jul 27 20:17:49.896525 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:49.896501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:49.896673 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:49.896501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:49.896673 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:49.896615    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:49.896787 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:49.896719    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:49.896787 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:49.896501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:49.896898 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:49.896859    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:50.099099 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:50.099006    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c" event={"ID":"bcf5f54d-e823-465f-a27d-155cbecd8d00","Type":"ContainerStarted","Data":"01fc0690e1b131930696ade3462f722d490b2992e3cc54c55756e7c4601724c4"}
Jul 27 20:17:50.101326 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:50.101283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft" event={"ID":"12ae015f-e09d-4457-ad64-b06b68251d3b","Type":"ContainerStarted","Data":"de610564a85c74f5bcc3c8d0f3ca328e55af10cd95aff9c1fdaeead1119b482a"}
Jul 27 20:17:50.120174 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:50.120125    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2shft" podStartSLOduration=2.9744490199999998 podStartE2EDuration="25.120108803s" totalImagesPullingTime="22.145659783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:50.119275186 +0000 UTC m=+25.775430528" watchObservedRunningTime="2026-07-27 20:17:50.120108803 +0000 UTC m=+25.776264145"
Jul 27 20:17:51.896137 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:51.895922    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:51.896596 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:51.895920    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:51.896596 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:51.896232    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:51.896596 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:51.895922    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:51.896596 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:51.896303    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:51.896596 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:51.896382    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:53.109989 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:53.109959    2580 generic.go:356] "Generic (PLEG): container finished" podID="204e7972-20a7-442a-a4c3-c29f8e78c3f7" containerID="e708a3e632cf9467fd4fa17473e1508d558097f7c1555f50a9a8cb2988f961b5" exitCode=0
Jul 27 20:17:53.110816 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:53.110037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78fk7" event={"ID":"204e7972-20a7-442a-a4c3-c29f8e78c3f7","Type":"ContainerDied","Data":"e708a3e632cf9467fd4fa17473e1508d558097f7c1555f50a9a8cb2988f961b5"}
Jul 27 20:17:53.113682 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:53.113660    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c" event={"ID":"bcf5f54d-e823-465f-a27d-155cbecd8d00","Type":"ContainerStarted","Data":"80a5af756ada739782a8b5bc160d995d4e29f07605b15e649d33da5fe3695261"}
Jul 27 20:17:53.113984 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:53.113962    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:53.114056 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:53.114036    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:53.129507 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:53.129482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:53.156073 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:53.156027    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c" podStartSLOduration=8.298500663 podStartE2EDuration="28.15601146s" totalImagesPullingTime="19.857510797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:17:53.155491216 +0000 UTC m=+28.811646558" watchObservedRunningTime="2026-07-27 20:17:53.15601146 +0000 UTC m=+28.812166803"
Jul 27 20:17:53.896272 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:53.896020    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:53.896582 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:53.896379    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:53.896582 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:53.896061    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:53.896582 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:53.896062    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:53.896582 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:53.896530    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:53.896840 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:53.896651    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:54.115892 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:54.115856    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:54.131495 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:54.131472    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:17:54.537453 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:54.537415    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k7v72"]
Jul 27 20:17:54.537638 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:54.537546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:54.537719 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:54.537649    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:54.540009 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:54.539984    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xbhcs"]
Jul 27 20:17:54.540130 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:54.540073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:54.540202 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:54.540155    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:54.548475 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:54.548453    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6txrr"]
Jul 27 20:17:54.548586 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:54.548530    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:54.548659 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:54.548600    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:55.119249 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:55.119213    2580 generic.go:356] "Generic (PLEG): container finished" podID="204e7972-20a7-442a-a4c3-c29f8e78c3f7" containerID="c4bebc86e07147661f40c3865ca4ef7be5b58861bef4b85f70420858c62eb191" exitCode=0
Jul 27 20:17:55.119687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:55.119289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78fk7" event={"ID":"204e7972-20a7-442a-a4c3-c29f8e78c3f7","Type":"ContainerDied","Data":"c4bebc86e07147661f40c3865ca4ef7be5b58861bef4b85f70420858c62eb191"}
Jul 27 20:17:55.896161 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:55.896124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:55.896161 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:55.896160    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:55.896382 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:55.896128    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:55.896382 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:55.896260    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:55.896482 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:55.896380    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:55.896482 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:55.896468    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:57.126611 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:57.126579    2580 generic.go:356] "Generic (PLEG): container finished" podID="204e7972-20a7-442a-a4c3-c29f8e78c3f7" containerID="94035d396be8764be923115bd42fb30d31c34b7a4cd03ce78eadcc10d0369e93" exitCode=0
Jul 27 20:17:57.127139 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:57.126631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78fk7" event={"ID":"204e7972-20a7-442a-a4c3-c29f8e78c3f7","Type":"ContainerDied","Data":"94035d396be8764be923115bd42fb30d31c34b7a4cd03ce78eadcc10d0369e93"}
Jul 27 20:17:57.896606 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:57.896568    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:57.896606 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:57.896592    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:57.896873 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:57.896573    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:57.896873 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:57.896696    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:57.896873 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:57.896819    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:57.897014 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:57.896906    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:17:58.508585 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:58.508548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:58.509159 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:58.509136    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:58.509235 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:58.509208    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs podName:9b574f99-44fb-4a34-b645-ef5aa1bbaf1e nodeName:}" failed. No retries permitted until 2026-07-27 20:18:30.509189261 +0000 UTC m=+66.165344582 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs") pod "network-metrics-daemon-xbhcs" (UID: "9b574f99-44fb-4a34-b645-ef5aa1bbaf1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:17:58.609507 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:58.609470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:58.609686 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:58.609624    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:58.609756 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:58.609700    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret podName:018163d0-e356-4286-b3e3-2b32e0afdf23 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:30.609669327 +0000 UTC m=+66.265824663 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret") pod "global-pull-secret-syncer-k7v72" (UID: "018163d0-e356-4286-b3e3-2b32e0afdf23") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:17:58.710195 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:58.710157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhg7d\" (UniqueName: \"kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d\") pod \"network-check-target-6txrr\" (UID: \"76cf7b6f-a97e-44af-ab23-f8d3ef30955a\") " pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:58.710365 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:58.710344    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:17:58.710416 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:58.710376    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:17:58.710416 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:58.710391    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xhg7d for pod openshift-network-diagnostics/network-check-target-6txrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:58.710477 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:58.710460    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d podName:76cf7b6f-a97e-44af-ab23-f8d3ef30955a nodeName:}" failed. No retries permitted until 2026-07-27 20:18:30.710440491 +0000 UTC m=+66.366595829 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xhg7d" (UniqueName: "kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d") pod "network-check-target-6txrr" (UID: "76cf7b6f-a97e-44af-ab23-f8d3ef30955a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:17:59.896200 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:59.895954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:17:59.896632 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:59.895984    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:17:59.896632 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:17:59.895984    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:17:59.896632 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:59.896328    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcs" podUID="9b574f99-44fb-4a34-b645-ef5aa1bbaf1e"
Jul 27 20:17:59.896632 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:59.896387    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7v72" podUID="018163d0-e356-4286-b3e3-2b32e0afdf23"
Jul 27 20:17:59.896632 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:17:59.896464    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6txrr" podUID="76cf7b6f-a97e-44af-ab23-f8d3ef30955a"
Jul 27 20:18:00.613283 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.613252    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-20.ec2.internal" event="NodeReady"
Jul 27 20:18:00.613478 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.613413    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 20:18:00.648635 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.648556    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"]
Jul 27 20:18:00.651440 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.651391    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"
Jul 27 20:18:00.653648 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.653619    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kdl8p"]
Jul 27 20:18:00.653814 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.653792    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 20:18:00.655057 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.655033    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 20:18:00.655267 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.655249    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 20:18:00.655360 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.655336    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:18:00.656155 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.655969    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9gw58\""
Jul 27 20:18:00.656155 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.656036    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"]
Jul 27 20:18:00.656330 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.656285    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.657834 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.657817    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dhvxz"]
Jul 27 20:18:00.658014 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.657994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:00.658962 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.658940    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 27 20:18:00.659061 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.658965    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 27 20:18:00.659061 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.658993    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 20:18:00.659061 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.659003    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 20:18:00.659196 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.658950    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-v6mr6\""
Jul 27 20:18:00.659642 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.659622    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"]
Jul 27 20:18:00.659875 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.659855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dhvxz"
Jul 27 20:18:00.661384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.661368    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"]
Jul 27 20:18:00.661507 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.661491    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"
Jul 27 20:18:00.663513 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.663494    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.664965 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.664817    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 20:18:00.666442 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.665719    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 27 20:18:00.666442 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.665787    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"]
Jul 27 20:18:00.666442 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.665869    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 20:18:00.666442 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.665900    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 20:18:00.666442 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.665961    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 27 20:18:00.666442 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.666167    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:18:00.666442 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.666295    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 20:18:00.666442 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.666392    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:18:00.666876 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.666823    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sclqk\""
Jul 27 20:18:00.667724 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.666955    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 20:18:00.668275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.668258    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-f6s97\""
Jul 27 20:18:00.668870 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.668851    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dt796\""
Jul 27 20:18:00.670788 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.670768    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 27 20:18:00.671395 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.671379    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 20:18:00.672235 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.672146    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 20:18:00.672480 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.672466    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s87ms\""
Jul 27 20:18:00.677265 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.677242    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-p68dz"]
Jul 27 20:18:00.677544 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.677513    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 20:18:00.679602 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.679585    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.682787 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.682741    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"]
Jul 27 20:18:00.684909 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.684877    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 27 20:18:00.685545 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.685527    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 20:18:00.685763 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.685719    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kdl8p"]
Jul 27 20:18:00.685857 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.685771    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:18:00.685857 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.685781    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 27 20:18:00.685857 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.685801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dhvxz"]
Jul 27 20:18:00.685857 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.685828    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54f5f9b87f-2bfnt"]
Jul 27 20:18:00.686147 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.686131    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:00.686550 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.686530    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 27 20:18:00.686806 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.686240    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vgg6x\""
Jul 27 20:18:00.687175 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.687143    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 27 20:18:00.689089 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.688832    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"]
Jul 27 20:18:00.689089 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.688871    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-p9r6x"]
Jul 27 20:18:00.689295 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.689276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.693292 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.693274    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"]
Jul 27 20:18:00.693418 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.693309    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9r6x"
Jul 27 20:18:00.694030 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.694013    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.695190    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"]
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.695225    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8xg2p"]
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.695234    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.695471    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hm58s\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.695640    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.695641    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.695723    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.695690    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.695941    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.696021    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.696057    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.696244    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-696lk\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.696463    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.696623    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.696843    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:18:00.697055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.696981    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:18:00.698868 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.698372    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-67qht"]
Jul 27 20:18:00.700517 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.699280    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8xg2p"
Jul 27 20:18:00.700517 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.700324    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 20:18:00.700517 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.700330    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fddhr\""
Jul 27 20:18:00.700517 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.700331    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 20:18:00.701498 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.701474    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"]
Jul 27 20:18:00.701577 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.701542    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"]
Jul 27 20:18:00.701577 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.701567    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"]
Jul 27 20:18:00.701684 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.701668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:00.703347 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.703327    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 20:18:00.705162 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.704434    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qtb5t\""
Jul 27 20:18:00.705162 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.704781    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 20:18:00.706155 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.706138    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 20:18:00.706466 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.706188    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jcfs7\""
Jul 27 20:18:00.707152 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.707133    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 20:18:00.707643 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.707623    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4zfst\""
Jul 27 20:18:00.707980 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.707963    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-p68dz"]
Jul 27 20:18:00.708841 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.708821    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 20:18:00.709647 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.709615    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8xg2p"]
Jul 27 20:18:00.711101 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.711079    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54f5f9b87f-2bfnt"]
Jul 27 20:18:00.712206 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.712151    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-p9r6x"]
Jul 27 20:18:00.717888 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.717864    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-67qht"]
Jul 27 20:18:00.724016 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.723976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3317a2a-a923-430a-80ac-56bc1016877f-serving-cert\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.724125 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.724027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e3317a2a-a923-430a-80ac-56bc1016877f-snapshots\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.724210 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.724190    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3317a2a-a923-430a-80ac-56bc1016877f-service-ca-bundle\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.724272 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.724226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzp7l\" (UniqueName: \"kubernetes.io/projected/e3317a2a-a923-430a-80ac-56bc1016877f-kube-api-access-kzp7l\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.724328 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.724275    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3317a2a-a923-430a-80ac-56bc1016877f-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.724328 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.724313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjxdx\" (UniqueName: \"kubernetes.io/projected/80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf-kube-api-access-xjxdx\") pod \"service-ca-operator-5d6c75f84f-8xhzg\" (UID: \"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"
Jul 27 20:18:00.724413 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.724385    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3317a2a-a923-430a-80ac-56bc1016877f-tmp\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.724448 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.724415    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf-config\") pod \"service-ca-operator-5d6c75f84f-8xhzg\" (UID: \"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"
Jul 27 20:18:00.724494 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.724462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf-serving-cert\") pod \"service-ca-operator-5d6c75f84f-8xhzg\" (UID: \"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"
Jul 27 20:18:00.825672 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.825635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3317a2a-a923-430a-80ac-56bc1016877f-serving-cert\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.825873 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.825688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj75r\" (UniqueName: \"kubernetes.io/projected/f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a-kube-api-access-pj75r\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb\" (UID: \"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"
Jul 27 20:18:00.825873 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.825771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9e44713-0b92-44af-bc65-2c56777d862f-ca-trust-extracted\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.825873 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.825808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9e44713-0b92-44af-bc65-2c56777d862f-trusted-ca\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.825873 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.825854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5mr7n\" (UID: \"9ccce07a-eca0-402a-b714-6d09fdf8ecd1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:00.825873 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.825871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:00.826070 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.825887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.826070 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.825904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37f6140b-7997-493a-ade8-5d64dd0b4870-config-volume\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:00.826070 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.825941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9e44713-0b92-44af-bc65-2c56777d862f-installation-pull-secrets\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.826070 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.825975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-h25jw\" (UID: \"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:00.826070 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.826057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3317a2a-a923-430a-80ac-56bc1016877f-service-ca-bundle\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.826227 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.826090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9e44713-0b92-44af-bc65-2c56777d862f-registry-certificates\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.826227 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.826108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqssf\" (UniqueName: \"kubernetes.io/projected/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-kube-api-access-kqssf\") pod \"cluster-samples-operator-6748489656-5mr7n\" (UID: \"9ccce07a-eca0-402a-b714-6d09fdf8ecd1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:00.826445 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.826417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3317a2a-a923-430a-80ac-56bc1016877f-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.826531 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.826495    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9e44713-0b92-44af-bc65-2c56777d862f-image-registry-private-configuration\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.826690 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.826665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3317a2a-a923-430a-80ac-56bc1016877f-service-ca-bundle\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.826815 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.826788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3317a2a-a923-430a-80ac-56bc1016877f-tmp\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.826889 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.826850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.826941 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.826889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf-serving-cert\") pod \"service-ca-operator-5d6c75f84f-8xhzg\" (UID: \"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"
Jul 27 20:18:00.826941 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.826917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:00.827037 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.826949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb\" (UID: \"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"
Jul 27 20:18:00.827037 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.826977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3736de45-8222-42d0-871a-5304b17df9da-config\") pod \"console-operator-584dcb6b54-p68dz\" (UID: \"3736de45-8222-42d0-871a-5304b17df9da\") " pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.827037 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827003    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-h25jw\" (UID: \"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:00.827182 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl7qf\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-kube-api-access-cl7qf\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.827182 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e3317a2a-a923-430a-80ac-56bc1016877f-snapshots\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.827182 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b-cert\") pod \"ingress-canary-8xg2p\" (UID: \"3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b\") " pod="openshift-ingress-canary/ingress-canary-8xg2p"
Jul 27 20:18:00.827182 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827106    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3317a2a-a923-430a-80ac-56bc1016877f-tmp\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.827182 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.827418 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb\" (UID: \"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"
Jul 27 20:18:00.827418 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxdw8\" (UniqueName: \"kubernetes.io/projected/3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b-kube-api-access-mxdw8\") pod \"ingress-canary-8xg2p\" (UID: \"3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b\") " pod="openshift-ingress-canary/ingress-canary-8xg2p"
Jul 27 20:18:00.827418 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3317a2a-a923-430a-80ac-56bc1016877f-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.827418 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx8gh\" (UniqueName: \"kubernetes.io/projected/0013340e-a437-449d-9668-5bfcd6ebd16c-kube-api-access-bx8gh\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.827418 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:00.827418 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzp7l\" (UniqueName: \"kubernetes.io/projected/e3317a2a-a923-430a-80ac-56bc1016877f-kube-api-access-kzp7l\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.827668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjxdx\" (UniqueName: \"kubernetes.io/projected/80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf-kube-api-access-xjxdx\") pod \"service-ca-operator-5d6c75f84f-8xhzg\" (UID: \"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"
Jul 27 20:18:00.827668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-bound-sa-token\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.827668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf-config\") pod \"service-ca-operator-5d6c75f84f-8xhzg\" (UID: \"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"
Jul 27 20:18:00.827668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827504    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3736de45-8222-42d0-871a-5304b17df9da-trusted-ca\") pod \"console-operator-584dcb6b54-p68dz\" (UID: \"3736de45-8222-42d0-871a-5304b17df9da\") " pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.827668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj9kk\" (UniqueName: \"kubernetes.io/projected/3736de45-8222-42d0-871a-5304b17df9da-kube-api-access-bj9kk\") pod \"console-operator-584dcb6b54-p68dz\" (UID: \"3736de45-8222-42d0-871a-5304b17df9da\") " pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.827668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdpfs\" (UniqueName: \"kubernetes.io/projected/0a376026-d99e-4061-9f1b-0d4a8955f2ac-kube-api-access-xdpfs\") pod \"network-check-source-7d88cb55d8-p9r6x\" (UID: \"0a376026-d99e-4061-9f1b-0d4a8955f2ac\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9r6x"
Jul 27 20:18:00.827668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-stats-auth\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.827668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkmvr\" (UniqueName: \"kubernetes.io/projected/37f6140b-7997-493a-ade8-5d64dd0b4870-kube-api-access-hkmvr\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:00.827668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e3317a2a-a923-430a-80ac-56bc1016877f-snapshots\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.827668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzv98\" (UniqueName: \"kubernetes.io/projected/3c13e5da-d871-4afa-ae81-bbcb923fd200-kube-api-access-kzv98\") pod \"volume-data-source-validator-549c6d54cf-dhvxz\" (UID: \"3c13e5da-d871-4afa-ae81-bbcb923fd200\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dhvxz"
Jul 27 20:18:00.828138 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdf4s\" (UniqueName: \"kubernetes.io/projected/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-kube-api-access-wdf4s\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:00.828138 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-default-certificate\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.828138 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37f6140b-7997-493a-ade8-5d64dd0b4870-tmp-dir\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:00.828138 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.827840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3736de45-8222-42d0-871a-5304b17df9da-serving-cert\") pod \"console-operator-584dcb6b54-p68dz\" (UID: \"3736de45-8222-42d0-871a-5304b17df9da\") " pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.828138 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.828110    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf-config\") pod \"service-ca-operator-5d6c75f84f-8xhzg\" (UID: \"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"
Jul 27 20:18:00.831094 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.831073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf-serving-cert\") pod \"service-ca-operator-5d6c75f84f-8xhzg\" (UID: \"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"
Jul 27 20:18:00.831215 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.831147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3317a2a-a923-430a-80ac-56bc1016877f-serving-cert\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.841209 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.841189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjxdx\" (UniqueName: \"kubernetes.io/projected/80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf-kube-api-access-xjxdx\") pod \"service-ca-operator-5d6c75f84f-8xhzg\" (UID: \"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"
Jul 27 20:18:00.841398 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.841381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzp7l\" (UniqueName: \"kubernetes.io/projected/e3317a2a-a923-430a-80ac-56bc1016877f-kube-api-access-kzp7l\") pod \"insights-operator-5885fdb759-kdl8p\" (UID: \"e3317a2a-a923-430a-80ac-56bc1016877f\") " pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:00.928769 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.928674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b-cert\") pod \"ingress-canary-8xg2p\" (UID: \"3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b\") " pod="openshift-ingress-canary/ingress-canary-8xg2p"
Jul 27 20:18:00.928769 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.928720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.928769 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.928764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb\" (UID: \"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.928860    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.928879    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c8b6cc6c-4k8fm: secret "image-registry-tls" not found
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.928875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxdw8\" (UniqueName: \"kubernetes.io/projected/3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b-kube-api-access-mxdw8\") pod \"ingress-canary-8xg2p\" (UID: \"3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b\") " pod="openshift-ingress-canary/ingress-canary-8xg2p"
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.928942    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls podName:e9e44713-0b92-44af-bc65-2c56777d862f nodeName:}" failed. No retries permitted until 2026-07-27 20:18:01.42892162 +0000 UTC m=+37.085076960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls") pod "image-registry-54c8b6cc6c-4k8fm" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f") : secret "image-registry-tls" not found
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.928968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx8gh\" (UniqueName: \"kubernetes.io/projected/0013340e-a437-449d-9668-5bfcd6ebd16c-kube-api-access-bx8gh\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.928989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929023    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-bound-sa-token\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3736de45-8222-42d0-871a-5304b17df9da-trusted-ca\") pod \"console-operator-584dcb6b54-p68dz\" (UID: \"3736de45-8222-42d0-871a-5304b17df9da\") " pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj9kk\" (UniqueName: \"kubernetes.io/projected/3736de45-8222-42d0-871a-5304b17df9da-kube-api-access-bj9kk\") pod \"console-operator-584dcb6b54-p68dz\" (UID: \"3736de45-8222-42d0-871a-5304b17df9da\") " pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdpfs\" (UniqueName: \"kubernetes.io/projected/0a376026-d99e-4061-9f1b-0d4a8955f2ac-kube-api-access-xdpfs\") pod \"network-check-source-7d88cb55d8-p9r6x\" (UID: \"0a376026-d99e-4061-9f1b-0d4a8955f2ac\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9r6x"
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.929120    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.929186    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls podName:37f6140b-7997-493a-ade8-5d64dd0b4870 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:01.429169522 +0000 UTC m=+37.085324859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls") pod "dns-default-67qht" (UID: "37f6140b-7997-493a-ade8-5d64dd0b4870") : secret "dns-default-metrics-tls" not found
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-stats-auth\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkmvr\" (UniqueName: \"kubernetes.io/projected/37f6140b-7997-493a-ade8-5d64dd0b4870-kube-api-access-hkmvr\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929311    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzv98\" (UniqueName: \"kubernetes.io/projected/3c13e5da-d871-4afa-ae81-bbcb923fd200-kube-api-access-kzv98\") pod \"volume-data-source-validator-549c6d54cf-dhvxz\" (UID: \"3c13e5da-d871-4afa-ae81-bbcb923fd200\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dhvxz"
Jul 27 20:18:00.929468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdf4s\" (UniqueName: \"kubernetes.io/projected/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-kube-api-access-wdf4s\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-default-certificate\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37f6140b-7997-493a-ade8-5d64dd0b4870-tmp-dir\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3736de45-8222-42d0-871a-5304b17df9da-serving-cert\") pod \"console-operator-584dcb6b54-p68dz\" (UID: \"3736de45-8222-42d0-871a-5304b17df9da\") " pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj75r\" (UniqueName: \"kubernetes.io/projected/f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a-kube-api-access-pj75r\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb\" (UID: \"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9e44713-0b92-44af-bc65-2c56777d862f-ca-trust-extracted\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9e44713-0b92-44af-bc65-2c56777d862f-trusted-ca\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5mr7n\" (UID: \"9ccce07a-eca0-402a-b714-6d09fdf8ecd1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37f6140b-7997-493a-ade8-5d64dd0b4870-config-volume\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929648    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9e44713-0b92-44af-bc65-2c56777d862f-installation-pull-secrets\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-h25jw\" (UID: \"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9e44713-0b92-44af-bc65-2c56777d862f-registry-certificates\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqssf\" (UniqueName: \"kubernetes.io/projected/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-kube-api-access-kqssf\") pod \"cluster-samples-operator-6748489656-5mr7n\" (UID: \"9ccce07a-eca0-402a-b714-6d09fdf8ecd1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9e44713-0b92-44af-bc65-2c56777d862f-image-registry-private-configuration\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.930262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb\" (UID: \"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3736de45-8222-42d0-871a-5304b17df9da-config\") pod \"console-operator-584dcb6b54-p68dz\" (UID: \"3736de45-8222-42d0-871a-5304b17df9da\") " pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-h25jw\" (UID: \"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.929991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl7qf\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-kube-api-access-cl7qf\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.930051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37f6140b-7997-493a-ade8-5d64dd0b4870-tmp-dir\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.930127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3736de45-8222-42d0-871a-5304b17df9da-trusted-ca\") pod \"console-operator-584dcb6b54-p68dz\" (UID: \"3736de45-8222-42d0-871a-5304b17df9da\") " pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.930356    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle podName:0013340e-a437-449d-9668-5bfcd6ebd16c nodeName:}" failed. No retries permitted until 2026-07-27 20:18:01.430339993 +0000 UTC m=+37.086495332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle") pod "router-default-54f5f9b87f-2bfnt" (UID: "0013340e-a437-449d-9668-5bfcd6ebd16c") : configmap references non-existent config key: service-ca.crt
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.930406    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37f6140b-7997-493a-ade8-5d64dd0b4870-config-volume\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.930429    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.930469    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls podName:c5b42704-6ac3-4fe3-a7d9-6e327f59bccd nodeName:}" failed. No retries permitted until 2026-07-27 20:18:01.430456889 +0000 UTC m=+37.086612211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-t44h7" (UID: "c5b42704-6ac3-4fe3-a7d9-6e327f59bccd") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.930548    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.930607    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs podName:0013340e-a437-449d-9668-5bfcd6ebd16c nodeName:}" failed. No retries permitted until 2026-07-27 20:18:01.430591585 +0000 UTC m=+37.086746923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs") pod "router-default-54f5f9b87f-2bfnt" (UID: "0013340e-a437-449d-9668-5bfcd6ebd16c") : secret "router-metrics-certs-default" not found
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.930681    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:18:00.931037 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.930768    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls podName:9ccce07a-eca0-402a-b714-6d09fdf8ecd1 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:01.430707614 +0000 UTC m=+37.086862937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls") pod "cluster-samples-operator-6748489656-5mr7n" (UID: "9ccce07a-eca0-402a-b714-6d09fdf8ecd1") : secret "samples-operator-tls" not found
Jul 27 20:18:00.931792 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.930906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:00.931792 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.930977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb\" (UID: \"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"
Jul 27 20:18:00.931792 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.931023    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9e44713-0b92-44af-bc65-2c56777d862f-trusted-ca\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.931792 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.931482    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9e44713-0b92-44af-bc65-2c56777d862f-registry-certificates\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.931792 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.931556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3736de45-8222-42d0-871a-5304b17df9da-config\") pod \"console-operator-584dcb6b54-p68dz\" (UID: \"3736de45-8222-42d0-871a-5304b17df9da\") " pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.931792 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.931774    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:18:00.932074 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:00.931819    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert podName:b15e2e83-21fe-4673-b2ca-46c2ce42a4f3 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:01.431804881 +0000 UTC m=+37.087960204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-h25jw" (UID: "b15e2e83-21fe-4673-b2ca-46c2ce42a4f3") : secret "networking-console-plugin-cert" not found
Jul 27 20:18:00.932189 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.932155    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9e44713-0b92-44af-bc65-2c56777d862f-ca-trust-extracted\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.932264 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.932208    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb\" (UID: \"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"
Jul 27 20:18:00.932264 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.932224    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-h25jw\" (UID: \"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:00.932522 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.932473    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3736de45-8222-42d0-871a-5304b17df9da-serving-cert\") pod \"console-operator-584dcb6b54-p68dz\" (UID: \"3736de45-8222-42d0-871a-5304b17df9da\") " pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.932666 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.932644    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-stats-auth\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.933596 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.933561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b-cert\") pod \"ingress-canary-8xg2p\" (UID: \"3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b\") " pod="openshift-ingress-canary/ingress-canary-8xg2p"
Jul 27 20:18:00.934217 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.934194    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9e44713-0b92-44af-bc65-2c56777d862f-installation-pull-secrets\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.934323 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.934283    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-default-certificate\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.934384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.934332    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9e44713-0b92-44af-bc65-2c56777d862f-image-registry-private-configuration\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.953222 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.953189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj9kk\" (UniqueName: \"kubernetes.io/projected/3736de45-8222-42d0-871a-5304b17df9da-kube-api-access-bj9kk\") pod \"console-operator-584dcb6b54-p68dz\" (UID: \"3736de45-8222-42d0-871a-5304b17df9da\") " pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:00.953379 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.953231    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdf4s\" (UniqueName: \"kubernetes.io/projected/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-kube-api-access-wdf4s\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:00.953514 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.953455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzv98\" (UniqueName: \"kubernetes.io/projected/3c13e5da-d871-4afa-ae81-bbcb923fd200-kube-api-access-kzv98\") pod \"volume-data-source-validator-549c6d54cf-dhvxz\" (UID: \"3c13e5da-d871-4afa-ae81-bbcb923fd200\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dhvxz"
Jul 27 20:18:00.955500 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.955471    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdpfs\" (UniqueName: \"kubernetes.io/projected/0a376026-d99e-4061-9f1b-0d4a8955f2ac-kube-api-access-xdpfs\") pod \"network-check-source-7d88cb55d8-p9r6x\" (UID: \"0a376026-d99e-4061-9f1b-0d4a8955f2ac\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9r6x"
Jul 27 20:18:00.956442 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.956421    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl7qf\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-kube-api-access-cl7qf\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.956670 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.956641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkmvr\" (UniqueName: \"kubernetes.io/projected/37f6140b-7997-493a-ade8-5d64dd0b4870-kube-api-access-hkmvr\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:00.956864 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.956847    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-bound-sa-token\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:00.957114 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.957091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj75r\" (UniqueName: \"kubernetes.io/projected/f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a-kube-api-access-pj75r\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb\" (UID: \"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"
Jul 27 20:18:00.957857 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.957815    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx8gh\" (UniqueName: \"kubernetes.io/projected/0013340e-a437-449d-9668-5bfcd6ebd16c-kube-api-access-bx8gh\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:00.957857 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.957834    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqssf\" (UniqueName: \"kubernetes.io/projected/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-kube-api-access-kqssf\") pod \"cluster-samples-operator-6748489656-5mr7n\" (UID: \"9ccce07a-eca0-402a-b714-6d09fdf8ecd1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:00.960134 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.960104    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxdw8\" (UniqueName: \"kubernetes.io/projected/3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b-kube-api-access-mxdw8\") pod \"ingress-canary-8xg2p\" (UID: \"3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b\") " pod="openshift-ingress-canary/ingress-canary-8xg2p"
Jul 27 20:18:00.969220 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.969194    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"
Jul 27 20:18:00.988382 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:00.988349    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-kdl8p"
Jul 27 20:18:01.007456 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.007430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dhvxz"
Jul 27 20:18:01.015310 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.015285    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"
Jul 27 20:18:01.030649 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.030621    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:01.053809 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.053779    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9r6x"
Jul 27 20:18:01.067040 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.067004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8xg2p"
Jul 27 20:18:01.434612 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.434577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:01.434813 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.434633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:01.434813 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.434706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:01.434813 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.434742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:01.434994 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.434858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5mr7n\" (UID: \"9ccce07a-eca0-402a-b714-6d09fdf8ecd1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:01.434994 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.434887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:01.434994 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.434917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-h25jw\" (UID: \"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:01.435126 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.435068    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:18:01.435179 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.435132    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert podName:b15e2e83-21fe-4673-b2ca-46c2ce42a4f3 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:02.435113942 +0000 UTC m=+38.091269284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-h25jw" (UID: "b15e2e83-21fe-4673-b2ca-46c2ce42a4f3") : secret "networking-console-plugin-cert" not found
Jul 27 20:18:01.436132 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.435679    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle podName:0013340e-a437-449d-9668-5bfcd6ebd16c nodeName:}" failed. No retries permitted until 2026-07-27 20:18:02.435660505 +0000 UTC m=+38.091815828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle") pod "router-default-54f5f9b87f-2bfnt" (UID: "0013340e-a437-449d-9668-5bfcd6ebd16c") : configmap references non-existent config key: service-ca.crt
Jul 27 20:18:01.436132 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.435921    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:18:01.436132 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.435936    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c8b6cc6c-4k8fm: secret "image-registry-tls" not found
Jul 27 20:18:01.436132 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.435979    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls podName:e9e44713-0b92-44af-bc65-2c56777d862f nodeName:}" failed. No retries permitted until 2026-07-27 20:18:02.435965325 +0000 UTC m=+38.092120651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls") pod "image-registry-54c8b6cc6c-4k8fm" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f") : secret "image-registry-tls" not found
Jul 27 20:18:01.436132 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.436005    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:18:01.436132 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.436027    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:18:01.436132 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.435859    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:18:01.436132 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.436058    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls podName:9ccce07a-eca0-402a-b714-6d09fdf8ecd1 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:02.436041315 +0000 UTC m=+38.092196638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls") pod "cluster-samples-operator-6748489656-5mr7n" (UID: "9ccce07a-eca0-402a-b714-6d09fdf8ecd1") : secret "samples-operator-tls" not found
Jul 27 20:18:01.436132 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.436076    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs podName:0013340e-a437-449d-9668-5bfcd6ebd16c nodeName:}" failed. No retries permitted until 2026-07-27 20:18:02.436066715 +0000 UTC m=+38.092222043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs") pod "router-default-54f5f9b87f-2bfnt" (UID: "0013340e-a437-449d-9668-5bfcd6ebd16c") : secret "router-metrics-certs-default" not found
Jul 27 20:18:01.436132 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.436091    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls podName:c5b42704-6ac3-4fe3-a7d9-6e327f59bccd nodeName:}" failed. No retries permitted until 2026-07-27 20:18:02.436083246 +0000 UTC m=+38.092238568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-t44h7" (UID: "c5b42704-6ac3-4fe3-a7d9-6e327f59bccd") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:18:01.436132 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.436123    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:18:01.436726 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:01.436154    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls podName:37f6140b-7997-493a-ade8-5d64dd0b4870 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:02.436142584 +0000 UTC m=+38.092297909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls") pod "dns-default-67qht" (UID: "37f6140b-7997-493a-ade8-5d64dd0b4870") : secret "dns-default-metrics-tls" not found
Jul 27 20:18:01.550577 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.550338    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-p9r6x"]
Jul 27 20:18:01.563370 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.563128    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb"]
Jul 27 20:18:01.575203 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.575111    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kdl8p"]
Jul 27 20:18:01.584931 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.584904    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg"]
Jul 27 20:18:01.588912 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.588737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8xg2p"]
Jul 27 20:18:01.590163 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.590140    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-p68dz"]
Jul 27 20:18:01.591016 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.590997    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dhvxz"]
Jul 27 20:18:01.592160 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:01.592134    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a376026_d99e_4061_9f1b_0d4a8955f2ac.slice/crio-cd70455bc360d4f8ad6ec7e535466669127ad2f6db4f08cc3e81d11ed078fa1f WatchSource:0}: Error finding container cd70455bc360d4f8ad6ec7e535466669127ad2f6db4f08cc3e81d11ed078fa1f: Status 404 returned error can't find the container with id cd70455bc360d4f8ad6ec7e535466669127ad2f6db4f08cc3e81d11ed078fa1f
Jul 27 20:18:01.593455 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:01.593429    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c13e5da_d871_4afa_ae81_bbcb923fd200.slice/crio-0cd7e363a5cc5e6100af2f896c27bfdd8e887ce60efee4d7d436c43e04b2a7f4 WatchSource:0}: Error finding container 0cd7e363a5cc5e6100af2f896c27bfdd8e887ce60efee4d7d436c43e04b2a7f4: Status 404 returned error can't find the container with id 0cd7e363a5cc5e6100af2f896c27bfdd8e887ce60efee4d7d436c43e04b2a7f4
Jul 27 20:18:01.594017 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:01.593994    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3317a2a_a923_430a_80ac_56bc1016877f.slice/crio-a79940ed315e55a9a9dad026b53fd319a8859bf8875b30b1c7d360edcea2a5af WatchSource:0}: Error finding container a79940ed315e55a9a9dad026b53fd319a8859bf8875b30b1c7d360edcea2a5af: Status 404 returned error can't find the container with id a79940ed315e55a9a9dad026b53fd319a8859bf8875b30b1c7d360edcea2a5af
Jul 27 20:18:01.595416 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:01.595395    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ad22b9_e5e2_4ec0_8333_9c277a96ae3a.slice/crio-b6362e78eaf95b9da815b007f7a6843a87abf023d076270d998d80f6659795be WatchSource:0}: Error finding container b6362e78eaf95b9da815b007f7a6843a87abf023d076270d998d80f6659795be: Status 404 returned error can't find the container with id b6362e78eaf95b9da815b007f7a6843a87abf023d076270d998d80f6659795be
Jul 27 20:18:01.598797 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:01.597620    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8bc154_34cd_4fd3_8f9b_b4c0b6a6e81b.slice/crio-c939cf0e1afc505e124abf60620562ad28381a20ae4f0f59e5843df2a553d915 WatchSource:0}: Error finding container c939cf0e1afc505e124abf60620562ad28381a20ae4f0f59e5843df2a553d915: Status 404 returned error can't find the container with id c939cf0e1afc505e124abf60620562ad28381a20ae4f0f59e5843df2a553d915
Jul 27 20:18:01.599503 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:01.599475    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80fb9cf5_fc2b_4d55_ba2f_9a2c97ac6bcf.slice/crio-b55d65611af48f9a4ad4df31115cb1bb15ff552ef8a5dd3acf1c4a07df348111 WatchSource:0}: Error finding container b55d65611af48f9a4ad4df31115cb1bb15ff552ef8a5dd3acf1c4a07df348111: Status 404 returned error can't find the container with id b55d65611af48f9a4ad4df31115cb1bb15ff552ef8a5dd3acf1c4a07df348111
Jul 27 20:18:01.601229 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:01.601091    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3736de45_8222_42d0_871a_5304b17df9da.slice/crio-18d67e3f9640ac867c37d4fb945437e403bad94d13a5a8e25013f9fe9054e1e6 WatchSource:0}: Error finding container 18d67e3f9640ac867c37d4fb945437e403bad94d13a5a8e25013f9fe9054e1e6: Status 404 returned error can't find the container with id 18d67e3f9640ac867c37d4fb945437e403bad94d13a5a8e25013f9fe9054e1e6
Jul 27 20:18:01.896359 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.896273    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:18:01.896520 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.896274    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:18:01.896520 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.896273    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:18:01.899145 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.899124    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:18:01.899145 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.899134    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xjfvv\""
Jul 27 20:18:01.899314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.899150    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8gvk7\""
Jul 27 20:18:01.899314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:01.899156    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:18:02.139384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.139342    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb" event={"ID":"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a","Type":"ContainerStarted","Data":"b6362e78eaf95b9da815b007f7a6843a87abf023d076270d998d80f6659795be"}
Jul 27 20:18:02.140616 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.140588    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9r6x" event={"ID":"0a376026-d99e-4061-9f1b-0d4a8955f2ac","Type":"ContainerStarted","Data":"cd70455bc360d4f8ad6ec7e535466669127ad2f6db4f08cc3e81d11ed078fa1f"}
Jul 27 20:18:02.141754 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.141715    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8xg2p" event={"ID":"3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b","Type":"ContainerStarted","Data":"c939cf0e1afc505e124abf60620562ad28381a20ae4f0f59e5843df2a553d915"}
Jul 27 20:18:02.142865 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.142815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz" event={"ID":"3736de45-8222-42d0-871a-5304b17df9da","Type":"ContainerStarted","Data":"18d67e3f9640ac867c37d4fb945437e403bad94d13a5a8e25013f9fe9054e1e6"}
Jul 27 20:18:02.143927 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.143904    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dhvxz" event={"ID":"3c13e5da-d871-4afa-ae81-bbcb923fd200","Type":"ContainerStarted","Data":"0cd7e363a5cc5e6100af2f896c27bfdd8e887ce60efee4d7d436c43e04b2a7f4"}
Jul 27 20:18:02.145103 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.145058    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg" event={"ID":"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf","Type":"ContainerStarted","Data":"b55d65611af48f9a4ad4df31115cb1bb15ff552ef8a5dd3acf1c4a07df348111"}
Jul 27 20:18:02.146326 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.146301    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kdl8p" event={"ID":"e3317a2a-a923-430a-80ac-56bc1016877f","Type":"ContainerStarted","Data":"a79940ed315e55a9a9dad026b53fd319a8859bf8875b30b1c7d360edcea2a5af"}
Jul 27 20:18:02.149590 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.149503    2580 generic.go:356] "Generic (PLEG): container finished" podID="204e7972-20a7-442a-a4c3-c29f8e78c3f7" containerID="330ed1beecb29f99c61cedd25d5ddb6361220124c2be7568be5083218ad4d482" exitCode=0
Jul 27 20:18:02.149590 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.149571    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78fk7" event={"ID":"204e7972-20a7-442a-a4c3-c29f8e78c3f7","Type":"ContainerDied","Data":"330ed1beecb29f99c61cedd25d5ddb6361220124c2be7568be5083218ad4d482"}
Jul 27 20:18:02.442613 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.442513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5mr7n\" (UID: \"9ccce07a-eca0-402a-b714-6d09fdf8ecd1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:02.442613 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.442579    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:02.442613 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.442610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-h25jw\" (UID: \"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:02.442949 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.442660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:02.442949 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.442707    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:18:02.442949 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.442805    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls podName:9ccce07a-eca0-402a-b714-6d09fdf8ecd1 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:04.442784556 +0000 UTC m=+40.098939880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls") pod "cluster-samples-operator-6748489656-5mr7n" (UID: "9ccce07a-eca0-402a-b714-6d09fdf8ecd1") : secret "samples-operator-tls" not found
Jul 27 20:18:02.442949 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.442837    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:18:02.442949 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.442889    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls podName:c5b42704-6ac3-4fe3-a7d9-6e327f59bccd nodeName:}" failed. No retries permitted until 2026-07-27 20:18:04.442873259 +0000 UTC m=+40.099028603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-t44h7" (UID: "c5b42704-6ac3-4fe3-a7d9-6e327f59bccd") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:18:02.442949 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.442949    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:18:02.443287 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.442981    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs podName:0013340e-a437-449d-9668-5bfcd6ebd16c nodeName:}" failed. No retries permitted until 2026-07-27 20:18:04.442970494 +0000 UTC m=+40.099125828 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs") pod "router-default-54f5f9b87f-2bfnt" (UID: "0013340e-a437-449d-9668-5bfcd6ebd16c") : secret "router-metrics-certs-default" not found
Jul 27 20:18:02.443287 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.443032    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:18:02.443287 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.443060    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert podName:b15e2e83-21fe-4673-b2ca-46c2ce42a4f3 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:04.443050697 +0000 UTC m=+40.099206060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-h25jw" (UID: "b15e2e83-21fe-4673-b2ca-46c2ce42a4f3") : secret "networking-console-plugin-cert" not found
Jul 27 20:18:02.443287 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.443121    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle podName:0013340e-a437-449d-9668-5bfcd6ebd16c nodeName:}" failed. No retries permitted until 2026-07-27 20:18:04.443111075 +0000 UTC m=+40.099266400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle") pod "router-default-54f5f9b87f-2bfnt" (UID: "0013340e-a437-449d-9668-5bfcd6ebd16c") : configmap references non-existent config key: service-ca.crt
Jul 27 20:18:02.443287 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.442713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:02.443287 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.443197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:02.443287 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:02.443252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:02.443625 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.443340    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:18:02.443625 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.443356    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:18:02.443625 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.443370    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls podName:37f6140b-7997-493a-ade8-5d64dd0b4870 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:04.443359635 +0000 UTC m=+40.099514970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls") pod "dns-default-67qht" (UID: "37f6140b-7997-493a-ade8-5d64dd0b4870") : secret "dns-default-metrics-tls" not found
Jul 27 20:18:02.443625 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.443372    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c8b6cc6c-4k8fm: secret "image-registry-tls" not found
Jul 27 20:18:02.443625 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:02.443416    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls podName:e9e44713-0b92-44af-bc65-2c56777d862f nodeName:}" failed. No retries permitted until 2026-07-27 20:18:04.443402176 +0000 UTC m=+40.099557515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls") pod "image-registry-54c8b6cc6c-4k8fm" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f") : secret "image-registry-tls" not found
Jul 27 20:18:03.163806 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:03.162727    2580 generic.go:356] "Generic (PLEG): container finished" podID="204e7972-20a7-442a-a4c3-c29f8e78c3f7" containerID="655ec82ff73a8c4954432a09a683fb64106bf937530e3a7f73c2ee43dc1630b9" exitCode=0
Jul 27 20:18:03.163806 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:03.162821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78fk7" event={"ID":"204e7972-20a7-442a-a4c3-c29f8e78c3f7","Type":"ContainerDied","Data":"655ec82ff73a8c4954432a09a683fb64106bf937530e3a7f73c2ee43dc1630b9"}
Jul 27 20:18:04.172001 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:04.171683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78fk7" event={"ID":"204e7972-20a7-442a-a4c3-c29f8e78c3f7","Type":"ContainerStarted","Data":"01b33059b2a804d498f3024d9238e5479359b362a5bfa779c0e9b4291c134946"}
Jul 27 20:18:04.174943 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:04.174454    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dhvxz" event={"ID":"3c13e5da-d871-4afa-ae81-bbcb923fd200","Type":"ContainerStarted","Data":"d328f4aacd312dd514ecc4007239c3461eadafbeffd7b2d1f79e8fbde787111a"}
Jul 27 20:18:04.200078 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:04.198809    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-78fk7" podStartSLOduration=9.962379279 podStartE2EDuration="39.198787452s" totalImagesPullingTime="29.236408173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:04.19734536 +0000 UTC m=+39.853500704" watchObservedRunningTime="2026-07-27 20:18:04.198787452 +0000 UTC m=+39.854942796"
Jul 27 20:18:04.215777 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:04.215707    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-dhvxz" podStartSLOduration=35.805223913 podStartE2EDuration="38.21569463s" totalImagesPullingTime="2.410470717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:04.214454454 +0000 UTC m=+39.870609799" watchObservedRunningTime="2026-07-27 20:18:04.21569463 +0000 UTC m=+39.871850025"
Jul 27 20:18:04.463241 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:04.463199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:04.463462 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:04.463309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5mr7n\" (UID: \"9ccce07a-eca0-402a-b714-6d09fdf8ecd1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:04.463462 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:04.463336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:04.463462 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:04.463361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-h25jw\" (UID: \"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:04.463462 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:04.463407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:04.463462 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:04.463428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:04.463471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.463618    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.463632    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c8b6cc6c-4k8fm: secret "image-registry-tls" not found
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.463692    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls podName:e9e44713-0b92-44af-bc65-2c56777d862f nodeName:}" failed. No retries permitted until 2026-07-27 20:18:08.463672815 +0000 UTC m=+44.119828139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls") pod "image-registry-54c8b6cc6c-4k8fm" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f") : secret "image-registry-tls" not found
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.463738    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.463820    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs podName:0013340e-a437-449d-9668-5bfcd6ebd16c nodeName:}" failed. No retries permitted until 2026-07-27 20:18:08.463800957 +0000 UTC m=+44.119956284 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs") pod "router-default-54f5f9b87f-2bfnt" (UID: "0013340e-a437-449d-9668-5bfcd6ebd16c") : secret "router-metrics-certs-default" not found
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.463887    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.463920    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls podName:37f6140b-7997-493a-ade8-5d64dd0b4870 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:08.463908704 +0000 UTC m=+44.120064029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls") pod "dns-default-67qht" (UID: "37f6140b-7997-493a-ade8-5d64dd0b4870") : secret "dns-default-metrics-tls" not found
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.463973    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.464004    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls podName:9ccce07a-eca0-402a-b714-6d09fdf8ecd1 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:08.463993374 +0000 UTC m=+44.120148701 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls") pod "cluster-samples-operator-6748489656-5mr7n" (UID: "9ccce07a-eca0-402a-b714-6d09fdf8ecd1") : secret "samples-operator-tls" not found
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.464086    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle podName:0013340e-a437-449d-9668-5bfcd6ebd16c nodeName:}" failed. No retries permitted until 2026-07-27 20:18:08.464070088 +0000 UTC m=+44.120225412 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle") pod "router-default-54f5f9b87f-2bfnt" (UID: "0013340e-a437-449d-9668-5bfcd6ebd16c") : configmap references non-existent config key: service-ca.crt
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.464096    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.464131    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls podName:c5b42704-6ac3-4fe3-a7d9-6e327f59bccd nodeName:}" failed. No retries permitted until 2026-07-27 20:18:08.46412076 +0000 UTC m=+44.120276081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-t44h7" (UID: "c5b42704-6ac3-4fe3-a7d9-6e327f59bccd") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.464150    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:18:04.464403 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:04.464183    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert podName:b15e2e83-21fe-4673-b2ca-46c2ce42a4f3 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:08.464172049 +0000 UTC m=+44.120327374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-h25jw" (UID: "b15e2e83-21fe-4673-b2ca-46c2ce42a4f3") : secret "networking-console-plugin-cert" not found
Jul 27 20:18:08.501196 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:08.501156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5mr7n\" (UID: \"9ccce07a-eca0-402a-b714-6d09fdf8ecd1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:08.501196 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:08.501197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:08.501218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-h25jw\" (UID: \"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:08.501251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:08.501273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:08.501307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501313    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:08.501328    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501330    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501313    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501391    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls podName:9ccce07a-eca0-402a-b714-6d09fdf8ecd1 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:16.501373081 +0000 UTC m=+52.157528404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls") pod "cluster-samples-operator-6748489656-5mr7n" (UID: "9ccce07a-eca0-402a-b714-6d09fdf8ecd1") : secret "samples-operator-tls" not found
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501409    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501424    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501431    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle podName:0013340e-a437-449d-9668-5bfcd6ebd16c nodeName:}" failed. No retries permitted until 2026-07-27 20:18:16.501420858 +0000 UTC m=+52.157576181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle") pod "router-default-54f5f9b87f-2bfnt" (UID: "0013340e-a437-449d-9668-5bfcd6ebd16c") : configmap references non-existent config key: service-ca.crt
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501447    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert podName:b15e2e83-21fe-4673-b2ca-46c2ce42a4f3 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:16.501439012 +0000 UTC m=+52.157594337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-h25jw" (UID: "b15e2e83-21fe-4673-b2ca-46c2ce42a4f3") : secret "networking-console-plugin-cert" not found
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501462    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls podName:c5b42704-6ac3-4fe3-a7d9-6e327f59bccd nodeName:}" failed. No retries permitted until 2026-07-27 20:18:16.501454447 +0000 UTC m=+52.157609769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-t44h7" (UID: "c5b42704-6ac3-4fe3-a7d9-6e327f59bccd") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501466    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:18:08.501809 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501476    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls podName:37f6140b-7997-493a-ade8-5d64dd0b4870 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:16.501468508 +0000 UTC m=+52.157623829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls") pod "dns-default-67qht" (UID: "37f6140b-7997-493a-ade8-5d64dd0b4870") : secret "dns-default-metrics-tls" not found
Jul 27 20:18:08.502296 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501483    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c8b6cc6c-4k8fm: secret "image-registry-tls" not found
Jul 27 20:18:08.502296 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501492    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs podName:0013340e-a437-449d-9668-5bfcd6ebd16c nodeName:}" failed. No retries permitted until 2026-07-27 20:18:16.501482614 +0000 UTC m=+52.157637942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs") pod "router-default-54f5f9b87f-2bfnt" (UID: "0013340e-a437-449d-9668-5bfcd6ebd16c") : secret "router-metrics-certs-default" not found
Jul 27 20:18:08.502296 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:08.501533    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls podName:e9e44713-0b92-44af-bc65-2c56777d862f nodeName:}" failed. No retries permitted until 2026-07-27 20:18:16.501524433 +0000 UTC m=+52.157679758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls") pod "image-registry-54c8b6cc6c-4k8fm" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f") : secret "image-registry-tls" not found
Jul 27 20:18:10.193838 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.193798    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb" event={"ID":"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a","Type":"ContainerStarted","Data":"626e856908c3216acc3d1977a6d2c437ef2b7ab24eadf067c8a4d4861ef47eff"}
Jul 27 20:18:10.195445 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.195409    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9r6x" event={"ID":"0a376026-d99e-4061-9f1b-0d4a8955f2ac","Type":"ContainerStarted","Data":"8a53a5abb983702d4466e00c5330a7bb89e2eac180cef51e56c818ab3064065f"}
Jul 27 20:18:10.197053 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.197016    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8xg2p" event={"ID":"3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b","Type":"ContainerStarted","Data":"a4eee7900211ce88dc7008adb2d7ea60437db5ccc2d0360b77b447c2eae33e40"}
Jul 27 20:18:10.199060 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.199038    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/0.log"
Jul 27 20:18:10.199167 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.199075    2580 generic.go:356] "Generic (PLEG): container finished" podID="3736de45-8222-42d0-871a-5304b17df9da" containerID="035b8d0aa36aca79dfbfb3959e115050adc4a15634d36fc08cc5c522d4f1fe0f" exitCode=255
Jul 27 20:18:10.199448 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.199285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz" event={"ID":"3736de45-8222-42d0-871a-5304b17df9da","Type":"ContainerDied","Data":"035b8d0aa36aca79dfbfb3959e115050adc4a15634d36fc08cc5c522d4f1fe0f"}
Jul 27 20:18:10.199448 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.199388    2580 scope.go:117] "RemoveContainer" containerID="035b8d0aa36aca79dfbfb3959e115050adc4a15634d36fc08cc5c522d4f1fe0f"
Jul 27 20:18:10.201096 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.201074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg" event={"ID":"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf","Type":"ContainerStarted","Data":"764a058b4c858525de49a9d65f89c9d8d05ad5935f0fe306a7936c9fbf6bb66c"}
Jul 27 20:18:10.202818 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.202772    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kdl8p" event={"ID":"e3317a2a-a923-430a-80ac-56bc1016877f","Type":"ContainerStarted","Data":"b55fb21ef46b2a4cc4f930f9530d7ebc74146cf97cdda17d1cbfdff978739bb0"}
Jul 27 20:18:10.212388 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.212333    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb" podStartSLOduration=36.269490049 podStartE2EDuration="44.212315501s" totalImagesPullingTime="7.942825452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:10.210487839 +0000 UTC m=+45.866643185" watchObservedRunningTime="2026-07-27 20:18:10.212315501 +0000 UTC m=+45.868470846"
Jul 27 20:18:10.232864 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.232619    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg" podStartSLOduration=36.296392652 podStartE2EDuration="44.232598939s" totalImagesPullingTime="7.936206287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:10.230690828 +0000 UTC m=+45.886846169" watchObservedRunningTime="2026-07-27 20:18:10.232598939 +0000 UTC m=+45.888754284"
Jul 27 20:18:10.248207 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.248154    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-kdl8p" podStartSLOduration=36.306860763 podStartE2EDuration="44.248136447s" totalImagesPullingTime="7.941275684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:10.246645132 +0000 UTC m=+45.902800475" watchObservedRunningTime="2026-07-27 20:18:10.248136447 +0000 UTC m=+45.904291790"
Jul 27 20:18:10.312470 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.312386    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9r6x" podStartSLOduration=36.368797473 podStartE2EDuration="44.312368675s" totalImagesPullingTime="7.943571202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:10.311723066 +0000 UTC m=+45.967878429" watchObservedRunningTime="2026-07-27 20:18:10.312368675 +0000 UTC m=+45.968524018"
Jul 27 20:18:10.330671 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.330586    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8xg2p" podStartSLOduration=2.394175758 podStartE2EDuration="10.330569393s" totalImagesPullingTime="7.936393635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:10.330079271 +0000 UTC m=+45.986234633" watchObservedRunningTime="2026-07-27 20:18:10.330569393 +0000 UTC m=+45.986724783"
Jul 27 20:18:10.755757 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.755692    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ppjj2"]
Jul 27 20:18:10.778999 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.778944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ppjj2"]
Jul 27 20:18:10.779169 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.779100    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:10.781578 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.781406    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 20:18:10.781719 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.781596    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kdwph\""
Jul 27 20:18:10.781719 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.781704    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 20:18:10.925451 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.925365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:10.925451 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.925410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/436b68b3-0ad6-4980-9d97-e02c99f8395d-data-volume\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:10.925677 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.925510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7q95\" (UniqueName: \"kubernetes.io/projected/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-api-access-r7q95\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:10.925677 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.925547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:10.925677 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:10.925622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/436b68b3-0ad6-4980-9d97-e02c99f8395d-crio-socket\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:11.026262 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.026219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/436b68b3-0ad6-4980-9d97-e02c99f8395d-data-volume\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:11.026463 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.026305    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7q95\" (UniqueName: \"kubernetes.io/projected/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-api-access-r7q95\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:11.026463 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.026333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:11.026463 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.026377    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/436b68b3-0ad6-4980-9d97-e02c99f8395d-crio-socket\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:11.026463 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.026444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:11.026463 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:11.026457    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:18:11.026721 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:11.026524    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm podName:436b68b3-0ad6-4980-9d97-e02c99f8395d nodeName:}" failed. No retries permitted until 2026-07-27 20:18:11.526504277 +0000 UTC m=+47.182659614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ppjj2" (UID: "436b68b3-0ad6-4980-9d97-e02c99f8395d") : configmap "kube-rbac-proxy" not found
Jul 27 20:18:11.026721 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:11.026570    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:18:11.026721 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:11.026607    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls podName:436b68b3-0ad6-4980-9d97-e02c99f8395d nodeName:}" failed. No retries permitted until 2026-07-27 20:18:11.526596293 +0000 UTC m=+47.182751628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ppjj2" (UID: "436b68b3-0ad6-4980-9d97-e02c99f8395d") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:18:11.026721 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.026600    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/436b68b3-0ad6-4980-9d97-e02c99f8395d-data-volume\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:11.026721 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.026654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/436b68b3-0ad6-4980-9d97-e02c99f8395d-crio-socket\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:11.031225 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.031204    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:11.031309 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.031254    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:11.037762 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.037718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7q95\" (UniqueName: \"kubernetes.io/projected/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-api-access-r7q95\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:11.211258 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.211178    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/1.log"
Jul 27 20:18:11.211626 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.211587    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/0.log"
Jul 27 20:18:11.211662 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.211623    2580 generic.go:356] "Generic (PLEG): container finished" podID="3736de45-8222-42d0-871a-5304b17df9da" containerID="e710014e4d44116bad71803e56df99124362d08af863dbf026ac85cbed004a0f" exitCode=255
Jul 27 20:18:11.211774 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.211723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz" event={"ID":"3736de45-8222-42d0-871a-5304b17df9da","Type":"ContainerDied","Data":"e710014e4d44116bad71803e56df99124362d08af863dbf026ac85cbed004a0f"}
Jul 27 20:18:11.211856 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.211840    2580 scope.go:117] "RemoveContainer" containerID="035b8d0aa36aca79dfbfb3959e115050adc4a15634d36fc08cc5c522d4f1fe0f"
Jul 27 20:18:11.211974 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.211956    2580 scope.go:117] "RemoveContainer" containerID="e710014e4d44116bad71803e56df99124362d08af863dbf026ac85cbed004a0f"
Jul 27 20:18:11.212176 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:11.212152    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-p68dz_openshift-console-operator(3736de45-8222-42d0-871a-5304b17df9da)\"" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz" podUID="3736de45-8222-42d0-871a-5304b17df9da"
Jul 27 20:18:11.530486 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.530392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:11.530635 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:11.530512    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:18:11.530635 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:11.530528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:11.530635 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:11.530585    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm podName:436b68b3-0ad6-4980-9d97-e02c99f8395d nodeName:}" failed. No retries permitted until 2026-07-27 20:18:12.530568769 +0000 UTC m=+48.186724090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ppjj2" (UID: "436b68b3-0ad6-4980-9d97-e02c99f8395d") : configmap "kube-rbac-proxy" not found
Jul 27 20:18:11.530775 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:11.530664    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:18:11.530775 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:11.530730    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls podName:436b68b3-0ad6-4980-9d97-e02c99f8395d nodeName:}" failed. No retries permitted until 2026-07-27 20:18:12.530714518 +0000 UTC m=+48.186869843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ppjj2" (UID: "436b68b3-0ad6-4980-9d97-e02c99f8395d") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:18:12.150578 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:12.150548    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xlqmn_75c6df92-2bce-4b1e-9e2d-e0ca0812f9de/dns-node-resolver/0.log"
Jul 27 20:18:12.216222 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:12.216197    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/1.log"
Jul 27 20:18:12.216615 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:12.216557    2580 scope.go:117] "RemoveContainer" containerID="e710014e4d44116bad71803e56df99124362d08af863dbf026ac85cbed004a0f"
Jul 27 20:18:12.216733 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:12.216714    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-p68dz_openshift-console-operator(3736de45-8222-42d0-871a-5304b17df9da)\"" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz" podUID="3736de45-8222-42d0-871a-5304b17df9da"
Jul 27 20:18:12.540222 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:12.540177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:12.540383 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:12.540300    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:18:12.540383 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:12.540327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:12.540383 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:12.540361    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm podName:436b68b3-0ad6-4980-9d97-e02c99f8395d nodeName:}" failed. No retries permitted until 2026-07-27 20:18:14.540346147 +0000 UTC m=+50.196501468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ppjj2" (UID: "436b68b3-0ad6-4980-9d97-e02c99f8395d") : configmap "kube-rbac-proxy" not found
Jul 27 20:18:12.540501 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:12.540434    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:18:12.540501 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:12.540489    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls podName:436b68b3-0ad6-4980-9d97-e02c99f8395d nodeName:}" failed. No retries permitted until 2026-07-27 20:18:14.540472128 +0000 UTC m=+50.196627450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ppjj2" (UID: "436b68b3-0ad6-4980-9d97-e02c99f8395d") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:18:13.151220 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:13.151195    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vx29c_f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6/node-ca/0.log"
Jul 27 20:18:13.552178 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:13.552152    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8xg2p_3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b/serve-healthcheck-canary/0.log"
Jul 27 20:18:14.559562 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:14.559520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:14.559972 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:14.559644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:14.559972 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:14.559648    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:18:14.559972 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:14.559786    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:18:14.559972 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:14.559829    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm podName:436b68b3-0ad6-4980-9d97-e02c99f8395d nodeName:}" failed. No retries permitted until 2026-07-27 20:18:18.559809378 +0000 UTC m=+54.215964722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ppjj2" (UID: "436b68b3-0ad6-4980-9d97-e02c99f8395d") : configmap "kube-rbac-proxy" not found
Jul 27 20:18:14.559972 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:14.559846    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls podName:436b68b3-0ad6-4980-9d97-e02c99f8395d nodeName:}" failed. No retries permitted until 2026-07-27 20:18:18.559840591 +0000 UTC m=+54.215995912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ppjj2" (UID: "436b68b3-0ad6-4980-9d97-e02c99f8395d") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:18:16.579617 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:16.579574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5mr7n\" (UID: \"9ccce07a-eca0-402a-b714-6d09fdf8ecd1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:16.579617 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:16.579629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.579721    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.579731    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:16.579770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-h25jw\" (UID: \"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.579791    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs podName:0013340e-a437-449d-9668-5bfcd6ebd16c nodeName:}" failed. No retries permitted until 2026-07-27 20:18:32.57977647 +0000 UTC m=+68.235931791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs") pod "router-default-54f5f9b87f-2bfnt" (UID: "0013340e-a437-449d-9668-5bfcd6ebd16c") : secret "router-metrics-certs-default" not found
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.579825    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls podName:9ccce07a-eca0-402a-b714-6d09fdf8ecd1 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:32.579818425 +0000 UTC m=+68.235973746 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls") pod "cluster-samples-operator-6748489656-5mr7n" (UID: "9ccce07a-eca0-402a-b714-6d09fdf8ecd1") : secret "samples-operator-tls" not found
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.579840    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:16.579871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.579893    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert podName:b15e2e83-21fe-4673-b2ca-46c2ce42a4f3 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:32.579877876 +0000 UTC m=+68.236033199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-h25jw" (UID: "b15e2e83-21fe-4673-b2ca-46c2ce42a4f3") : secret "networking-console-plugin-cert" not found
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:16.579927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.579941    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle podName:0013340e-a437-449d-9668-5bfcd6ebd16c nodeName:}" failed. No retries permitted until 2026-07-27 20:18:32.579932501 +0000 UTC m=+68.236087822 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle") pod "router-default-54f5f9b87f-2bfnt" (UID: "0013340e-a437-449d-9668-5bfcd6ebd16c") : configmap references non-existent config key: service-ca.crt
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.579965    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.579993    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls podName:c5b42704-6ac3-4fe3-a7d9-6e327f59bccd nodeName:}" failed. No retries permitted until 2026-07-27 20:18:32.579986363 +0000 UTC m=+68.236141684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-t44h7" (UID: "c5b42704-6ac3-4fe3-a7d9-6e327f59bccd") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:16.579994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:16.580021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:16.580094 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.580037    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:18:16.580582 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.580045    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c8b6cc6c-4k8fm: secret "image-registry-tls" not found
Jul 27 20:18:16.580582 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.580065    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls podName:e9e44713-0b92-44af-bc65-2c56777d862f nodeName:}" failed. No retries permitted until 2026-07-27 20:18:32.580058207 +0000 UTC m=+68.236213527 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls") pod "image-registry-54c8b6cc6c-4k8fm" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f") : secret "image-registry-tls" not found
Jul 27 20:18:16.580582 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.580098    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:18:16.580582 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:16.580125    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls podName:37f6140b-7997-493a-ade8-5d64dd0b4870 nodeName:}" failed. No retries permitted until 2026-07-27 20:18:32.580116837 +0000 UTC m=+68.236272159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls") pod "dns-default-67qht" (UID: "37f6140b-7997-493a-ade8-5d64dd0b4870") : secret "dns-default-metrics-tls" not found
Jul 27 20:18:18.599719 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:18.599675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:18.600332 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:18.599823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:18.600332 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:18.599967    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:18:18.600332 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:18.600049    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls podName:436b68b3-0ad6-4980-9d97-e02c99f8395d nodeName:}" failed. No retries permitted until 2026-07-27 20:18:26.600027785 +0000 UTC m=+62.256183109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ppjj2" (UID: "436b68b3-0ad6-4980-9d97-e02c99f8395d") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:18:18.600453 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:18.600342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/436b68b3-0ad6-4980-9d97-e02c99f8395d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:21.031138 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:21.031097    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:21.031538 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:21.031158    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:21.031538 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:21.031493    2580 scope.go:117] "RemoveContainer" containerID="e710014e4d44116bad71803e56df99124362d08af863dbf026ac85cbed004a0f"
Jul 27 20:18:21.243159 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:21.243129    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:18:21.243547 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:21.243528    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/1.log"
Jul 27 20:18:21.243607 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:21.243566    2580 generic.go:356] "Generic (PLEG): container finished" podID="3736de45-8222-42d0-871a-5304b17df9da" containerID="4791693700aa9e7ad3544f21cbd407879bf9335e4cf3ffb35eec888441ae88e1" exitCode=255
Jul 27 20:18:21.243639 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:21.243601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz" event={"ID":"3736de45-8222-42d0-871a-5304b17df9da","Type":"ContainerDied","Data":"4791693700aa9e7ad3544f21cbd407879bf9335e4cf3ffb35eec888441ae88e1"}
Jul 27 20:18:21.243672 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:21.243650    2580 scope.go:117] "RemoveContainer" containerID="e710014e4d44116bad71803e56df99124362d08af863dbf026ac85cbed004a0f"
Jul 27 20:18:21.244001 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:21.243982    2580 scope.go:117] "RemoveContainer" containerID="4791693700aa9e7ad3544f21cbd407879bf9335e4cf3ffb35eec888441ae88e1"
Jul 27 20:18:21.244170 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:21.244149    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-p68dz_openshift-console-operator(3736de45-8222-42d0-871a-5304b17df9da)\"" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz" podUID="3736de45-8222-42d0-871a-5304b17df9da"
Jul 27 20:18:22.247758 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:22.247717    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:18:26.141825 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:26.141797    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f87c"
Jul 27 20:18:26.672121 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:26.672084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:26.674446 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:26.674412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/436b68b3-0ad6-4980-9d97-e02c99f8395d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ppjj2\" (UID: \"436b68b3-0ad6-4980-9d97-e02c99f8395d\") " pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:26.692194 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:26.692168    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kdwph\""
Jul 27 20:18:26.699989 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:26.699967    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ppjj2"
Jul 27 20:18:26.826336 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:26.826306    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ppjj2"]
Jul 27 20:18:26.829450 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:26.829420    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436b68b3_0ad6_4980_9d97_e02c99f8395d.slice/crio-446afa643adc7d51d9d827814efe7b60f3495fb8aec1c644e711123e8975a010 WatchSource:0}: Error finding container 446afa643adc7d51d9d827814efe7b60f3495fb8aec1c644e711123e8975a010: Status 404 returned error can't find the container with id 446afa643adc7d51d9d827814efe7b60f3495fb8aec1c644e711123e8975a010
Jul 27 20:18:27.266371 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:27.266339    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ppjj2" event={"ID":"436b68b3-0ad6-4980-9d97-e02c99f8395d","Type":"ContainerStarted","Data":"446afa643adc7d51d9d827814efe7b60f3495fb8aec1c644e711123e8975a010"}
Jul 27 20:18:30.512183 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:30.512137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:18:30.515568 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:30.515539    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:18:30.525116 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:30.525062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b574f99-44fb-4a34-b645-ef5aa1bbaf1e-metrics-certs\") pod \"network-metrics-daemon-xbhcs\" (UID: \"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e\") " pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:18:30.612905 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:30.612862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:18:30.616061 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:30.616034    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:18:30.626643 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:30.626614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018163d0-e356-4286-b3e3-2b32e0afdf23-original-pull-secret\") pod \"global-pull-secret-syncer-k7v72\" (UID: \"018163d0-e356-4286-b3e3-2b32e0afdf23\") " pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:18:30.709761 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:30.709711    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8gvk7\""
Jul 27 20:18:30.714431 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:30.714402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhg7d\" (UniqueName: \"kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d\") pod \"network-check-target-6txrr\" (UID: \"76cf7b6f-a97e-44af-ab23-f8d3ef30955a\") " pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:18:30.716684 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:30.716660    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7v72"
Jul 27 20:18:30.717233 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:30.717209    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhg7d\" (UniqueName: \"kubernetes.io/projected/76cf7b6f-a97e-44af-ab23-f8d3ef30955a-kube-api-access-xhg7d\") pod \"network-check-target-6txrr\" (UID: \"76cf7b6f-a97e-44af-ab23-f8d3ef30955a\") " pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:18:30.717339 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:30.717326    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcs"
Jul 27 20:18:31.014901 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:31.014875    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xjfvv\""
Jul 27 20:18:31.022141 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:31.022110    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:18:31.031812 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:31.031780    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:31.031956 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:31.031838    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:31.032189 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:31.032176    2580 scope.go:117] "RemoveContainer" containerID="4791693700aa9e7ad3544f21cbd407879bf9335e4cf3ffb35eec888441ae88e1"
Jul 27 20:18:31.032349 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:18:31.032329    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-p68dz_openshift-console-operator(3736de45-8222-42d0-871a-5304b17df9da)\"" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz" podUID="3736de45-8222-42d0-871a-5304b17df9da"
Jul 27 20:18:31.805582 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:31.805548    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xbhcs"]
Jul 27 20:18:31.808157 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:31.808135    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b574f99_44fb_4a34_b645_ef5aa1bbaf1e.slice/crio-cf8399d69f623b12ac7feef01e91d7221db27e83da2d93664a6474d4b83c6186 WatchSource:0}: Error finding container cf8399d69f623b12ac7feef01e91d7221db27e83da2d93664a6474d4b83c6186: Status 404 returned error can't find the container with id cf8399d69f623b12ac7feef01e91d7221db27e83da2d93664a6474d4b83c6186
Jul 27 20:18:32.029315 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.029292    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k7v72"]
Jul 27 20:18:32.031669 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.031597    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6txrr"]
Jul 27 20:18:32.031924 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:32.031895    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018163d0_e356_4286_b3e3_2b32e0afdf23.slice/crio-a04c768c0cea1906dec19145ea5ba7abc220c0c4a025a0456723fa170877e9f4 WatchSource:0}: Error finding container a04c768c0cea1906dec19145ea5ba7abc220c0c4a025a0456723fa170877e9f4: Status 404 returned error can't find the container with id a04c768c0cea1906dec19145ea5ba7abc220c0c4a025a0456723fa170877e9f4
Jul 27 20:18:32.033911 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:32.033881    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76cf7b6f_a97e_44af_ab23_f8d3ef30955a.slice/crio-ed104d1e343a0683125208250f379f508d2a9ff3eb55d0ea43cdb50e04e8c50a WatchSource:0}: Error finding container ed104d1e343a0683125208250f379f508d2a9ff3eb55d0ea43cdb50e04e8c50a: Status 404 returned error can't find the container with id ed104d1e343a0683125208250f379f508d2a9ff3eb55d0ea43cdb50e04e8c50a
Jul 27 20:18:32.286528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.286485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ppjj2" event={"ID":"436b68b3-0ad6-4980-9d97-e02c99f8395d","Type":"ContainerStarted","Data":"b05abd503e5bfc69ddeab984310e93567b5a240622409b756789b3ebe62b2e87"}
Jul 27 20:18:32.287959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.287929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xbhcs" event={"ID":"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e","Type":"ContainerStarted","Data":"cf8399d69f623b12ac7feef01e91d7221db27e83da2d93664a6474d4b83c6186"}
Jul 27 20:18:32.290240 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.290207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6txrr" event={"ID":"76cf7b6f-a97e-44af-ab23-f8d3ef30955a","Type":"ContainerStarted","Data":"aa923bc7f37b4db8087415fbab8001e280fcee6c67fe1fdd6ddf47919a3da703"}
Jul 27 20:18:32.290367 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.290260    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6txrr" event={"ID":"76cf7b6f-a97e-44af-ab23-f8d3ef30955a","Type":"ContainerStarted","Data":"ed104d1e343a0683125208250f379f508d2a9ff3eb55d0ea43cdb50e04e8c50a"}
Jul 27 20:18:32.290367 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.290321    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:18:32.291722 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.291696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k7v72" event={"ID":"018163d0-e356-4286-b3e3-2b32e0afdf23","Type":"ContainerStarted","Data":"a04c768c0cea1906dec19145ea5ba7abc220c0c4a025a0456723fa170877e9f4"}
Jul 27 20:18:32.306789 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.306724    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6txrr" podStartSLOduration=67.306705099 podStartE2EDuration="1m7.306705099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:32.305229444 +0000 UTC m=+67.961384788" watchObservedRunningTime="2026-07-27 20:18:32.306705099 +0000 UTC m=+67.962860444"
Jul 27 20:18:32.633642 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.633556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5mr7n\" (UID: \"9ccce07a-eca0-402a-b714-6d09fdf8ecd1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:32.633642 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.633597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:32.633642 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.633626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-h25jw\" (UID: \"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:32.633895 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.633664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:32.633895 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.633686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:32.633895 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.633725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:32.633895 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.633770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:32.634803 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.634737    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0013340e-a437-449d-9668-5bfcd6ebd16c-service-ca-bundle\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:32.637427 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.637371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013340e-a437-449d-9668-5bfcd6ebd16c-metrics-certs\") pod \"router-default-54f5f9b87f-2bfnt\" (UID: \"0013340e-a437-449d-9668-5bfcd6ebd16c\") " pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:32.637946 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.637919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ccce07a-eca0-402a-b714-6d09fdf8ecd1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5mr7n\" (UID: \"9ccce07a-eca0-402a-b714-6d09fdf8ecd1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:32.638045 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.637918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5b42704-6ac3-4fe3-a7d9-6e327f59bccd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-t44h7\" (UID: \"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:32.639046 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.639001    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls\") pod \"image-registry-54c8b6cc6c-4k8fm\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") " pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:32.639623 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.639577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b15e2e83-21fe-4673-b2ca-46c2ce42a4f3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-h25jw\" (UID: \"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:32.640435 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.640412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f6140b-7997-493a-ade8-5d64dd0b4870-metrics-tls\") pod \"dns-default-67qht\" (UID: \"37f6140b-7997-493a-ade8-5d64dd0b4870\") " pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:32.798252 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.798028    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sclqk\""
Jul 27 20:18:32.806159 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.806125    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"
Jul 27 20:18:32.827189 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.826941    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s87ms\""
Jul 27 20:18:32.835233 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.835205    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:32.840041 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.839838    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jcfs7\""
Jul 27 20:18:32.847804 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.847776    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hm58s\""
Jul 27 20:18:32.848043 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.847982    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"
Jul 27 20:18:32.856143 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.856077    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:32.862186 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.862166    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fddhr\""
Jul 27 20:18:32.871062 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.871037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"
Jul 27 20:18:32.874124 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.874104    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4zfst\""
Jul 27 20:18:32.883191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:32.883163    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:33.191263 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:33.187013    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54f5f9b87f-2bfnt"]
Jul 27 20:18:33.198867 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:33.195672    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n"]
Jul 27 20:18:33.259821 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:33.259711    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-h25jw"]
Jul 27 20:18:33.262381 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:33.262273    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"]
Jul 27 20:18:33.273156 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:33.273116    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7"]
Jul 27 20:18:33.292020 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:33.291983    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-67qht"]
Jul 27 20:18:33.363352 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:33.363315    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0013340e_a437_449d_9668_5bfcd6ebd16c.slice/crio-b577e7e151334a38c056a6102656cae51abc9bb4cba56306292d58125bc88a7a WatchSource:0}: Error finding container b577e7e151334a38c056a6102656cae51abc9bb4cba56306292d58125bc88a7a: Status 404 returned error can't find the container with id b577e7e151334a38c056a6102656cae51abc9bb4cba56306292d58125bc88a7a
Jul 27 20:18:33.364298 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:33.364273    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15e2e83_21fe_4673_b2ca_46c2ce42a4f3.slice/crio-4a76c055f9990283f15c019a0e4af6703820476bb296c01d5aa299e048ef9ecb WatchSource:0}: Error finding container 4a76c055f9990283f15c019a0e4af6703820476bb296c01d5aa299e048ef9ecb: Status 404 returned error can't find the container with id 4a76c055f9990283f15c019a0e4af6703820476bb296c01d5aa299e048ef9ecb
Jul 27 20:18:33.366045 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:33.366018    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b42704_6ac3_4fe3_a7d9_6e327f59bccd.slice/crio-e079f62bad8f62747e234db0dcc82106cc4ab70627f628b2371e4d9efc7197f4 WatchSource:0}: Error finding container e079f62bad8f62747e234db0dcc82106cc4ab70627f628b2371e4d9efc7197f4: Status 404 returned error can't find the container with id e079f62bad8f62747e234db0dcc82106cc4ab70627f628b2371e4d9efc7197f4
Jul 27 20:18:33.367333 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:33.367294    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e44713_0b92_44af_bc65_2c56777d862f.slice/crio-5d8b5887f1df98578251653434f9bdf4e79b1156b326b0756a8f202bb35f26cc WatchSource:0}: Error finding container 5d8b5887f1df98578251653434f9bdf4e79b1156b326b0756a8f202bb35f26cc: Status 404 returned error can't find the container with id 5d8b5887f1df98578251653434f9bdf4e79b1156b326b0756a8f202bb35f26cc
Jul 27 20:18:33.367581 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:33.367545    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f6140b_7997_493a_ade8_5d64dd0b4870.slice/crio-48e4a374453c450f0fdc3ae486a8939740a35999c49cd6227137fe5546e6a08e WatchSource:0}: Error finding container 48e4a374453c450f0fdc3ae486a8939740a35999c49cd6227137fe5546e6a08e: Status 404 returned error can't find the container with id 48e4a374453c450f0fdc3ae486a8939740a35999c49cd6227137fe5546e6a08e
Jul 27 20:18:34.303925 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.303833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-67qht" event={"ID":"37f6140b-7997-493a-ade8-5d64dd0b4870","Type":"ContainerStarted","Data":"48e4a374453c450f0fdc3ae486a8939740a35999c49cd6227137fe5546e6a08e"}
Jul 27 20:18:34.307997 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.307912    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw" event={"ID":"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3","Type":"ContainerStarted","Data":"4a76c055f9990283f15c019a0e4af6703820476bb296c01d5aa299e048ef9ecb"}
Jul 27 20:18:34.310885 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.310638    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f5f9b87f-2bfnt" event={"ID":"0013340e-a437-449d-9668-5bfcd6ebd16c","Type":"ContainerStarted","Data":"dce7fd85d02e07644fb3f238e90d5b84c13b614ea4e2466d27870e20fe39a205"}
Jul 27 20:18:34.310885 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.310681    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f5f9b87f-2bfnt" event={"ID":"0013340e-a437-449d-9668-5bfcd6ebd16c","Type":"ContainerStarted","Data":"b577e7e151334a38c056a6102656cae51abc9bb4cba56306292d58125bc88a7a"}
Jul 27 20:18:34.313367 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.313289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n" event={"ID":"9ccce07a-eca0-402a-b714-6d09fdf8ecd1","Type":"ContainerStarted","Data":"9d3f14028440f0abcfd5818ad9f479e0fedf5d78104404052e7681464e6fcb72"}
Jul 27 20:18:34.317306 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.317214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xbhcs" event={"ID":"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e","Type":"ContainerStarted","Data":"722f8b02bb4aa611bf503cd6dd570e5cda95adb3ed0b19c36f1ca1c274aa2166"}
Jul 27 20:18:34.317306 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.317275    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xbhcs" event={"ID":"9b574f99-44fb-4a34-b645-ef5aa1bbaf1e","Type":"ContainerStarted","Data":"213705f5503ecb211959b36c389a03ad9ab21dd27bb3344a14677c4b7ba4dd9d"}
Jul 27 20:18:34.318849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.318811    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7" event={"ID":"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd","Type":"ContainerStarted","Data":"e079f62bad8f62747e234db0dcc82106cc4ab70627f628b2371e4d9efc7197f4"}
Jul 27 20:18:34.323142 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.322489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm" event={"ID":"e9e44713-0b92-44af-bc65-2c56777d862f","Type":"ContainerStarted","Data":"1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae"}
Jul 27 20:18:34.323142 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.322637    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm" event={"ID":"e9e44713-0b92-44af-bc65-2c56777d862f","Type":"ContainerStarted","Data":"5d8b5887f1df98578251653434f9bdf4e79b1156b326b0756a8f202bb35f26cc"}
Jul 27 20:18:34.323142 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.322864    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:34.331872 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.331497    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54f5f9b87f-2bfnt" podStartSLOduration=68.331476968 podStartE2EDuration="1m8.331476968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:34.329788108 +0000 UTC m=+69.985943452" watchObservedRunningTime="2026-07-27 20:18:34.331476968 +0000 UTC m=+69.987632312"
Jul 27 20:18:34.345517 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.345297    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xbhcs" podStartSLOduration=67.745458483 podStartE2EDuration="1m9.345278893s" totalImagesPullingTime="1.59982041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:34.343646805 +0000 UTC m=+69.999802148" watchObservedRunningTime="2026-07-27 20:18:34.345278893 +0000 UTC m=+70.001434237"
Jul 27 20:18:34.362737 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.362282    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm" podStartSLOduration=68.362269277 podStartE2EDuration="1m8.362269277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:34.360948663 +0000 UTC m=+70.017104048" watchObservedRunningTime="2026-07-27 20:18:34.362269277 +0000 UTC m=+70.018424620"
Jul 27 20:18:34.857039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.856616    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:34.860258 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:34.860032    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:35.330129 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:35.330091    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:35.331871 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:35.331844    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54f5f9b87f-2bfnt"
Jul 27 20:18:40.348712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.348668    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k7v72" event={"ID":"018163d0-e356-4286-b3e3-2b32e0afdf23","Type":"ContainerStarted","Data":"8158babb87cc1dc28aa4b80cb2dcb311a15544586e3d0b23b0d67c262cf205a5"}
Jul 27 20:18:40.350552 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.350525    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-67qht" event={"ID":"37f6140b-7997-493a-ade8-5d64dd0b4870","Type":"ContainerStarted","Data":"28f2fddea7b7a86d155c0e325d89177e99a9c3a9eafd544f572e2dbb6683e01f"}
Jul 27 20:18:40.350688 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.350567    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-67qht" event={"ID":"37f6140b-7997-493a-ade8-5d64dd0b4870","Type":"ContainerStarted","Data":"2f87b9b59bab5befd862441bafa191d14cf3938f2e7ade9cfc954c76abda213e"}
Jul 27 20:18:40.350688 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.350633    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:40.352151 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.352125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw" event={"ID":"b15e2e83-21fe-4673-b2ca-46c2ce42a4f3","Type":"ContainerStarted","Data":"551d7c3db07e3b2bb8557321b63d97dc3f91e1113675ca2102a4b31b1fdf71d3"}
Jul 27 20:18:40.354019 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.353991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n" event={"ID":"9ccce07a-eca0-402a-b714-6d09fdf8ecd1","Type":"ContainerStarted","Data":"a924cb765fa6d19e2af81abab7e7b9dbb04247e6f7c50b267c43998f9d184751"}
Jul 27 20:18:40.354134 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.354037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n" event={"ID":"9ccce07a-eca0-402a-b714-6d09fdf8ecd1","Type":"ContainerStarted","Data":"1afc56dc04824da16a8c2bfc4a41c00c1ab32233f537b4c9d049afa154587780"}
Jul 27 20:18:40.355605 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.355588    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ppjj2" event={"ID":"436b68b3-0ad6-4980-9d97-e02c99f8395d","Type":"ContainerStarted","Data":"af46c4b2f9b1c620523906aebdce8cbcc665cba4d1d6f75e42b99ff4620ab3a3"}
Jul 27 20:18:40.357021 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.356993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7" event={"ID":"c5b42704-6ac3-4fe3-a7d9-6e327f59bccd","Type":"ContainerStarted","Data":"6ccbf819e1f8b59ba1d362b591f7fa23ea9385323abdee2e74d4d20371739ff7"}
Jul 27 20:18:40.363494 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.363449    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k7v72" podStartSLOduration=67.682875584 podStartE2EDuration="1m15.363434061s" totalImagesPullingTime="7.680558477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:40.36281309 +0000 UTC m=+76.018968431" watchObservedRunningTime="2026-07-27 20:18:40.363434061 +0000 UTC m=+76.019589407"
Jul 27 20:18:40.378036 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.377994    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5mr7n" podStartSLOduration=68.10009235 podStartE2EDuration="1m14.377980712s" totalImagesPullingTime="6.277888362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:40.377566714 +0000 UTC m=+76.033722057" watchObservedRunningTime="2026-07-27 20:18:40.377980712 +0000 UTC m=+76.034136056"
Jul 27 20:18:40.392198 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.392146    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-h25jw" podStartSLOduration=53.083698662 podStartE2EDuration="59.392127241s" totalImagesPullingTime="6.308428579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:40.391809503 +0000 UTC m=+76.047964848" watchObservedRunningTime="2026-07-27 20:18:40.392127241 +0000 UTC m=+76.048282586"
Jul 27 20:18:40.413048 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.412999    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-67qht" podStartSLOduration=34.105268139 podStartE2EDuration="40.412982011s" totalImagesPullingTime="6.307713872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:40.41156802 +0000 UTC m=+76.067723365" watchObservedRunningTime="2026-07-27 20:18:40.412982011 +0000 UTC m=+76.069137354"
Jul 27 20:18:40.427433 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:40.427371    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-t44h7" podStartSLOduration=68.119142718 podStartE2EDuration="1m14.427350667s" totalImagesPullingTime="6.308207949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:40.426341283 +0000 UTC m=+76.082496655" watchObservedRunningTime="2026-07-27 20:18:40.427350667 +0000 UTC m=+76.083506011"
Jul 27 20:18:43.896256 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:43.896224    2580 scope.go:117] "RemoveContainer" containerID="4791693700aa9e7ad3544f21cbd407879bf9335e4cf3ffb35eec888441ae88e1"
Jul 27 20:18:44.375269 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:44.375244    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:18:44.375422 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:44.375327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz" event={"ID":"3736de45-8222-42d0-871a-5304b17df9da","Type":"ContainerStarted","Data":"29453461ba5f04586aec042da4e90e22715c736251dcf65ade8b5d3b5acdbe5d"}
Jul 27 20:18:44.375642 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:44.375614    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:44.393194 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:44.393133    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz" podStartSLOduration=70.457989457 podStartE2EDuration="1m18.393114862s" totalImagesPullingTime="7.935125405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:44.391390047 +0000 UTC m=+80.047545391" watchObservedRunningTime="2026-07-27 20:18:44.393114862 +0000 UTC m=+80.049270206"
Jul 27 20:18:44.530591 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:44.530504    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-p68dz"
Jul 27 20:18:45.381136 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:45.381103    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ppjj2" event={"ID":"436b68b3-0ad6-4980-9d97-e02c99f8395d","Type":"ContainerStarted","Data":"e251a315529cf63ffe0d6e19102012953347e698d2e6c8a0ced984bda1b6cfcc"}
Jul 27 20:18:45.400563 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:45.400511    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ppjj2" podStartSLOduration=18.13137136 podStartE2EDuration="35.400496616s" totalImagesPullingTime="17.269125256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:18:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:45.3998236 +0000 UTC m=+81.055978965" watchObservedRunningTime="2026-07-27 20:18:45.400496616 +0000 UTC m=+81.056651958"
Jul 27 20:18:50.364305 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:50.364191    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-67qht"
Jul 27 20:18:52.776434 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.776403    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5wm8f"]
Jul 27 20:18:52.779261 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.779244    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:52.781694 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.781672    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 20:18:52.781942 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.781926    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 20:18:52.782032 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.781990    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bjbdd\""
Jul 27 20:18:52.782882 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.782865    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 20:18:52.782952 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.782895    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 20:18:52.909861 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.909828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-wtmp\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:52.909861 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.909863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:52.910201 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.909886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-tls\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:52.910201 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.909902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b6e274b-669e-4670-b4d4-43daed3ac433-metrics-client-ca\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:52.910201 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.909961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-textfile\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:52.910201 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.910008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:52.910201 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.910028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b6e274b-669e-4670-b4d4-43daed3ac433-root\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:52.910201 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.910088    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4hls\" (UniqueName: \"kubernetes.io/projected/4b6e274b-669e-4670-b4d4-43daed3ac433-kube-api-access-j4hls\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:52.910201 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:52.910113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b6e274b-669e-4670-b4d4-43daed3ac433-sys\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.010869 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.010830    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4hls\" (UniqueName: \"kubernetes.io/projected/4b6e274b-669e-4670-b4d4-43daed3ac433-kube-api-access-j4hls\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.010869 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.010874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b6e274b-669e-4670-b4d4-43daed3ac433-sys\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011127 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.010933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b6e274b-669e-4670-b4d4-43daed3ac433-sys\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011127 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.011004    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-wtmp\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011127 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.011052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011127 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.011083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-tls\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.011151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b6e274b-669e-4670-b4d4-43daed3ac433-metrics-client-ca\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.011205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-textfile\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.011163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-wtmp\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.011225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.011250    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b6e274b-669e-4670-b4d4-43daed3ac433-root\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011543 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.011325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b6e274b-669e-4670-b4d4-43daed3ac433-root\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011642 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.011620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-textfile\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011776 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.011733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b6e274b-669e-4670-b4d4-43daed3ac433-metrics-client-ca\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.011843 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.011824    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.013471 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.013448    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.013679 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.013659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b6e274b-669e-4670-b4d4-43daed3ac433-node-exporter-tls\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.026648 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.026581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4hls\" (UniqueName: \"kubernetes.io/projected/4b6e274b-669e-4670-b4d4-43daed3ac433-kube-api-access-j4hls\") pod \"node-exporter-5wm8f\" (UID: \"4b6e274b-669e-4670-b4d4-43daed3ac433\") " pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.088622 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.088584    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5wm8f"
Jul 27 20:18:53.101237 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:53.101198    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6e274b_669e_4670_b4d4_43daed3ac433.slice/crio-e2d14982c268c5c5867f2fcbf1acc811e5c8da716a4914cf6cf530cb6f61ddc2 WatchSource:0}: Error finding container e2d14982c268c5c5867f2fcbf1acc811e5c8da716a4914cf6cf530cb6f61ddc2: Status 404 returned error can't find the container with id e2d14982c268c5c5867f2fcbf1acc811e5c8da716a4914cf6cf530cb6f61ddc2
Jul 27 20:18:53.413016 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:53.412977    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wm8f" event={"ID":"4b6e274b-669e-4670-b4d4-43daed3ac433","Type":"ContainerStarted","Data":"e2d14982c268c5c5867f2fcbf1acc811e5c8da716a4914cf6cf530cb6f61ddc2"}
Jul 27 20:18:54.418315 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:54.418277    2580 generic.go:356] "Generic (PLEG): container finished" podID="4b6e274b-669e-4670-b4d4-43daed3ac433" containerID="3b58ecd4bc316597d8bd9583c1ccb13504a5750a0d6f02933cee57da16c18d6f" exitCode=0
Jul 27 20:18:54.418737 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:54.418366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wm8f" event={"ID":"4b6e274b-669e-4670-b4d4-43daed3ac433","Type":"ContainerDied","Data":"3b58ecd4bc316597d8bd9583c1ccb13504a5750a0d6f02933cee57da16c18d6f"}
Jul 27 20:18:55.334427 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:55.334396    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:18:55.423960 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:55.423924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wm8f" event={"ID":"4b6e274b-669e-4670-b4d4-43daed3ac433","Type":"ContainerStarted","Data":"bab2557d558d975fef44499b71240aa20a93c68d0e578819761888ec52a23ec2"}
Jul 27 20:18:55.424428 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:55.423984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wm8f" event={"ID":"4b6e274b-669e-4670-b4d4-43daed3ac433","Type":"ContainerStarted","Data":"54ebab06e65e7ef61865bc4d7df2c499fe2882d33a83292bc1877a26a04aea95"}
Jul 27 20:18:55.443667 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:55.443598    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5wm8f" podStartSLOduration=2.491978935 podStartE2EDuration="3.443578216s" totalImagesPullingTime="886.919407ms" totalInitContainerRuntime="64.679874ms" isStatefulPod=true podCreationTimestamp="2026-07-27 20:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:55.440097549 +0000 UTC m=+91.096252917" watchObservedRunningTime="2026-07-27 20:18:55.443578216 +0000 UTC m=+91.099733558"
Jul 27 20:18:57.956691 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:57.956656    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c7658747b-r6rhx"]
Jul 27 20:18:57.958896 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:57.958879    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:57.961232 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:57.961210    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 27 20:18:57.961232 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:57.961243    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 27 20:18:57.961436 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:57.961426    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rw58m\""
Jul 27 20:18:57.961624 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:57.961604    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 27 20:18:57.961868 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:57.961695    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 27 20:18:57.962018 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:57.961997    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 27 20:18:57.965822 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:57.965678    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 27 20:18:57.973083 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:57.973053    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c7658747b-r6rhx"]
Jul 27 20:18:58.053488 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.053446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2ac731-521d-4d05-b94c-43a820621c07-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.053668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.053499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnvdq\" (UniqueName: \"kubernetes.io/projected/2d2ac731-521d-4d05-b94c-43a820621c07-kube-api-access-rnvdq\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.053668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.053563    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2ac731-521d-4d05-b94c-43a820621c07-serving-certs-ca-bundle\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.053668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.053621    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d2ac731-521d-4d05-b94c-43a820621c07-federate-client-tls\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.053668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.053637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d2ac731-521d-4d05-b94c-43a820621c07-metrics-client-ca\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.053844 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.053673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d2ac731-521d-4d05-b94c-43a820621c07-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.053844 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.053725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d2ac731-521d-4d05-b94c-43a820621c07-secret-telemeter-client\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.053844 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.053773    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d2ac731-521d-4d05-b94c-43a820621c07-telemeter-client-tls\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.154473 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.154435    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d2ac731-521d-4d05-b94c-43a820621c07-secret-telemeter-client\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.154640 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.154481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d2ac731-521d-4d05-b94c-43a820621c07-telemeter-client-tls\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.154640 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.154606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2ac731-521d-4d05-b94c-43a820621c07-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.154726 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.154663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnvdq\" (UniqueName: \"kubernetes.io/projected/2d2ac731-521d-4d05-b94c-43a820621c07-kube-api-access-rnvdq\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.154726 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.154692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2ac731-521d-4d05-b94c-43a820621c07-serving-certs-ca-bundle\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.154846 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.154724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d2ac731-521d-4d05-b94c-43a820621c07-federate-client-tls\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.154846 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.154768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d2ac731-521d-4d05-b94c-43a820621c07-metrics-client-ca\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.154846 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.154820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d2ac731-521d-4d05-b94c-43a820621c07-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.155507 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.155481    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2ac731-521d-4d05-b94c-43a820621c07-serving-certs-ca-bundle\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.155672 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.155646    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d2ac731-521d-4d05-b94c-43a820621c07-metrics-client-ca\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.155778 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.155739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2ac731-521d-4d05-b94c-43a820621c07-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.157266 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.157244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2d2ac731-521d-4d05-b94c-43a820621c07-telemeter-client-tls\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.157345 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.157287    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d2ac731-521d-4d05-b94c-43a820621c07-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.157432 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.157417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2d2ac731-521d-4d05-b94c-43a820621c07-secret-telemeter-client\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.157468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.157431    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2d2ac731-521d-4d05-b94c-43a820621c07-federate-client-tls\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.162490 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.162468    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnvdq\" (UniqueName: \"kubernetes.io/projected/2d2ac731-521d-4d05-b94c-43a820621c07-kube-api-access-rnvdq\") pod \"telemeter-client-7c7658747b-r6rhx\" (UID: \"2d2ac731-521d-4d05-b94c-43a820621c07\") " pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.259407 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.259325    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"]
Jul 27 20:18:58.268266 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.268240    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx"
Jul 27 20:18:58.406019 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.405993    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c7658747b-r6rhx"]
Jul 27 20:18:58.408511 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:18:58.408485    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2ac731_521d_4d05_b94c_43a820621c07.slice/crio-eeea15be858e4e63cd5e898108a5bf480175eaa9a6c8b269128bf3320971c428 WatchSource:0}: Error finding container eeea15be858e4e63cd5e898108a5bf480175eaa9a6c8b269128bf3320971c428: Status 404 returned error can't find the container with id eeea15be858e4e63cd5e898108a5bf480175eaa9a6c8b269128bf3320971c428
Jul 27 20:18:58.436235 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:18:58.436199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx" event={"ID":"2d2ac731-521d-4d05-b94c-43a820621c07","Type":"ContainerStarted","Data":"eeea15be858e4e63cd5e898108a5bf480175eaa9a6c8b269128bf3320971c428"}
Jul 27 20:19:00.233251 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.233211    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58944b6757-8kbrj"]
Jul 27 20:19:00.235568 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.235547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.238112 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.237895    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 20:19:00.238112 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.237946    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 20:19:00.238112 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.237904    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 20:19:00.238112 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.237971    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 20:19:00.238902 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.238772    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vmj8n\""
Jul 27 20:19:00.239010 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.238978    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 20:19:00.239010 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.238985    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 20:19:00.239245 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.239230    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 20:19:00.242863 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.242840    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 20:19:00.246799 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.246777    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58944b6757-8kbrj"]
Jul 27 20:19:00.272097 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.272066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-trusted-ca-bundle\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.272280 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.272107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90117049-e80e-4820-a934-392898e016ab-console-serving-cert\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.272280 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.272134    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pg55\" (UniqueName: \"kubernetes.io/projected/90117049-e80e-4820-a934-392898e016ab-kube-api-access-6pg55\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.272280 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.272182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90117049-e80e-4820-a934-392898e016ab-console-oauth-config\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.272545 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.272322    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-service-ca\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.272545 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.272357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-console-config\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.272545 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.272384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-oauth-serving-cert\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.373305 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.373277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-service-ca\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.373433 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.373312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-console-config\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.373433 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.373331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-oauth-serving-cert\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.373433 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.373374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-trusted-ca-bundle\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.373433 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.373408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90117049-e80e-4820-a934-392898e016ab-console-serving-cert\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.373640 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.373437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pg55\" (UniqueName: \"kubernetes.io/projected/90117049-e80e-4820-a934-392898e016ab-kube-api-access-6pg55\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.373640 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.373465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90117049-e80e-4820-a934-392898e016ab-console-oauth-config\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.374049 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.374001    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-service-ca\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.374170 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.374131    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-oauth-serving-cert\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.374238 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.374216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-trusted-ca-bundle\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.374565 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.374537    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-console-config\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.375942 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.375922    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90117049-e80e-4820-a934-392898e016ab-console-oauth-config\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.376204 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.376185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90117049-e80e-4820-a934-392898e016ab-console-serving-cert\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.381374 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.381343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pg55\" (UniqueName: \"kubernetes.io/projected/90117049-e80e-4820-a934-392898e016ab-kube-api-access-6pg55\") pod \"console-58944b6757-8kbrj\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") " pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.445431 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.445396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx" event={"ID":"2d2ac731-521d-4d05-b94c-43a820621c07","Type":"ContainerStarted","Data":"d56f5487f4b7ddbfef8e4d327634dad82e1a785f75582cc38a1cab74b11519b8"}
Jul 27 20:19:00.547444 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.547415    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:00.675199 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:00.675165    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58944b6757-8kbrj"]
Jul 27 20:19:00.678143 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:19:00.678116    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90117049_e80e_4820_a934_392898e016ab.slice/crio-83909a2ebd334fc58dfda12f70b5b7e9952313d5083add154957a265d19620d2 WatchSource:0}: Error finding container 83909a2ebd334fc58dfda12f70b5b7e9952313d5083add154957a265d19620d2: Status 404 returned error can't find the container with id 83909a2ebd334fc58dfda12f70b5b7e9952313d5083add154957a265d19620d2
Jul 27 20:19:01.452062 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:01.452021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58944b6757-8kbrj" event={"ID":"90117049-e80e-4820-a934-392898e016ab","Type":"ContainerStarted","Data":"83909a2ebd334fc58dfda12f70b5b7e9952313d5083add154957a265d19620d2"}
Jul 27 20:19:01.455798 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:01.455763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx" event={"ID":"2d2ac731-521d-4d05-b94c-43a820621c07","Type":"ContainerStarted","Data":"d77f53c4acb16195b67b9b375472f147822b10a4ad0456ee5a92d5c8ab20845b"}
Jul 27 20:19:01.455921 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:01.455834    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx" event={"ID":"2d2ac731-521d-4d05-b94c-43a820621c07","Type":"ContainerStarted","Data":"e4b78a8a930205896994695d4de0782450a319ec4dbe51a26de572cfe62b3fca"}
Jul 27 20:19:01.480300 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:01.480237    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c7658747b-r6rhx" podStartSLOduration=1.699893323 podStartE2EDuration="4.480213325s" totalImagesPullingTime="2.780320002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:19:01.477341851 +0000 UTC m=+97.133497246" watchObservedRunningTime="2026-07-27 20:19:01.480213325 +0000 UTC m=+97.136368672"
Jul 27 20:19:02.366887 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.366850    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84f66ccffd-xszvx"]
Jul 27 20:19:02.418580 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.418536    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f66ccffd-xszvx"]
Jul 27 20:19:02.418776 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.418692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.492660 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.492615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-console-config\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.493179 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.492677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0977cf7-8700-4e21-ab71-88599709ff69-console-serving-cert\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.493179 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.492706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cmhb\" (UniqueName: \"kubernetes.io/projected/c0977cf7-8700-4e21-ab71-88599709ff69-kube-api-access-2cmhb\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.493179 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.492766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-service-ca\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.493179 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.492783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-oauth-serving-cert\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.493179 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.493096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0977cf7-8700-4e21-ab71-88599709ff69-console-oauth-config\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.493462 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.493218    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-trusted-ca-bundle\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.593972 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.593924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0977cf7-8700-4e21-ab71-88599709ff69-console-oauth-config\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.594175 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.594002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-trusted-ca-bundle\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.594175 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.594091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-console-config\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.594175 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.594164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0977cf7-8700-4e21-ab71-88599709ff69-console-serving-cert\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.594353 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.594187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cmhb\" (UniqueName: \"kubernetes.io/projected/c0977cf7-8700-4e21-ab71-88599709ff69-kube-api-access-2cmhb\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.594353 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.594212    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-service-ca\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.594353 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.594235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-oauth-serving-cert\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.594868 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.594841    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-console-config\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.594989 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.594964    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-service-ca\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.595066 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.595043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-trusted-ca-bundle\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.595139 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.595120    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-oauth-serving-cert\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.597096 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.597071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0977cf7-8700-4e21-ab71-88599709ff69-console-oauth-config\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.597179 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.597131    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0977cf7-8700-4e21-ab71-88599709ff69-console-serving-cert\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.603118 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.603096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cmhb\" (UniqueName: \"kubernetes.io/projected/c0977cf7-8700-4e21-ab71-88599709ff69-kube-api-access-2cmhb\") pod \"console-84f66ccffd-xszvx\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") " pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:02.729803 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:02.729707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:03.299716 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:03.299669    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6txrr"
Jul 27 20:19:04.042571 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:04.042537    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f66ccffd-xszvx"]
Jul 27 20:19:04.045678 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:19:04.045645    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0977cf7_8700_4e21_ab71_88599709ff69.slice/crio-15ca2b30dce6f8e1fa08512533907f294be53c8e29c7e0dbed6cd2d84e3c9700 WatchSource:0}: Error finding container 15ca2b30dce6f8e1fa08512533907f294be53c8e29c7e0dbed6cd2d84e3c9700: Status 404 returned error can't find the container with id 15ca2b30dce6f8e1fa08512533907f294be53c8e29c7e0dbed6cd2d84e3c9700
Jul 27 20:19:04.471242 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:04.471205    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58944b6757-8kbrj" event={"ID":"90117049-e80e-4820-a934-392898e016ab","Type":"ContainerStarted","Data":"93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040"}
Jul 27 20:19:04.472521 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:04.472491    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f66ccffd-xszvx" event={"ID":"c0977cf7-8700-4e21-ab71-88599709ff69","Type":"ContainerStarted","Data":"15ca2b30dce6f8e1fa08512533907f294be53c8e29c7e0dbed6cd2d84e3c9700"}
Jul 27 20:19:04.487969 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:04.487915    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58944b6757-8kbrj" podStartSLOduration=0.924774524 podStartE2EDuration="4.487896836s" totalImagesPullingTime="3.563122312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:19:04.486173749 +0000 UTC m=+100.142329092" watchObservedRunningTime="2026-07-27 20:19:04.487896836 +0000 UTC m=+100.144052178"
Jul 27 20:19:05.478453 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:05.478410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f66ccffd-xszvx" event={"ID":"c0977cf7-8700-4e21-ab71-88599709ff69","Type":"ContainerStarted","Data":"0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68"}
Jul 27 20:19:05.495377 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:05.495321    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84f66ccffd-xszvx" podStartSLOduration=3.041263434 podStartE2EDuration="3.49530619s" totalImagesPullingTime="454.042756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:19:05.494822392 +0000 UTC m=+101.150977736" watchObservedRunningTime="2026-07-27 20:19:05.49530619 +0000 UTC m=+101.151461532"
Jul 27 20:19:10.547974 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:10.547942    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:10.548384 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:10.547996    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:10.552861 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:10.552837    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:11.507082 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:11.507047    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:12.729864 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:12.729828    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:12.730248 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:12.729925    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:12.734665 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:12.734643    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:13.514288 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:13.514258    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:19:13.563071 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:13.563033    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58944b6757-8kbrj"]
Jul 27 20:19:23.284174 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.284112    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm" podUID="e9e44713-0b92-44af-bc65-2c56777d862f" containerName="registry" containerID="cri-o://1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae" gracePeriod=30
Jul 27 20:19:23.527249 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.527223    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:19:23.548287 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.548194    2580 generic.go:356] "Generic (PLEG): container finished" podID="e9e44713-0b92-44af-bc65-2c56777d862f" containerID="1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae" exitCode=0
Jul 27 20:19:23.548287 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.548243    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"
Jul 27 20:19:23.548287 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.548245    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm" event={"ID":"e9e44713-0b92-44af-bc65-2c56777d862f","Type":"ContainerDied","Data":"1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae"}
Jul 27 20:19:23.548556 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.548299    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54c8b6cc6c-4k8fm" event={"ID":"e9e44713-0b92-44af-bc65-2c56777d862f","Type":"ContainerDied","Data":"5d8b5887f1df98578251653434f9bdf4e79b1156b326b0756a8f202bb35f26cc"}
Jul 27 20:19:23.548556 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.548328    2580 scope.go:117] "RemoveContainer" containerID="1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae"
Jul 27 20:19:23.556875 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.556852    2580 scope.go:117] "RemoveContainer" containerID="1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae"
Jul 27 20:19:23.557225 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:19:23.557196    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae\": container with ID starting with 1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae not found: ID does not exist" containerID="1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae"
Jul 27 20:19:23.557290 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.557237    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae"} err="failed to get container status \"1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae\": rpc error: code = NotFound desc = could not find container \"1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae\": container with ID starting with 1cfb1c60d1553779ab84d9fda002ce4030e5fdc9b60732746a55a001f3a331ae not found: ID does not exist"
Jul 27 20:19:23.687019 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.686971    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls\") pod \"e9e44713-0b92-44af-bc65-2c56777d862f\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") "
Jul 27 20:19:23.687188 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.687032    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9e44713-0b92-44af-bc65-2c56777d862f-trusted-ca\") pod \"e9e44713-0b92-44af-bc65-2c56777d862f\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") "
Jul 27 20:19:23.687188 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.687059    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9e44713-0b92-44af-bc65-2c56777d862f-image-registry-private-configuration\") pod \"e9e44713-0b92-44af-bc65-2c56777d862f\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") "
Jul 27 20:19:23.687188 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.687095    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9e44713-0b92-44af-bc65-2c56777d862f-installation-pull-secrets\") pod \"e9e44713-0b92-44af-bc65-2c56777d862f\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") "
Jul 27 20:19:23.687188 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.687123    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9e44713-0b92-44af-bc65-2c56777d862f-registry-certificates\") pod \"e9e44713-0b92-44af-bc65-2c56777d862f\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") "
Jul 27 20:19:23.687188 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.687160    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9e44713-0b92-44af-bc65-2c56777d862f-ca-trust-extracted\") pod \"e9e44713-0b92-44af-bc65-2c56777d862f\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") "
Jul 27 20:19:23.687436 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.687191    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-bound-sa-token\") pod \"e9e44713-0b92-44af-bc65-2c56777d862f\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") "
Jul 27 20:19:23.687436 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.687221    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl7qf\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-kube-api-access-cl7qf\") pod \"e9e44713-0b92-44af-bc65-2c56777d862f\" (UID: \"e9e44713-0b92-44af-bc65-2c56777d862f\") "
Jul 27 20:19:23.687676 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.687599    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9e44713-0b92-44af-bc65-2c56777d862f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e9e44713-0b92-44af-bc65-2c56777d862f" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:19:23.687931 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.687680    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9e44713-0b92-44af-bc65-2c56777d862f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e9e44713-0b92-44af-bc65-2c56777d862f" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:19:23.690126 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.690096    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e44713-0b92-44af-bc65-2c56777d862f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e9e44713-0b92-44af-bc65-2c56777d862f" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:19:23.690240 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.690138    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e9e44713-0b92-44af-bc65-2c56777d862f" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:19:23.690240 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.690216    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-kube-api-access-cl7qf" (OuterVolumeSpecName: "kube-api-access-cl7qf") pod "e9e44713-0b92-44af-bc65-2c56777d862f" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f"). InnerVolumeSpecName "kube-api-access-cl7qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:19:23.690325 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.690231    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e44713-0b92-44af-bc65-2c56777d862f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e9e44713-0b92-44af-bc65-2c56777d862f" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:19:23.690325 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.690306    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e9e44713-0b92-44af-bc65-2c56777d862f" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:19:23.695602 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.695570    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e44713-0b92-44af-bc65-2c56777d862f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e9e44713-0b92-44af-bc65-2c56777d862f" (UID: "e9e44713-0b92-44af-bc65-2c56777d862f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:19:23.788061 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.788022    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-registry-tls\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:23.788061 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.788052    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9e44713-0b92-44af-bc65-2c56777d862f-trusted-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:23.788061 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.788065    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9e44713-0b92-44af-bc65-2c56777d862f-image-registry-private-configuration\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:23.788279 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.788074    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9e44713-0b92-44af-bc65-2c56777d862f-installation-pull-secrets\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:23.788279 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.788085    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9e44713-0b92-44af-bc65-2c56777d862f-registry-certificates\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:23.788279 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.788093    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9e44713-0b92-44af-bc65-2c56777d862f-ca-trust-extracted\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:23.788279 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.788101    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-bound-sa-token\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:23.788279 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.788110    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl7qf\" (UniqueName: \"kubernetes.io/projected/e9e44713-0b92-44af-bc65-2c56777d862f-kube-api-access-cl7qf\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:23.869162 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.869134    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"]
Jul 27 20:19:23.880340 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:23.880311    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54c8b6cc6c-4k8fm"]
Jul 27 20:19:24.901143 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:24.901110    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9e44713-0b92-44af-bc65-2c56777d862f" path="/var/lib/kubelet/pods/e9e44713-0b92-44af-bc65-2c56777d862f/volumes"
Jul 27 20:19:31.577702 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:31.577668    2580 generic.go:356] "Generic (PLEG): container finished" podID="f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a" containerID="626e856908c3216acc3d1977a6d2c437ef2b7ab24eadf067c8a4d4861ef47eff" exitCode=0
Jul 27 20:19:31.578098 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:31.577741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb" event={"ID":"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a","Type":"ContainerDied","Data":"626e856908c3216acc3d1977a6d2c437ef2b7ab24eadf067c8a4d4861ef47eff"}
Jul 27 20:19:31.578139 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:31.578122    2580 scope.go:117] "RemoveContainer" containerID="626e856908c3216acc3d1977a6d2c437ef2b7ab24eadf067c8a4d4861ef47eff"
Jul 27 20:19:32.583256 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:32.583225    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb" event={"ID":"f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a","Type":"ContainerStarted","Data":"d62368276fb2881d786bcc08ceee6509ee706088c83b2e7d338fc1515b8b75a8"}
Jul 27 20:19:35.598730 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:35.598642    2580 generic.go:356] "Generic (PLEG): container finished" podID="80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf" containerID="764a058b4c858525de49a9d65f89c9d8d05ad5935f0fe306a7936c9fbf6bb66c" exitCode=0
Jul 27 20:19:35.598730 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:35.598716    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg" event={"ID":"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf","Type":"ContainerDied","Data":"764a058b4c858525de49a9d65f89c9d8d05ad5935f0fe306a7936c9fbf6bb66c"}
Jul 27 20:19:35.599240 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:35.599101    2580 scope.go:117] "RemoveContainer" containerID="764a058b4c858525de49a9d65f89c9d8d05ad5935f0fe306a7936c9fbf6bb66c"
Jul 27 20:19:35.600245 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:35.600227    2580 generic.go:356] "Generic (PLEG): container finished" podID="e3317a2a-a923-430a-80ac-56bc1016877f" containerID="b55fb21ef46b2a4cc4f930f9530d7ebc74146cf97cdda17d1cbfdff978739bb0" exitCode=0
Jul 27 20:19:35.600323 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:35.600285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kdl8p" event={"ID":"e3317a2a-a923-430a-80ac-56bc1016877f","Type":"ContainerDied","Data":"b55fb21ef46b2a4cc4f930f9530d7ebc74146cf97cdda17d1cbfdff978739bb0"}
Jul 27 20:19:35.600537 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:35.600525    2580 scope.go:117] "RemoveContainer" containerID="b55fb21ef46b2a4cc4f930f9530d7ebc74146cf97cdda17d1cbfdff978739bb0"
Jul 27 20:19:36.606548 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:36.606511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8xhzg" event={"ID":"80fb9cf5-fc2b-4d55-ba2f-9a2c97ac6bcf","Type":"ContainerStarted","Data":"83b84460f108b45162c6cfb322b856bfc6731cbba1978a62c543a1f082a2eb05"}
Jul 27 20:19:36.608343 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:36.608317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kdl8p" event={"ID":"e3317a2a-a923-430a-80ac-56bc1016877f","Type":"ContainerStarted","Data":"a12bcc6211a259377f6a172d37d407f5665d1bc0ecb849b2a1e87b2580aec2ba"}
Jul 27 20:19:38.584039 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:38.583989    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58944b6757-8kbrj" podUID="90117049-e80e-4820-a934-392898e016ab" containerName="console" containerID="cri-o://93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040" gracePeriod=15
Jul 27 20:19:38.832946 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:38.832919    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:39.022396 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.022300    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-oauth-serving-cert\") pod \"90117049-e80e-4820-a934-392898e016ab\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") "
Jul 27 20:19:39.022396 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.022348    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-console-config\") pod \"90117049-e80e-4820-a934-392898e016ab\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") "
Jul 27 20:19:39.022396 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.022388    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-service-ca\") pod \"90117049-e80e-4820-a934-392898e016ab\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") "
Jul 27 20:19:39.022688 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.022417    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90117049-e80e-4820-a934-392898e016ab-console-oauth-config\") pod \"90117049-e80e-4820-a934-392898e016ab\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") "
Jul 27 20:19:39.022688 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.022439    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pg55\" (UniqueName: \"kubernetes.io/projected/90117049-e80e-4820-a934-392898e016ab-kube-api-access-6pg55\") pod \"90117049-e80e-4820-a934-392898e016ab\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") "
Jul 27 20:19:39.022688 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.022460    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90117049-e80e-4820-a934-392898e016ab-console-serving-cert\") pod \"90117049-e80e-4820-a934-392898e016ab\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") "
Jul 27 20:19:39.022688 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.022498    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-trusted-ca-bundle\") pod \"90117049-e80e-4820-a934-392898e016ab\" (UID: \"90117049-e80e-4820-a934-392898e016ab\") "
Jul 27 20:19:39.022904 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.022855    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "90117049-e80e-4820-a934-392898e016ab" (UID: "90117049-e80e-4820-a934-392898e016ab"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:19:39.023015 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.022993    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-console-config" (OuterVolumeSpecName: "console-config") pod "90117049-e80e-4820-a934-392898e016ab" (UID: "90117049-e80e-4820-a934-392898e016ab"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:19:39.023067 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.023024    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-service-ca" (OuterVolumeSpecName: "service-ca") pod "90117049-e80e-4820-a934-392898e016ab" (UID: "90117049-e80e-4820-a934-392898e016ab"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:19:39.023150 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.023121    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "90117049-e80e-4820-a934-392898e016ab" (UID: "90117049-e80e-4820-a934-392898e016ab"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:19:39.024864 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.024830    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90117049-e80e-4820-a934-392898e016ab-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "90117049-e80e-4820-a934-392898e016ab" (UID: "90117049-e80e-4820-a934-392898e016ab"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:19:39.024977 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.024887    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90117049-e80e-4820-a934-392898e016ab-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "90117049-e80e-4820-a934-392898e016ab" (UID: "90117049-e80e-4820-a934-392898e016ab"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:19:39.024977 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.024888    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90117049-e80e-4820-a934-392898e016ab-kube-api-access-6pg55" (OuterVolumeSpecName: "kube-api-access-6pg55") pod "90117049-e80e-4820-a934-392898e016ab" (UID: "90117049-e80e-4820-a934-392898e016ab"). InnerVolumeSpecName "kube-api-access-6pg55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:19:39.123115 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.123075    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-oauth-serving-cert\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:39.123115 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.123108    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-console-config\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:39.123115 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.123118    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:39.123115 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.123126    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90117049-e80e-4820-a934-392898e016ab-console-oauth-config\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:39.123379 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.123135    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pg55\" (UniqueName: \"kubernetes.io/projected/90117049-e80e-4820-a934-392898e016ab-kube-api-access-6pg55\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:39.123379 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.123144    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90117049-e80e-4820-a934-392898e016ab-console-serving-cert\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:39.123379 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.123152    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90117049-e80e-4820-a934-392898e016ab-trusted-ca-bundle\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:19:39.621917 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.621875    2580 generic.go:356] "Generic (PLEG): container finished" podID="90117049-e80e-4820-a934-392898e016ab" containerID="93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040" exitCode=0
Jul 27 20:19:39.622314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.621928    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58944b6757-8kbrj"
Jul 27 20:19:39.622314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.621959    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58944b6757-8kbrj" event={"ID":"90117049-e80e-4820-a934-392898e016ab","Type":"ContainerDied","Data":"93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040"}
Jul 27 20:19:39.622314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.622016    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58944b6757-8kbrj" event={"ID":"90117049-e80e-4820-a934-392898e016ab","Type":"ContainerDied","Data":"83909a2ebd334fc58dfda12f70b5b7e9952313d5083add154957a265d19620d2"}
Jul 27 20:19:39.622314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.622036    2580 scope.go:117] "RemoveContainer" containerID="93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040"
Jul 27 20:19:39.631056 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.631033    2580 scope.go:117] "RemoveContainer" containerID="93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040"
Jul 27 20:19:39.631336 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:19:39.631315    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040\": container with ID starting with 93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040 not found: ID does not exist" containerID="93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040"
Jul 27 20:19:39.631392 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.631350    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040"} err="failed to get container status \"93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040\": rpc error: code = NotFound desc = could not find container \"93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040\": container with ID starting with 93c81dbfda4129bd9700dd6a036091b6740604c00819e09db45c4a9f4fc19040 not found: ID does not exist"
Jul 27 20:19:39.642472 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.642444    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58944b6757-8kbrj"]
Jul 27 20:19:39.646370 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:39.646344    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58944b6757-8kbrj"]
Jul 27 20:19:40.901251 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:19:40.901206    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90117049-e80e-4820-a934-392898e016ab" path="/var/lib/kubelet/pods/90117049-e80e-4820-a934-392898e016ab/volumes"
Jul 27 20:20:14.710214 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.710176    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 20:20:14.710689 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.710483    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e44713-0b92-44af-bc65-2c56777d862f" containerName="registry"
Jul 27 20:20:14.710689 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.710494    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e44713-0b92-44af-bc65-2c56777d862f" containerName="registry"
Jul 27 20:20:14.710689 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.710504    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90117049-e80e-4820-a934-392898e016ab" containerName="console"
Jul 27 20:20:14.710689 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.710510    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="90117049-e80e-4820-a934-392898e016ab" containerName="console"
Jul 27 20:20:14.710689 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.710564    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9e44713-0b92-44af-bc65-2c56777d862f" containerName="registry"
Jul 27 20:20:14.710689 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.710574    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="90117049-e80e-4820-a934-392898e016ab" containerName="console"
Jul 27 20:20:14.715781 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.715761    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.718734 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.718705    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 20:20:14.718866 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.718705    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 20:20:14.718866 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.718784    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 20:20:14.718866 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.718706    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 20:20:14.718866 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.718706    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 20:20:14.719390 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.719371    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 20:20:14.719488 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.719457    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gq4qb\""
Jul 27 20:20:14.719715 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.719695    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 20:20:14.719846 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.719702    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 20:20:14.723846 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.723827    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 20:20:14.735535 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.735514    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 20:20:14.818332 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9409878d-b5e2-4d77-a911-0229753e6954-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.818332 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818340    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.818549 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.818549 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9409878d-b5e2-4d77-a911-0229753e6954-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.818549 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9409878d-b5e2-4d77-a911-0229753e6954-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.818549 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-web-config\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.818549 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw9zj\" (UniqueName: \"kubernetes.io/projected/9409878d-b5e2-4d77-a911-0229753e6954-kube-api-access-cw9zj\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.818728 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818559    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-config-volume\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.818728 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9409878d-b5e2-4d77-a911-0229753e6954-config-out\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.818728 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9409878d-b5e2-4d77-a911-0229753e6954-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.818728 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.818728 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.818728 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.818703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919393 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-web-config\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919393 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw9zj\" (UniqueName: \"kubernetes.io/projected/9409878d-b5e2-4d77-a911-0229753e6954-kube-api-access-cw9zj\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919588 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-config-volume\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919588 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9409878d-b5e2-4d77-a911-0229753e6954-config-out\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919588 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9409878d-b5e2-4d77-a911-0229753e6954-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919588 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919560    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919763 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919763 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919763 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9409878d-b5e2-4d77-a911-0229753e6954-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919994 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919799    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919994 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919994 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9409878d-b5e2-4d77-a911-0229753e6954-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.919994 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.919900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9409878d-b5e2-4d77-a911-0229753e6954-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.920213 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.920188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9409878d-b5e2-4d77-a911-0229753e6954-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.920993 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.920663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9409878d-b5e2-4d77-a911-0229753e6954-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.920993 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.920811    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9409878d-b5e2-4d77-a911-0229753e6954-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.922616 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.922565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-web-config\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.922862 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.922813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.922862 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.922819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.923164 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.923142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9409878d-b5e2-4d77-a911-0229753e6954-config-out\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.923645 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.923598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.924018 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.923995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9409878d-b5e2-4d77-a911-0229753e6954-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.924113 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.924025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.924113 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.924092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-config-volume\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.924325 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.924304    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9409878d-b5e2-4d77-a911-0229753e6954-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:14.929035 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:14.929016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw9zj\" (UniqueName: \"kubernetes.io/projected/9409878d-b5e2-4d77-a911-0229753e6954-kube-api-access-cw9zj\") pod \"alertmanager-main-0\" (UID: \"9409878d-b5e2-4d77-a911-0229753e6954\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:15.025911 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:15.025816    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:20:15.164593 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:15.164569    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 20:20:15.166299 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:20:15.166272    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9409878d_b5e2_4d77_a911_0229753e6954.slice/crio-482a12671359af2d71983ce8977dbc77e0fb8d2957adbf6031a0fb252eacfb1b WatchSource:0}: Error finding container 482a12671359af2d71983ce8977dbc77e0fb8d2957adbf6031a0fb252eacfb1b: Status 404 returned error can't find the container with id 482a12671359af2d71983ce8977dbc77e0fb8d2957adbf6031a0fb252eacfb1b
Jul 27 20:20:15.759882 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:15.759848    2580 generic.go:356] "Generic (PLEG): container finished" podID="9409878d-b5e2-4d77-a911-0229753e6954" containerID="6f50b618340ff469e751a048998f7afc8b2d6addfd0aef02988a86e91717178a" exitCode=0
Jul 27 20:20:15.760361 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:15.759942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9409878d-b5e2-4d77-a911-0229753e6954","Type":"ContainerDied","Data":"6f50b618340ff469e751a048998f7afc8b2d6addfd0aef02988a86e91717178a"}
Jul 27 20:20:15.760361 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:15.760049    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9409878d-b5e2-4d77-a911-0229753e6954","Type":"ContainerStarted","Data":"482a12671359af2d71983ce8977dbc77e0fb8d2957adbf6031a0fb252eacfb1b"}
Jul 27 20:20:17.771364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:17.771327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9409878d-b5e2-4d77-a911-0229753e6954","Type":"ContainerStarted","Data":"79246fc0c343162c330b6decb5dc9687817504ab8dd21cc191f6b3c92e2659aa"}
Jul 27 20:20:17.771735 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:17.771396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9409878d-b5e2-4d77-a911-0229753e6954","Type":"ContainerStarted","Data":"48e088382d42b9336ce7fcc14bae3c0efc196152b1ff9d508182c6287370304e"}
Jul 27 20:20:17.771735 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:17.771423    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9409878d-b5e2-4d77-a911-0229753e6954","Type":"ContainerStarted","Data":"5adc0b95de11ea6cbd3f3d0ad3ec35a898d316580da9633a8cba166b9f5543fc"}
Jul 27 20:20:17.771735 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:17.771449    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9409878d-b5e2-4d77-a911-0229753e6954","Type":"ContainerStarted","Data":"d880fd9662aa14e31ecc19930b5b39558afc08ed52ca7e56d3e5a671af9b7d33"}
Jul 27 20:20:17.771735 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:17.771472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9409878d-b5e2-4d77-a911-0229753e6954","Type":"ContainerStarted","Data":"d4fadaa66e4b8870e6f2213eacf0d617533abce588d1422b7fa6519fc2ab483c"}
Jul 27 20:20:18.779578 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:18.779539    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9409878d-b5e2-4d77-a911-0229753e6954","Type":"ContainerStarted","Data":"ff421acfa473ed128c45bdb1f9a18de42560c8992f3c6a9d56e4858a446a697d"}
Jul 27 20:20:18.808019 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:18.807961    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.174949226 podStartE2EDuration="4.807945532s" totalImagesPullingTime="2.619741135s" totalInitContainerRuntime="13.255171ms" isStatefulPod=false podCreationTimestamp="2026-07-27 20:20:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:20:18.806788737 +0000 UTC m=+174.462944081" watchObservedRunningTime="2026-07-27 20:20:18.807945532 +0000 UTC m=+174.464100874"
Jul 27 20:20:22.170406 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.170370    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56fdc9db94-s7jpp"]
Jul 27 20:20:22.174318 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.174296    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.184850 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.184817    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56fdc9db94-s7jpp"]
Jul 27 20:20:22.288075 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.288038    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-config\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.288247 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.288083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-oauth-serving-cert\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.288247 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.288143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-serving-cert\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.288247 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.288159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-service-ca\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.288247 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.288205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-oauth-config\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.288381 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.288247    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-trusted-ca-bundle\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.288381 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.288283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgbrp\" (UniqueName: \"kubernetes.io/projected/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-kube-api-access-xgbrp\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.389355 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.389317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-service-ca\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.389355 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.389361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-oauth-config\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.389598 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.389381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-trusted-ca-bundle\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.389598 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.389412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgbrp\" (UniqueName: \"kubernetes.io/projected/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-kube-api-access-xgbrp\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.389598 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.389458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-config\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.389598 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.389480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-oauth-serving-cert\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.389598 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.389534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-serving-cert\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.390297 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.390267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-service-ca\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.390382 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.390301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-config\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.390382 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.390356    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-oauth-serving-cert\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.390505 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.390487    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-trusted-ca-bundle\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.391928 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.391907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-serving-cert\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.392004 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.391960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-oauth-config\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.397795 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.397773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgbrp\" (UniqueName: \"kubernetes.io/projected/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-kube-api-access-xgbrp\") pod \"console-56fdc9db94-s7jpp\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") " pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.486450 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.486352    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:22.626098 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.626069    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56fdc9db94-s7jpp"]
Jul 27 20:20:22.628570 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:20:22.628539    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ea0967_ef40_4afb_a502_2bdbc9a3aea5.slice/crio-e1f8937ddd4722f8cb5f0dd2655c72aca4d50adf4e8d406ca2e5c14ba61def3d WatchSource:0}: Error finding container e1f8937ddd4722f8cb5f0dd2655c72aca4d50adf4e8d406ca2e5c14ba61def3d: Status 404 returned error can't find the container with id e1f8937ddd4722f8cb5f0dd2655c72aca4d50adf4e8d406ca2e5c14ba61def3d
Jul 27 20:20:22.797383 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.797347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56fdc9db94-s7jpp" event={"ID":"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5","Type":"ContainerStarted","Data":"052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568"}
Jul 27 20:20:22.797547 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.797395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56fdc9db94-s7jpp" event={"ID":"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5","Type":"ContainerStarted","Data":"e1f8937ddd4722f8cb5f0dd2655c72aca4d50adf4e8d406ca2e5c14ba61def3d"}
Jul 27 20:20:22.814728 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:22.814677    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56fdc9db94-s7jpp" podStartSLOduration=0.814660581 podStartE2EDuration="814.660581ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:20:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:20:22.814165657 +0000 UTC m=+178.470321001" watchObservedRunningTime="2026-07-27 20:20:22.814660581 +0000 UTC m=+178.470815923"
Jul 27 20:20:32.487378 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:32.487333    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:32.487797 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:32.487393    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:32.492139 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:32.492116    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:32.839869 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:32.839843    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:20:32.884069 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:32.884040    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f66ccffd-xszvx"]
Jul 27 20:20:57.907902 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:57.907843    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84f66ccffd-xszvx" podUID="c0977cf7-8700-4e21-ab71-88599709ff69" containerName="console" containerID="cri-o://0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68" gracePeriod=15
Jul 27 20:20:58.159422 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.159357    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:20:58.286980 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.286938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cmhb\" (UniqueName: \"kubernetes.io/projected/c0977cf7-8700-4e21-ab71-88599709ff69-kube-api-access-2cmhb\") pod \"c0977cf7-8700-4e21-ab71-88599709ff69\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") "
Jul 27 20:20:58.286980 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.286977    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0977cf7-8700-4e21-ab71-88599709ff69-console-oauth-config\") pod \"c0977cf7-8700-4e21-ab71-88599709ff69\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") "
Jul 27 20:20:58.287239 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.287001    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-service-ca\") pod \"c0977cf7-8700-4e21-ab71-88599709ff69\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") "
Jul 27 20:20:58.287239 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.287031    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-trusted-ca-bundle\") pod \"c0977cf7-8700-4e21-ab71-88599709ff69\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") "
Jul 27 20:20:58.287239 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.287063    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-console-config\") pod \"c0977cf7-8700-4e21-ab71-88599709ff69\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") "
Jul 27 20:20:58.287239 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.287172    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0977cf7-8700-4e21-ab71-88599709ff69-console-serving-cert\") pod \"c0977cf7-8700-4e21-ab71-88599709ff69\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") "
Jul 27 20:20:58.287441 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.287248    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-oauth-serving-cert\") pod \"c0977cf7-8700-4e21-ab71-88599709ff69\" (UID: \"c0977cf7-8700-4e21-ab71-88599709ff69\") "
Jul 27 20:20:58.287441 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.287428    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-console-config" (OuterVolumeSpecName: "console-config") pod "c0977cf7-8700-4e21-ab71-88599709ff69" (UID: "c0977cf7-8700-4e21-ab71-88599709ff69"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:20:58.287538 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.287467    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-service-ca" (OuterVolumeSpecName: "service-ca") pod "c0977cf7-8700-4e21-ab71-88599709ff69" (UID: "c0977cf7-8700-4e21-ab71-88599709ff69"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:20:58.287538 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.287479    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c0977cf7-8700-4e21-ab71-88599709ff69" (UID: "c0977cf7-8700-4e21-ab71-88599709ff69"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:20:58.287809 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.287783    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:20:58.287955 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.287814    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-trusted-ca-bundle\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:20:58.287955 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.287824    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-console-config\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:20:58.287955 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.287781    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c0977cf7-8700-4e21-ab71-88599709ff69" (UID: "c0977cf7-8700-4e21-ab71-88599709ff69"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:20:58.289270 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.289245    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0977cf7-8700-4e21-ab71-88599709ff69-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c0977cf7-8700-4e21-ab71-88599709ff69" (UID: "c0977cf7-8700-4e21-ab71-88599709ff69"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:20:58.289438 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.289420    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0977cf7-8700-4e21-ab71-88599709ff69-kube-api-access-2cmhb" (OuterVolumeSpecName: "kube-api-access-2cmhb") pod "c0977cf7-8700-4e21-ab71-88599709ff69" (UID: "c0977cf7-8700-4e21-ab71-88599709ff69"). InnerVolumeSpecName "kube-api-access-2cmhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:20:58.289498 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.289418    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0977cf7-8700-4e21-ab71-88599709ff69-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c0977cf7-8700-4e21-ab71-88599709ff69" (UID: "c0977cf7-8700-4e21-ab71-88599709ff69"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:20:58.389080 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.389041    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cmhb\" (UniqueName: \"kubernetes.io/projected/c0977cf7-8700-4e21-ab71-88599709ff69-kube-api-access-2cmhb\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:20:58.389080 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.389073    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0977cf7-8700-4e21-ab71-88599709ff69-console-oauth-config\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:20:58.389080 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.389082    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0977cf7-8700-4e21-ab71-88599709ff69-console-serving-cert\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:20:58.389080 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.389091    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0977cf7-8700-4e21-ab71-88599709ff69-oauth-serving-cert\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:20:58.935790 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.935741    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0977cf7-8700-4e21-ab71-88599709ff69" containerID="0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68" exitCode=0
Jul 27 20:20:58.935790 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.935796    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f66ccffd-xszvx"
Jul 27 20:20:58.936260 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.935847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f66ccffd-xszvx" event={"ID":"c0977cf7-8700-4e21-ab71-88599709ff69","Type":"ContainerDied","Data":"0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68"}
Jul 27 20:20:58.936260 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.935899    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f66ccffd-xszvx" event={"ID":"c0977cf7-8700-4e21-ab71-88599709ff69","Type":"ContainerDied","Data":"15ca2b30dce6f8e1fa08512533907f294be53c8e29c7e0dbed6cd2d84e3c9700"}
Jul 27 20:20:58.936260 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.935923    2580 scope.go:117] "RemoveContainer" containerID="0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68"
Jul 27 20:20:58.944214 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.944192    2580 scope.go:117] "RemoveContainer" containerID="0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68"
Jul 27 20:20:58.944515 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:20:58.944490    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68\": container with ID starting with 0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68 not found: ID does not exist" containerID="0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68"
Jul 27 20:20:58.944626 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.944522    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68"} err="failed to get container status \"0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68\": rpc error: code = NotFound desc = could not find container \"0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68\": container with ID starting with 0668bed55b5d5814f7c7e43c401391fcaaa85b94ea4bf3bdd14700567da3eb68 not found: ID does not exist"
Jul 27 20:20:58.951206 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.951176    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f66ccffd-xszvx"]
Jul 27 20:20:58.954884 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:20:58.954856    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84f66ccffd-xszvx"]
Jul 27 20:21:00.900850 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:00.900815    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0977cf7-8700-4e21-ab71-88599709ff69" path="/var/lib/kubelet/pods/c0977cf7-8700-4e21-ab71-88599709ff69/volumes"
Jul 27 20:21:19.912894 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:19.912858    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"]
Jul 27 20:21:19.913252 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:19.913142    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0977cf7-8700-4e21-ab71-88599709ff69" containerName="console"
Jul 27 20:21:19.913252 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:19.913152    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0977cf7-8700-4e21-ab71-88599709ff69" containerName="console"
Jul 27 20:21:19.913252 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:19.913214    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0977cf7-8700-4e21-ab71-88599709ff69" containerName="console"
Jul 27 20:21:19.916429 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:19.916412    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:19.918938 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:19.918912    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:21:19.919725 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:19.919703    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k9dcq\""
Jul 27 20:21:19.919725 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:19.919720    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:21:19.925063 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:19.925038    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"]
Jul 27 20:21:20.079382 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:20.079345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20d2fc27-36fb-47ad-a609-af1c6646d0ff-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz\" (UID: \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:20.079579 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:20.079391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20d2fc27-36fb-47ad-a609-af1c6646d0ff-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz\" (UID: \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:20.079579 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:20.079489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxz9n\" (UniqueName: \"kubernetes.io/projected/20d2fc27-36fb-47ad-a609-af1c6646d0ff-kube-api-access-cxz9n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz\" (UID: \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:20.180312 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:20.180213    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxz9n\" (UniqueName: \"kubernetes.io/projected/20d2fc27-36fb-47ad-a609-af1c6646d0ff-kube-api-access-cxz9n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz\" (UID: \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:20.180312 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:20.180281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20d2fc27-36fb-47ad-a609-af1c6646d0ff-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz\" (UID: \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:20.180523 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:20.180317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20d2fc27-36fb-47ad-a609-af1c6646d0ff-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz\" (UID: \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:20.180772 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:20.180728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20d2fc27-36fb-47ad-a609-af1c6646d0ff-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz\" (UID: \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:20.180851 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:20.180742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20d2fc27-36fb-47ad-a609-af1c6646d0ff-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz\" (UID: \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:20.188668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:20.188644    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxz9n\" (UniqueName: \"kubernetes.io/projected/20d2fc27-36fb-47ad-a609-af1c6646d0ff-kube-api-access-cxz9n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz\" (UID: \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:20.225638 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:20.225611    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:20.355653 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:20.355626    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"]
Jul 27 20:21:20.358401 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:21:20.358376    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d2fc27_36fb_47ad_a609_af1c6646d0ff.slice/crio-44df8b7e076ce28bd69f5ca23667cf8449ad1750c5ba5a19bdcc2ed228706628 WatchSource:0}: Error finding container 44df8b7e076ce28bd69f5ca23667cf8449ad1750c5ba5a19bdcc2ed228706628: Status 404 returned error can't find the container with id 44df8b7e076ce28bd69f5ca23667cf8449ad1750c5ba5a19bdcc2ed228706628
Jul 27 20:21:21.044393 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:21.044352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz" event={"ID":"20d2fc27-36fb-47ad-a609-af1c6646d0ff","Type":"ContainerStarted","Data":"44df8b7e076ce28bd69f5ca23667cf8449ad1750c5ba5a19bdcc2ed228706628"}
Jul 27 20:21:27.074953 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:27.074909    2580 generic.go:356] "Generic (PLEG): container finished" podID="20d2fc27-36fb-47ad-a609-af1c6646d0ff" containerID="370080d22070497542208ba1090fe2457a13134d233628a5f629f7fb00c93a56" exitCode=0
Jul 27 20:21:27.075361 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:27.074994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz" event={"ID":"20d2fc27-36fb-47ad-a609-af1c6646d0ff","Type":"ContainerDied","Data":"370080d22070497542208ba1090fe2457a13134d233628a5f629f7fb00c93a56"}
Jul 27 20:21:30.089301 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:30.089263    2580 generic.go:356] "Generic (PLEG): container finished" podID="20d2fc27-36fb-47ad-a609-af1c6646d0ff" containerID="f4e409a4a6c3e77c922a46f545cd74de774f10dac4c231f050c1a3c6e4bc806d" exitCode=0
Jul 27 20:21:30.089763 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:30.089349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz" event={"ID":"20d2fc27-36fb-47ad-a609-af1c6646d0ff","Type":"ContainerDied","Data":"f4e409a4a6c3e77c922a46f545cd74de774f10dac4c231f050c1a3c6e4bc806d"}
Jul 27 20:21:37.121555 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:37.121521    2580 generic.go:356] "Generic (PLEG): container finished" podID="20d2fc27-36fb-47ad-a609-af1c6646d0ff" containerID="c3941ecec178a2e379c323adcc616321f546af899b86d959cdde256fac9e4f71" exitCode=0
Jul 27 20:21:37.121942 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:37.121599    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz" event={"ID":"20d2fc27-36fb-47ad-a609-af1c6646d0ff","Type":"ContainerDied","Data":"c3941ecec178a2e379c323adcc616321f546af899b86d959cdde256fac9e4f71"}
Jul 27 20:21:38.254920 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:38.254890    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:38.339021 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:38.338984    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20d2fc27-36fb-47ad-a609-af1c6646d0ff-bundle\") pod \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\" (UID: \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\") "
Jul 27 20:21:38.339198 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:38.339045    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20d2fc27-36fb-47ad-a609-af1c6646d0ff-util\") pod \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\" (UID: \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\") "
Jul 27 20:21:38.339198 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:38.339066    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxz9n\" (UniqueName: \"kubernetes.io/projected/20d2fc27-36fb-47ad-a609-af1c6646d0ff-kube-api-access-cxz9n\") pod \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\" (UID: \"20d2fc27-36fb-47ad-a609-af1c6646d0ff\") "
Jul 27 20:21:38.339691 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:38.339657    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d2fc27-36fb-47ad-a609-af1c6646d0ff-bundle" (OuterVolumeSpecName: "bundle") pod "20d2fc27-36fb-47ad-a609-af1c6646d0ff" (UID: "20d2fc27-36fb-47ad-a609-af1c6646d0ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:38.341332 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:38.341304    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d2fc27-36fb-47ad-a609-af1c6646d0ff-kube-api-access-cxz9n" (OuterVolumeSpecName: "kube-api-access-cxz9n") pod "20d2fc27-36fb-47ad-a609-af1c6646d0ff" (UID: "20d2fc27-36fb-47ad-a609-af1c6646d0ff"). InnerVolumeSpecName "kube-api-access-cxz9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:21:38.344357 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:38.344328    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d2fc27-36fb-47ad-a609-af1c6646d0ff-util" (OuterVolumeSpecName: "util") pod "20d2fc27-36fb-47ad-a609-af1c6646d0ff" (UID: "20d2fc27-36fb-47ad-a609-af1c6646d0ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:38.440443 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:38.440347    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20d2fc27-36fb-47ad-a609-af1c6646d0ff-util\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:21:38.440443 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:38.440381    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxz9n\" (UniqueName: \"kubernetes.io/projected/20d2fc27-36fb-47ad-a609-af1c6646d0ff-kube-api-access-cxz9n\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:21:38.440443 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:38.440393    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20d2fc27-36fb-47ad-a609-af1c6646d0ff-bundle\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:21:39.131308 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:39.131276    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz"
Jul 27 20:21:39.131308 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:39.131290    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mrclz" event={"ID":"20d2fc27-36fb-47ad-a609-af1c6646d0ff","Type":"ContainerDied","Data":"44df8b7e076ce28bd69f5ca23667cf8449ad1750c5ba5a19bdcc2ed228706628"}
Jul 27 20:21:39.131512 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:39.131367    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44df8b7e076ce28bd69f5ca23667cf8449ad1750c5ba5a19bdcc2ed228706628"
Jul 27 20:21:42.770116 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.770083    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4"]
Jul 27 20:21:42.770510 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.770419    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d2fc27-36fb-47ad-a609-af1c6646d0ff" containerName="pull"
Jul 27 20:21:42.770510 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.770431    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d2fc27-36fb-47ad-a609-af1c6646d0ff" containerName="pull"
Jul 27 20:21:42.770510 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.770439    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d2fc27-36fb-47ad-a609-af1c6646d0ff" containerName="extract"
Jul 27 20:21:42.770510 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.770444    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d2fc27-36fb-47ad-a609-af1c6646d0ff" containerName="extract"
Jul 27 20:21:42.770510 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.770458    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d2fc27-36fb-47ad-a609-af1c6646d0ff" containerName="util"
Jul 27 20:21:42.770510 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.770463    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d2fc27-36fb-47ad-a609-af1c6646d0ff" containerName="util"
Jul 27 20:21:42.770716 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.770529    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="20d2fc27-36fb-47ad-a609-af1c6646d0ff" containerName="extract"
Jul 27 20:21:42.804215 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.804183    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4"]
Jul 27 20:21:42.804363 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.804287    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4"
Jul 27 20:21:42.806850 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.806825    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:21:42.807041 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.806853    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 20:21:42.807041 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.806891    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cppr6\""
Jul 27 20:21:42.878017 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.877974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6061c9cd-b593-4ae1-a3e7-6404f0c337c0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j8zx4\" (UID: \"6061c9cd-b593-4ae1-a3e7-6404f0c337c0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4"
Jul 27 20:21:42.878204 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.878056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jxw4\" (UniqueName: \"kubernetes.io/projected/6061c9cd-b593-4ae1-a3e7-6404f0c337c0-kube-api-access-2jxw4\") pod \"cert-manager-operator-controller-manager-55c444bf86-j8zx4\" (UID: \"6061c9cd-b593-4ae1-a3e7-6404f0c337c0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4"
Jul 27 20:21:42.978869 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.978827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6061c9cd-b593-4ae1-a3e7-6404f0c337c0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j8zx4\" (UID: \"6061c9cd-b593-4ae1-a3e7-6404f0c337c0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4"
Jul 27 20:21:42.979053 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.978925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jxw4\" (UniqueName: \"kubernetes.io/projected/6061c9cd-b593-4ae1-a3e7-6404f0c337c0-kube-api-access-2jxw4\") pod \"cert-manager-operator-controller-manager-55c444bf86-j8zx4\" (UID: \"6061c9cd-b593-4ae1-a3e7-6404f0c337c0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4"
Jul 27 20:21:42.979325 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.979305    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6061c9cd-b593-4ae1-a3e7-6404f0c337c0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j8zx4\" (UID: \"6061c9cd-b593-4ae1-a3e7-6404f0c337c0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4"
Jul 27 20:21:42.986736 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:42.986700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jxw4\" (UniqueName: \"kubernetes.io/projected/6061c9cd-b593-4ae1-a3e7-6404f0c337c0-kube-api-access-2jxw4\") pod \"cert-manager-operator-controller-manager-55c444bf86-j8zx4\" (UID: \"6061c9cd-b593-4ae1-a3e7-6404f0c337c0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4"
Jul 27 20:21:43.113708 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:43.113671    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4"
Jul 27 20:21:43.261244 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:43.261218    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4"]
Jul 27 20:21:43.263817 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:21:43.263788    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6061c9cd_b593_4ae1_a3e7_6404f0c337c0.slice/crio-0b6385b6c7cbdd81d9aa760dff20244ed976c7b5f85492bdfe61770c7deff23f WatchSource:0}: Error finding container 0b6385b6c7cbdd81d9aa760dff20244ed976c7b5f85492bdfe61770c7deff23f: Status 404 returned error can't find the container with id 0b6385b6c7cbdd81d9aa760dff20244ed976c7b5f85492bdfe61770c7deff23f
Jul 27 20:21:44.156155 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:44.156112    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4" event={"ID":"6061c9cd-b593-4ae1-a3e7-6404f0c337c0","Type":"ContainerStarted","Data":"0b6385b6c7cbdd81d9aa760dff20244ed976c7b5f85492bdfe61770c7deff23f"}
Jul 27 20:21:45.168138 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:45.168098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4" event={"ID":"6061c9cd-b593-4ae1-a3e7-6404f0c337c0","Type":"ContainerStarted","Data":"1c7e4f809429d9e61346bcf90e842dd5902603b377e381c53271c47dc87902cf"}
Jul 27 20:21:45.203259 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:45.203194    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j8zx4" podStartSLOduration=1.694499113 podStartE2EDuration="3.203172548s" totalImagesPullingTime="1.508673435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:21:45.201587909 +0000 UTC m=+260.857743272" watchObservedRunningTime="2026-07-27 20:21:45.203172548 +0000 UTC m=+260.859327892"
Jul 27 20:21:47.098581 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.098499    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"]
Jul 27 20:21:47.100984 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.100960    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:47.103343 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.103319    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:21:47.103343 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.103339    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:21:47.104036 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.104016    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k9dcq\""
Jul 27 20:21:47.112542 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.112515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"]
Jul 27 20:21:47.214606 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.214569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kh2c\" (UniqueName: \"kubernetes.io/projected/bc524101-fd9a-439d-a292-018a6122b953-kube-api-access-2kh2c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms\" (UID: \"bc524101-fd9a-439d-a292-018a6122b953\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:47.214820 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.214616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc524101-fd9a-439d-a292-018a6122b953-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms\" (UID: \"bc524101-fd9a-439d-a292-018a6122b953\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:47.214820 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.214644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc524101-fd9a-439d-a292-018a6122b953-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms\" (UID: \"bc524101-fd9a-439d-a292-018a6122b953\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:47.315347 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.315304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kh2c\" (UniqueName: \"kubernetes.io/projected/bc524101-fd9a-439d-a292-018a6122b953-kube-api-access-2kh2c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms\" (UID: \"bc524101-fd9a-439d-a292-018a6122b953\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:47.315347 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.315354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc524101-fd9a-439d-a292-018a6122b953-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms\" (UID: \"bc524101-fd9a-439d-a292-018a6122b953\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:47.315604 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.315388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc524101-fd9a-439d-a292-018a6122b953-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms\" (UID: \"bc524101-fd9a-439d-a292-018a6122b953\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:47.315713 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.315690    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc524101-fd9a-439d-a292-018a6122b953-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms\" (UID: \"bc524101-fd9a-439d-a292-018a6122b953\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:47.315805 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.315763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc524101-fd9a-439d-a292-018a6122b953-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms\" (UID: \"bc524101-fd9a-439d-a292-018a6122b953\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:47.323832 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.323805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kh2c\" (UniqueName: \"kubernetes.io/projected/bc524101-fd9a-439d-a292-018a6122b953-kube-api-access-2kh2c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms\" (UID: \"bc524101-fd9a-439d-a292-018a6122b953\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:47.409851 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.409739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:47.540438 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:47.540410    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"]
Jul 27 20:21:47.543032 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:21:47.543006    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc524101_fd9a_439d_a292_018a6122b953.slice/crio-1bad5e13cbde9b56ce7b403ecbe2de694c5f65496dac6090fa56811b20db9000 WatchSource:0}: Error finding container 1bad5e13cbde9b56ce7b403ecbe2de694c5f65496dac6090fa56811b20db9000: Status 404 returned error can't find the container with id 1bad5e13cbde9b56ce7b403ecbe2de694c5f65496dac6090fa56811b20db9000
Jul 27 20:21:48.184221 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.184183    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc524101-fd9a-439d-a292-018a6122b953" containerID="69ba3cf187f408ebd693d6e072fef1b6018c5d59341252a77ba5d293d2dc28c1" exitCode=0
Jul 27 20:21:48.184668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.184253    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms" event={"ID":"bc524101-fd9a-439d-a292-018a6122b953","Type":"ContainerDied","Data":"69ba3cf187f408ebd693d6e072fef1b6018c5d59341252a77ba5d293d2dc28c1"}
Jul 27 20:21:48.184668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.184292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms" event={"ID":"bc524101-fd9a-439d-a292-018a6122b953","Type":"ContainerStarted","Data":"1bad5e13cbde9b56ce7b403ecbe2de694c5f65496dac6090fa56811b20db9000"}
Jul 27 20:21:48.332632 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.332603    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dd48z"]
Jul 27 20:21:48.334695 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.334678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z"
Jul 27 20:21:48.337291 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.337269    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nflrp\""
Jul 27 20:21:48.337470 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.337451    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 20:21:48.337547 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.337529    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 20:21:48.346470 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.346446    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dd48z"]
Jul 27 20:21:48.425068 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.425027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dnpp\" (UniqueName: \"kubernetes.io/projected/c056c813-60a7-4a8a-b13f-fd5fbd7dbae7-kube-api-access-9dnpp\") pod \"cert-manager-webhook-6486ffd997-dd48z\" (UID: \"c056c813-60a7-4a8a-b13f-fd5fbd7dbae7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z"
Jul 27 20:21:48.425068 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.425074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c056c813-60a7-4a8a-b13f-fd5fbd7dbae7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dd48z\" (UID: \"c056c813-60a7-4a8a-b13f-fd5fbd7dbae7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z"
Jul 27 20:21:48.526370 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.526240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c056c813-60a7-4a8a-b13f-fd5fbd7dbae7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dd48z\" (UID: \"c056c813-60a7-4a8a-b13f-fd5fbd7dbae7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z"
Jul 27 20:21:48.526370 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.526325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dnpp\" (UniqueName: \"kubernetes.io/projected/c056c813-60a7-4a8a-b13f-fd5fbd7dbae7-kube-api-access-9dnpp\") pod \"cert-manager-webhook-6486ffd997-dd48z\" (UID: \"c056c813-60a7-4a8a-b13f-fd5fbd7dbae7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z"
Jul 27 20:21:48.535378 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.535349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c056c813-60a7-4a8a-b13f-fd5fbd7dbae7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dd48z\" (UID: \"c056c813-60a7-4a8a-b13f-fd5fbd7dbae7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z"
Jul 27 20:21:48.535592 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.535571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dnpp\" (UniqueName: \"kubernetes.io/projected/c056c813-60a7-4a8a-b13f-fd5fbd7dbae7-kube-api-access-9dnpp\") pod \"cert-manager-webhook-6486ffd997-dd48z\" (UID: \"c056c813-60a7-4a8a-b13f-fd5fbd7dbae7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z"
Jul 27 20:21:48.659538 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.659499    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z"
Jul 27 20:21:48.786577 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:48.786536    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dd48z"]
Jul 27 20:21:48.792566 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:21:48.792539    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc056c813_60a7_4a8a_b13f_fd5fbd7dbae7.slice/crio-ed66f9a39717176807e89d4d12bbb1150a82a7572765f354b5fc653241d5563b WatchSource:0}: Error finding container ed66f9a39717176807e89d4d12bbb1150a82a7572765f354b5fc653241d5563b: Status 404 returned error can't find the container with id ed66f9a39717176807e89d4d12bbb1150a82a7572765f354b5fc653241d5563b
Jul 27 20:21:49.189974 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:49.189881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z" event={"ID":"c056c813-60a7-4a8a-b13f-fd5fbd7dbae7","Type":"ContainerStarted","Data":"ed66f9a39717176807e89d4d12bbb1150a82a7572765f354b5fc653241d5563b"}
Jul 27 20:21:52.207366 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:52.207321    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc524101-fd9a-439d-a292-018a6122b953" containerID="a176241fef97bb91aef1135ed113dc3580bdbd717775f0d636863e1257938b14" exitCode=0
Jul 27 20:21:52.207842 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:52.207399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms" event={"ID":"bc524101-fd9a-439d-a292-018a6122b953","Type":"ContainerDied","Data":"a176241fef97bb91aef1135ed113dc3580bdbd717775f0d636863e1257938b14"}
Jul 27 20:21:52.209145 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:52.209111    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z" event={"ID":"c056c813-60a7-4a8a-b13f-fd5fbd7dbae7","Type":"ContainerStarted","Data":"89df8f6494a2f1323f4eae023ad85e9a2e7d2bce2aab3a2e2bfac1b4c36bef64"}
Jul 27 20:21:52.209255 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:52.209244    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z"
Jul 27 20:21:52.240468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:52.240423    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z" podStartSLOduration=1.389484288 podStartE2EDuration="4.240406394s" totalImagesPullingTime="2.850922106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:21:52.239277091 +0000 UTC m=+267.895432436" watchObservedRunningTime="2026-07-27 20:21:52.240406394 +0000 UTC m=+267.896561736"
Jul 27 20:21:53.215174 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:53.215136    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc524101-fd9a-439d-a292-018a6122b953" containerID="75352ede2a6b17c7733ef09bf64528e25158962f2bac75a7d797f26a9a2f99a8" exitCode=0
Jul 27 20:21:53.215610 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:53.215226    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms" event={"ID":"bc524101-fd9a-439d-a292-018a6122b953","Type":"ContainerDied","Data":"75352ede2a6b17c7733ef09bf64528e25158962f2bac75a7d797f26a9a2f99a8"}
Jul 27 20:21:54.348342 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:54.348318    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:54.480741 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:54.480648    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc524101-fd9a-439d-a292-018a6122b953-util\") pod \"bc524101-fd9a-439d-a292-018a6122b953\" (UID: \"bc524101-fd9a-439d-a292-018a6122b953\") "
Jul 27 20:21:54.480741 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:54.480712    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc524101-fd9a-439d-a292-018a6122b953-bundle\") pod \"bc524101-fd9a-439d-a292-018a6122b953\" (UID: \"bc524101-fd9a-439d-a292-018a6122b953\") "
Jul 27 20:21:54.480999 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:54.480782    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kh2c\" (UniqueName: \"kubernetes.io/projected/bc524101-fd9a-439d-a292-018a6122b953-kube-api-access-2kh2c\") pod \"bc524101-fd9a-439d-a292-018a6122b953\" (UID: \"bc524101-fd9a-439d-a292-018a6122b953\") "
Jul 27 20:21:54.481114 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:54.481091    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc524101-fd9a-439d-a292-018a6122b953-bundle" (OuterVolumeSpecName: "bundle") pod "bc524101-fd9a-439d-a292-018a6122b953" (UID: "bc524101-fd9a-439d-a292-018a6122b953"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:54.482796 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:54.482773    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc524101-fd9a-439d-a292-018a6122b953-kube-api-access-2kh2c" (OuterVolumeSpecName: "kube-api-access-2kh2c") pod "bc524101-fd9a-439d-a292-018a6122b953" (UID: "bc524101-fd9a-439d-a292-018a6122b953"). InnerVolumeSpecName "kube-api-access-2kh2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:21:54.485083 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:54.485059    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc524101-fd9a-439d-a292-018a6122b953-util" (OuterVolumeSpecName: "util") pod "bc524101-fd9a-439d-a292-018a6122b953" (UID: "bc524101-fd9a-439d-a292-018a6122b953"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:54.581510 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:54.581462    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kh2c\" (UniqueName: \"kubernetes.io/projected/bc524101-fd9a-439d-a292-018a6122b953-kube-api-access-2kh2c\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:21:54.581510 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:54.581503    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc524101-fd9a-439d-a292-018a6122b953-util\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:21:54.581510 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:54.581513    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc524101-fd9a-439d-a292-018a6122b953-bundle\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:21:55.225907 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.225824    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms"
Jul 27 20:21:55.226059 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.225816    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2vms" event={"ID":"bc524101-fd9a-439d-a292-018a6122b953","Type":"ContainerDied","Data":"1bad5e13cbde9b56ce7b403ecbe2de694c5f65496dac6090fa56811b20db9000"}
Jul 27 20:21:55.226059 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.225950    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bad5e13cbde9b56ce7b403ecbe2de694c5f65496dac6090fa56811b20db9000"
Jul 27 20:21:55.905881 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.905842    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-drg77"]
Jul 27 20:21:55.906275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.906174    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc524101-fd9a-439d-a292-018a6122b953" containerName="extract"
Jul 27 20:21:55.906275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.906187    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc524101-fd9a-439d-a292-018a6122b953" containerName="extract"
Jul 27 20:21:55.906275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.906198    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc524101-fd9a-439d-a292-018a6122b953" containerName="util"
Jul 27 20:21:55.906275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.906206    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc524101-fd9a-439d-a292-018a6122b953" containerName="util"
Jul 27 20:21:55.906275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.906218    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc524101-fd9a-439d-a292-018a6122b953" containerName="pull"
Jul 27 20:21:55.906275 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.906225    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc524101-fd9a-439d-a292-018a6122b953" containerName="pull"
Jul 27 20:21:55.906484 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.906282    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc524101-fd9a-439d-a292-018a6122b953" containerName="extract"
Jul 27 20:21:55.908125 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.908108    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-drg77"
Jul 27 20:21:55.910329 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.910313    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-g6pc9\""
Jul 27 20:21:55.916720 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.916697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-drg77"]
Jul 27 20:21:55.993678 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.993642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ae75121-6887-4b4e-b35a-43b55d0f6926-bound-sa-token\") pod \"cert-manager-55b4d954d5-drg77\" (UID: \"1ae75121-6887-4b4e-b35a-43b55d0f6926\") " pod="cert-manager/cert-manager-55b4d954d5-drg77"
Jul 27 20:21:55.993877 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:55.993715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbr6m\" (UniqueName: \"kubernetes.io/projected/1ae75121-6887-4b4e-b35a-43b55d0f6926-kube-api-access-sbr6m\") pod \"cert-manager-55b4d954d5-drg77\" (UID: \"1ae75121-6887-4b4e-b35a-43b55d0f6926\") " pod="cert-manager/cert-manager-55b4d954d5-drg77"
Jul 27 20:21:56.095166 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:56.095131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbr6m\" (UniqueName: \"kubernetes.io/projected/1ae75121-6887-4b4e-b35a-43b55d0f6926-kube-api-access-sbr6m\") pod \"cert-manager-55b4d954d5-drg77\" (UID: \"1ae75121-6887-4b4e-b35a-43b55d0f6926\") " pod="cert-manager/cert-manager-55b4d954d5-drg77"
Jul 27 20:21:56.095338 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:56.095276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ae75121-6887-4b4e-b35a-43b55d0f6926-bound-sa-token\") pod \"cert-manager-55b4d954d5-drg77\" (UID: \"1ae75121-6887-4b4e-b35a-43b55d0f6926\") " pod="cert-manager/cert-manager-55b4d954d5-drg77"
Jul 27 20:21:56.102988 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:56.102958    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ae75121-6887-4b4e-b35a-43b55d0f6926-bound-sa-token\") pod \"cert-manager-55b4d954d5-drg77\" (UID: \"1ae75121-6887-4b4e-b35a-43b55d0f6926\") " pod="cert-manager/cert-manager-55b4d954d5-drg77"
Jul 27 20:21:56.103122 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:56.103105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbr6m\" (UniqueName: \"kubernetes.io/projected/1ae75121-6887-4b4e-b35a-43b55d0f6926-kube-api-access-sbr6m\") pod \"cert-manager-55b4d954d5-drg77\" (UID: \"1ae75121-6887-4b4e-b35a-43b55d0f6926\") " pod="cert-manager/cert-manager-55b4d954d5-drg77"
Jul 27 20:21:56.216937 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:56.216844    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-drg77"
Jul 27 20:21:56.342227 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:56.342202    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-drg77"]
Jul 27 20:21:56.344419 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:21:56.344391    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ae75121_6887_4b4e_b35a_43b55d0f6926.slice/crio-61397c340ce75cba1574638f2ebc33565e0ec34b43277b89515ec0d5dd600676 WatchSource:0}: Error finding container 61397c340ce75cba1574638f2ebc33565e0ec34b43277b89515ec0d5dd600676: Status 404 returned error can't find the container with id 61397c340ce75cba1574638f2ebc33565e0ec34b43277b89515ec0d5dd600676
Jul 27 20:21:57.236261 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:57.236224    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-drg77" event={"ID":"1ae75121-6887-4b4e-b35a-43b55d0f6926","Type":"ContainerStarted","Data":"7c9cc9e9bfa8478bbfab426658298ee06a662fcece7a30d96dd3aa7b215ec0bf"}
Jul 27 20:21:57.236261 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:57.236268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-drg77" event={"ID":"1ae75121-6887-4b4e-b35a-43b55d0f6926","Type":"ContainerStarted","Data":"61397c340ce75cba1574638f2ebc33565e0ec34b43277b89515ec0d5dd600676"}
Jul 27 20:21:57.252051 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:57.252003    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-drg77" podStartSLOduration=2.251988819 podStartE2EDuration="2.251988819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:21:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:21:57.250421639 +0000 UTC m=+272.906576993" watchObservedRunningTime="2026-07-27 20:21:57.251988819 +0000 UTC m=+272.908144161"
Jul 27 20:21:58.218007 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:21:58.217971    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dd48z"
Jul 27 20:22:11.166735 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.166698    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"]
Jul 27 20:22:11.187520 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.187480    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"]
Jul 27 20:22:11.187668 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.187610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:11.190204 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.190184    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:22:11.190343 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.190300    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:22:11.191104 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.191078    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k9dcq\""
Jul 27 20:22:11.330765 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.330706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wd8p\" (UniqueName: \"kubernetes.io/projected/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-kube-api-access-2wd8p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv\" (UID: \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:11.330982 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.330851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv\" (UID: \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:11.330982 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.330893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv\" (UID: \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:11.432232 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.432140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv\" (UID: \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:11.432232 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.432184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv\" (UID: \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:11.432455 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.432250    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wd8p\" (UniqueName: \"kubernetes.io/projected/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-kube-api-access-2wd8p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv\" (UID: \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:11.432543 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.432521    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv\" (UID: \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:11.432601 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.432553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv\" (UID: \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:11.451948 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.451916    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wd8p\" (UniqueName: \"kubernetes.io/projected/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-kube-api-access-2wd8p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv\" (UID: \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:11.497419 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.497389    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:11.635587 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:11.635556    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"]
Jul 27 20:22:11.637906 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:22:11.637873    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804a49ab_b2c8_4c72_bfdf_3fbd590ed79b.slice/crio-11fcb351c8c09c0bfcb5669acebcbe40a989384f92f2595322a7849e23616ad8 WatchSource:0}: Error finding container 11fcb351c8c09c0bfcb5669acebcbe40a989384f92f2595322a7849e23616ad8: Status 404 returned error can't find the container with id 11fcb351c8c09c0bfcb5669acebcbe40a989384f92f2595322a7849e23616ad8
Jul 27 20:22:12.311133 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:12.311099    2580 generic.go:356] "Generic (PLEG): container finished" podID="804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" containerID="9bfa33d2039a128c4af0145516a0ac98e90ab458197f2d516347e80028639317" exitCode=0
Jul 27 20:22:12.311605 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:12.311145    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv" event={"ID":"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b","Type":"ContainerDied","Data":"9bfa33d2039a128c4af0145516a0ac98e90ab458197f2d516347e80028639317"}
Jul 27 20:22:12.311605 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:12.311182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv" event={"ID":"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b","Type":"ContainerStarted","Data":"11fcb351c8c09c0bfcb5669acebcbe40a989384f92f2595322a7849e23616ad8"}
Jul 27 20:22:13.317278 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:13.317176    2580 generic.go:356] "Generic (PLEG): container finished" podID="804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" containerID="ef49dd51aeb9fad95db3d99df19579da661cf02765c2e01759f080c1ef476484" exitCode=0
Jul 27 20:22:13.317278 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:13.317238    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv" event={"ID":"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b","Type":"ContainerDied","Data":"ef49dd51aeb9fad95db3d99df19579da661cf02765c2e01759f080c1ef476484"}
Jul 27 20:22:14.323921 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:14.323880    2580 generic.go:356] "Generic (PLEG): container finished" podID="804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" containerID="95faa15468930b7a079d00f91166a579742fde7eeca1f245db363bb302049192" exitCode=0
Jul 27 20:22:14.324385 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:14.323972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv" event={"ID":"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b","Type":"ContainerDied","Data":"95faa15468930b7a079d00f91166a579742fde7eeca1f245db363bb302049192"}
Jul 27 20:22:15.462742 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:15.462716    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:15.567179 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:15.567137    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wd8p\" (UniqueName: \"kubernetes.io/projected/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-kube-api-access-2wd8p\") pod \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\" (UID: \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\") "
Jul 27 20:22:15.567179 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:15.567180    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-bundle\") pod \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\" (UID: \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\") "
Jul 27 20:22:15.567391 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:15.567204    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-util\") pod \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\" (UID: \"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b\") "
Jul 27 20:22:15.567930 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:15.567897    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-bundle" (OuterVolumeSpecName: "bundle") pod "804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" (UID: "804a49ab-b2c8-4c72-bfdf-3fbd590ed79b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:15.569270 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:15.569243    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-kube-api-access-2wd8p" (OuterVolumeSpecName: "kube-api-access-2wd8p") pod "804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" (UID: "804a49ab-b2c8-4c72-bfdf-3fbd590ed79b"). InnerVolumeSpecName "kube-api-access-2wd8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:22:15.572930 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:15.572897    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-util" (OuterVolumeSpecName: "util") pod "804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" (UID: "804a49ab-b2c8-4c72-bfdf-3fbd590ed79b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:15.668822 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:15.668713    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wd8p\" (UniqueName: \"kubernetes.io/projected/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-kube-api-access-2wd8p\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:22:15.668822 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:15.668763    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-bundle\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:22:15.668822 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:15.668778    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/804a49ab-b2c8-4c72-bfdf-3fbd590ed79b-util\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:22:16.335081 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:16.335045    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv"
Jul 27 20:22:16.335081 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:16.335060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkswqv" event={"ID":"804a49ab-b2c8-4c72-bfdf-3fbd590ed79b","Type":"ContainerDied","Data":"11fcb351c8c09c0bfcb5669acebcbe40a989384f92f2595322a7849e23616ad8"}
Jul 27 20:22:16.335311 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:16.335117    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11fcb351c8c09c0bfcb5669acebcbe40a989384f92f2595322a7849e23616ad8"
Jul 27 20:22:22.657422 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.657390    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"]
Jul 27 20:22:22.657885 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.657805    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" containerName="pull"
Jul 27 20:22:22.657885 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.657824    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" containerName="pull"
Jul 27 20:22:22.657885 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.657834    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" containerName="extract"
Jul 27 20:22:22.657885 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.657840    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" containerName="extract"
Jul 27 20:22:22.657885 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.657848    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" containerName="util"
Jul 27 20:22:22.657885 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.657854    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" containerName="util"
Jul 27 20:22:22.658155 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.657917    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="804a49ab-b2c8-4c72-bfdf-3fbd590ed79b" containerName="extract"
Jul 27 20:22:22.662010 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.661992    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.666466 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.666443    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 20:22:22.666684 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.666662    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 20:22:22.666684 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.666675    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 20:22:22.666864 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.666675    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 20:22:22.666864 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.666672    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jw6l6\""
Jul 27 20:22:22.709053 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.709015    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"]
Jul 27 20:22:22.722687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.722658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e71996de-f400-4bf6-9103-c7edf7801c24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.722845 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.722692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e71996de-f400-4bf6-9103-c7edf7801c24-manifests\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.722845 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.722721    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldxxw\" (UniqueName: \"kubernetes.io/projected/e71996de-f400-4bf6-9103-c7edf7801c24-kube-api-access-ldxxw\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.722845 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.722797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e71996de-f400-4bf6-9103-c7edf7801c24-tmp\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.722948 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.722868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e71996de-f400-4bf6-9103-c7edf7801c24-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.823761 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.823721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e71996de-f400-4bf6-9103-c7edf7801c24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.823936 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.823782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e71996de-f400-4bf6-9103-c7edf7801c24-manifests\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.823936 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.823815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldxxw\" (UniqueName: \"kubernetes.io/projected/e71996de-f400-4bf6-9103-c7edf7801c24-kube-api-access-ldxxw\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.823936 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.823832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e71996de-f400-4bf6-9103-c7edf7801c24-tmp\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.823936 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.823882    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e71996de-f400-4bf6-9103-c7edf7801c24-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.824180 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.824159    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e71996de-f400-4bf6-9103-c7edf7801c24-manifests\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.826242 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.826219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e71996de-f400-4bf6-9103-c7edf7801c24-tmp\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.826367 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.826259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e71996de-f400-4bf6-9103-c7edf7801c24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.826433 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.826415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e71996de-f400-4bf6-9103-c7edf7801c24-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.838129 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.838106    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldxxw\" (UniqueName: \"kubernetes.io/projected/e71996de-f400-4bf6-9103-c7edf7801c24-kube-api-access-ldxxw\") pod \"opendatahub-operator-controller-manager-6b8fd6b656-8cfwr\" (UID: \"e71996de-f400-4bf6-9103-c7edf7801c24\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:22.972469 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:22.972378    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:23.112791 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:23.112762    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"]
Jul 27 20:22:23.115617 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:22:23.115588    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode71996de_f400_4bf6_9103_c7edf7801c24.slice/crio-a88698ccb301eba291778a81b69226b8b38b87ec15fc7e086a88f55a9ad34759 WatchSource:0}: Error finding container a88698ccb301eba291778a81b69226b8b38b87ec15fc7e086a88f55a9ad34759: Status 404 returned error can't find the container with id a88698ccb301eba291778a81b69226b8b38b87ec15fc7e086a88f55a9ad34759
Jul 27 20:22:23.368992 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:23.368956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr" event={"ID":"e71996de-f400-4bf6-9103-c7edf7801c24","Type":"ContainerStarted","Data":"a88698ccb301eba291778a81b69226b8b38b87ec15fc7e086a88f55a9ad34759"}
Jul 27 20:22:26.307420 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:26.307392    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:22:26.307420 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:26.307418    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:22:26.319135 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:26.319112    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 20:22:27.398128 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:27.398087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr" event={"ID":"e71996de-f400-4bf6-9103-c7edf7801c24","Type":"ContainerStarted","Data":"6103d46981e230c06caa3c5597030d7819a09970218bb80e4fec89d59011e3a2"}
Jul 27 20:22:28.404053 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:28.404018    2580 generic.go:356] "Generic (PLEG): container finished" podID="e71996de-f400-4bf6-9103-c7edf7801c24" containerID="6103d46981e230c06caa3c5597030d7819a09970218bb80e4fec89d59011e3a2" exitCode=0
Jul 27 20:22:28.404053 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:28.404057    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr" event={"ID":"e71996de-f400-4bf6-9103-c7edf7801c24","Type":"ContainerDied","Data":"6103d46981e230c06caa3c5597030d7819a09970218bb80e4fec89d59011e3a2"}
Jul 27 20:22:28.404556 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:28.404539    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:22:29.410177 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:29.410142    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr" event={"ID":"e71996de-f400-4bf6-9103-c7edf7801c24","Type":"ContainerStarted","Data":"c44e403f20fc3fc7dc5cba4ba1cfaf077d500c41152d5806fd74a41da4f12d28"}
Jul 27 20:22:29.410564 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:29.410251    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:29.432343 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:29.432291    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr" podStartSLOduration=2.8379786879999997 podStartE2EDuration="7.43227286s" totalImagesPullingTime="3.555359774s" totalInitContainerRuntime="1.038934398s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:22:29.429642279 +0000 UTC m=+305.085797621" watchObservedRunningTime="2026-07-27 20:22:29.43227286 +0000 UTC m=+305.088428204"
Jul 27 20:22:40.419129 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:40.419094    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b8fd6b656-8cfwr"
Jul 27 20:22:42.826176 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:42.826136    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9d6v5"]
Jul 27 20:22:42.834565 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:42.834544    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5"
Jul 27 20:22:42.837827 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:42.837803    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wgnbn\""
Jul 27 20:22:42.837971 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:42.837806    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 20:22:42.840829 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:42.840805    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9d6v5"]
Jul 27 20:22:42.903345 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:42.903312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4r67\" (UniqueName: \"kubernetes.io/projected/34230126-94de-401a-9b97-2c6a23389ae8-kube-api-access-n4r67\") pod \"odh-model-controller-7998c67dc4-9d6v5\" (UID: \"34230126-94de-401a-9b97-2c6a23389ae8\") " pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5"
Jul 27 20:22:42.903501 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:42.903374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34230126-94de-401a-9b97-2c6a23389ae8-cert\") pod \"odh-model-controller-7998c67dc4-9d6v5\" (UID: \"34230126-94de-401a-9b97-2c6a23389ae8\") " pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5"
Jul 27 20:22:43.004179 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:43.004145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4r67\" (UniqueName: \"kubernetes.io/projected/34230126-94de-401a-9b97-2c6a23389ae8-kube-api-access-n4r67\") pod \"odh-model-controller-7998c67dc4-9d6v5\" (UID: \"34230126-94de-401a-9b97-2c6a23389ae8\") " pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5"
Jul 27 20:22:43.004347 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:43.004202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34230126-94de-401a-9b97-2c6a23389ae8-cert\") pod \"odh-model-controller-7998c67dc4-9d6v5\" (UID: \"34230126-94de-401a-9b97-2c6a23389ae8\") " pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5"
Jul 27 20:22:43.004347 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:22:43.004309    2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 27 20:22:43.004423 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:22:43.004368    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34230126-94de-401a-9b97-2c6a23389ae8-cert podName:34230126-94de-401a-9b97-2c6a23389ae8 nodeName:}" failed. No retries permitted until 2026-07-27 20:22:43.504351694 +0000 UTC m=+319.160507015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/34230126-94de-401a-9b97-2c6a23389ae8-cert") pod "odh-model-controller-7998c67dc4-9d6v5" (UID: "34230126-94de-401a-9b97-2c6a23389ae8") : secret "odh-model-controller-webhook-cert" not found
Jul 27 20:22:43.017613 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:43.017582    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4r67\" (UniqueName: \"kubernetes.io/projected/34230126-94de-401a-9b97-2c6a23389ae8-kube-api-access-n4r67\") pod \"odh-model-controller-7998c67dc4-9d6v5\" (UID: \"34230126-94de-401a-9b97-2c6a23389ae8\") " pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5"
Jul 27 20:22:43.508985 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:43.508946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34230126-94de-401a-9b97-2c6a23389ae8-cert\") pod \"odh-model-controller-7998c67dc4-9d6v5\" (UID: \"34230126-94de-401a-9b97-2c6a23389ae8\") " pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5"
Jul 27 20:22:43.509145 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:22:43.509070    2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 27 20:22:43.509145 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:22:43.509123    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34230126-94de-401a-9b97-2c6a23389ae8-cert podName:34230126-94de-401a-9b97-2c6a23389ae8 nodeName:}" failed. No retries permitted until 2026-07-27 20:22:44.509107901 +0000 UTC m=+320.165263225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/34230126-94de-401a-9b97-2c6a23389ae8-cert") pod "odh-model-controller-7998c67dc4-9d6v5" (UID: "34230126-94de-401a-9b97-2c6a23389ae8") : secret "odh-model-controller-webhook-cert" not found
Jul 27 20:22:44.516811 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:44.516774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34230126-94de-401a-9b97-2c6a23389ae8-cert\") pod \"odh-model-controller-7998c67dc4-9d6v5\" (UID: \"34230126-94de-401a-9b97-2c6a23389ae8\") " pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5"
Jul 27 20:22:44.519172 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:44.519140    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34230126-94de-401a-9b97-2c6a23389ae8-cert\") pod \"odh-model-controller-7998c67dc4-9d6v5\" (UID: \"34230126-94de-401a-9b97-2c6a23389ae8\") " pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5"
Jul 27 20:22:44.648493 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:44.648453    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5"
Jul 27 20:22:44.987703 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:44.987586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9d6v5"]
Jul 27 20:22:44.989897 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:22:44.989872    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34230126_94de_401a_9b97_2c6a23389ae8.slice/crio-9554b68bf37e2f6771546a7e8a7b23c5c276221f2eba5e7ca4d4177b3217fb2c WatchSource:0}: Error finding container 9554b68bf37e2f6771546a7e8a7b23c5c276221f2eba5e7ca4d4177b3217fb2c: Status 404 returned error can't find the container with id 9554b68bf37e2f6771546a7e8a7b23c5c276221f2eba5e7ca4d4177b3217fb2c
Jul 27 20:22:45.488658 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:45.488622    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5" event={"ID":"34230126-94de-401a-9b97-2c6a23389ae8","Type":"ContainerStarted","Data":"9554b68bf37e2f6771546a7e8a7b23c5c276221f2eba5e7ca4d4177b3217fb2c"}
Jul 27 20:22:48.187967 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.187880    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"]
Jul 27 20:22:48.191053 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.191032    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"
Jul 27 20:22:48.193636 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.193619    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 20:22:48.194004 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.193988    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 20:22:48.203069 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.203045    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"]
Jul 27 20:22:48.352996 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.352956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/505f4a06-57ee-475c-bd78-24f4d9359815-tmp\") pod \"kube-auth-proxy-59b675654c-dcxj2\" (UID: \"505f4a06-57ee-475c-bd78-24f4d9359815\") " pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"
Jul 27 20:22:48.353171 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.353046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qww8w\" (UniqueName: \"kubernetes.io/projected/505f4a06-57ee-475c-bd78-24f4d9359815-kube-api-access-qww8w\") pod \"kube-auth-proxy-59b675654c-dcxj2\" (UID: \"505f4a06-57ee-475c-bd78-24f4d9359815\") " pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"
Jul 27 20:22:48.353171 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.353080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/505f4a06-57ee-475c-bd78-24f4d9359815-tls-certs\") pod \"kube-auth-proxy-59b675654c-dcxj2\" (UID: \"505f4a06-57ee-475c-bd78-24f4d9359815\") " pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"
Jul 27 20:22:48.453941 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.453847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/505f4a06-57ee-475c-bd78-24f4d9359815-tls-certs\") pod \"kube-auth-proxy-59b675654c-dcxj2\" (UID: \"505f4a06-57ee-475c-bd78-24f4d9359815\") " pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"
Jul 27 20:22:48.453941 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.453907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/505f4a06-57ee-475c-bd78-24f4d9359815-tmp\") pod \"kube-auth-proxy-59b675654c-dcxj2\" (UID: \"505f4a06-57ee-475c-bd78-24f4d9359815\") " pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"
Jul 27 20:22:48.454205 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.453955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qww8w\" (UniqueName: \"kubernetes.io/projected/505f4a06-57ee-475c-bd78-24f4d9359815-kube-api-access-qww8w\") pod \"kube-auth-proxy-59b675654c-dcxj2\" (UID: \"505f4a06-57ee-475c-bd78-24f4d9359815\") " pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"
Jul 27 20:22:48.454205 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:22:48.454020    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 27 20:22:48.454205 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:22:48.454116    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/505f4a06-57ee-475c-bd78-24f4d9359815-tls-certs podName:505f4a06-57ee-475c-bd78-24f4d9359815 nodeName:}" failed. No retries permitted until 2026-07-27 20:22:48.954092576 +0000 UTC m=+324.610247902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/505f4a06-57ee-475c-bd78-24f4d9359815-tls-certs") pod "kube-auth-proxy-59b675654c-dcxj2" (UID: "505f4a06-57ee-475c-bd78-24f4d9359815") : secret "kube-auth-proxy-tls" not found
Jul 27 20:22:48.456130 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.456100    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/505f4a06-57ee-475c-bd78-24f4d9359815-tmp\") pod \"kube-auth-proxy-59b675654c-dcxj2\" (UID: \"505f4a06-57ee-475c-bd78-24f4d9359815\") " pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"
Jul 27 20:22:48.462188 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.462162    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qww8w\" (UniqueName: \"kubernetes.io/projected/505f4a06-57ee-475c-bd78-24f4d9359815-kube-api-access-qww8w\") pod \"kube-auth-proxy-59b675654c-dcxj2\" (UID: \"505f4a06-57ee-475c-bd78-24f4d9359815\") " pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"
Jul 27 20:22:48.506128 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.506094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5" event={"ID":"34230126-94de-401a-9b97-2c6a23389ae8","Type":"ContainerStarted","Data":"6497b28572f7a76841f78b87ba9dd6903d69200f31565c47e457c89f1b4e3e7f"}
Jul 27 20:22:48.506297 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.506210    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5"
Jul 27 20:22:48.524050 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.524002    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5" podStartSLOduration=3.649779395 podStartE2EDuration="6.523986878s" totalImagesPullingTime="2.874207483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:22:48.522642346 +0000 UTC m=+324.178797701" watchObservedRunningTime="2026-07-27 20:22:48.523986878 +0000 UTC m=+324.180142221"
Jul 27 20:22:48.958511 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.958473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/505f4a06-57ee-475c-bd78-24f4d9359815-tls-certs\") pod \"kube-auth-proxy-59b675654c-dcxj2\" (UID: \"505f4a06-57ee-475c-bd78-24f4d9359815\") " pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"
Jul 27 20:22:48.960832 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:48.960807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/505f4a06-57ee-475c-bd78-24f4d9359815-tls-certs\") pod \"kube-auth-proxy-59b675654c-dcxj2\" (UID: \"505f4a06-57ee-475c-bd78-24f4d9359815\") " pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"
Jul 27 20:22:49.099953 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.099916    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"
Jul 27 20:22:49.236127 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.236057    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59b675654c-dcxj2"]
Jul 27 20:22:49.238438 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:22:49.238410    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505f4a06_57ee_475c_bd78_24f4d9359815.slice/crio-da458a2a08662893d03372e8cd68f7455a88098406296421d3974198479e423f WatchSource:0}: Error finding container da458a2a08662893d03372e8cd68f7455a88098406296421d3974198479e423f: Status 404 returned error can't find the container with id da458a2a08662893d03372e8cd68f7455a88098406296421d3974198479e423f
Jul 27 20:22:49.402145 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.402113    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"]
Jul 27 20:22:49.406597 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.406575    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.410176 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.410155    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 20:22:49.410289 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.410221    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 20:22:49.410348 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.410323    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 20:22:49.415599 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.415576    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 20:22:49.415878 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.415862    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wr59l\""
Jul 27 20:22:49.439220 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.439194    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"]
Jul 27 20:22:49.512150 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.512065    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2" event={"ID":"505f4a06-57ee-475c-bd78-24f4d9359815","Type":"ContainerStarted","Data":"da458a2a08662893d03372e8cd68f7455a88098406296421d3974198479e423f"}
Jul 27 20:22:49.564764 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.564725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.564938 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.564841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.564938 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.564928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.565060 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.565012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.565060 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.565049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnfvb\" (UniqueName: \"kubernetes.io/projected/34d1e0b3-c5b6-4a4b-8748-31632b92828c-kube-api-access-jnfvb\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.565160 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.565123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/34d1e0b3-c5b6-4a4b-8748-31632b92828c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.565213 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.565157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.666104 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.666063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.666286 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.666119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.666286 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.666198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.666286 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.666228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnfvb\" (UniqueName: \"kubernetes.io/projected/34d1e0b3-c5b6-4a4b-8748-31632b92828c-kube-api-access-jnfvb\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.666512 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.666287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/34d1e0b3-c5b6-4a4b-8748-31632b92828c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.666512 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.666344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.666512 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.666374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.666822 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.666782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.668533 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.668509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.668644 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.668573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/34d1e0b3-c5b6-4a4b-8748-31632b92828c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.668736 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.668719    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.668736 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.668726    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.673822 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.673795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.673901 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.673795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnfvb\" (UniqueName: \"kubernetes.io/projected/34d1e0b3-c5b6-4a4b-8748-31632b92828c-kube-api-access-jnfvb\") pod \"istiod-openshift-gateway-7b7995d5cd-cj6m4\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.715885 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.715842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:49.852655 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:49.852626    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"]
Jul 27 20:22:49.854701 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:22:49.854677    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d1e0b3_c5b6_4a4b_8748_31632b92828c.slice/crio-67d559223b594a16b6525e8d1739f7e8e644c51c5307745d0cf41f8bf2f6bf41 WatchSource:0}: Error finding container 67d559223b594a16b6525e8d1739f7e8e644c51c5307745d0cf41f8bf2f6bf41: Status 404 returned error can't find the container with id 67d559223b594a16b6525e8d1739f7e8e644c51c5307745d0cf41f8bf2f6bf41
Jul 27 20:22:50.517420 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:50.517385    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4" event={"ID":"34d1e0b3-c5b6-4a4b-8748-31632b92828c","Type":"ContainerStarted","Data":"67d559223b594a16b6525e8d1739f7e8e644c51c5307745d0cf41f8bf2f6bf41"}
Jul 27 20:22:52.563194 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.563151    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v478z"]
Jul 27 20:22:52.570336 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.570312    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z"
Jul 27 20:22:52.573044 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.573017    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7d26c\""
Jul 27 20:22:52.573172 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.573097    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 27 20:22:52.576652 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.576626    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"]
Jul 27 20:22:52.580959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.580934    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v478z"]
Jul 27 20:22:52.581093 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.581020    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"
Jul 27 20:22:52.583289 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.583102    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 27 20:22:52.583409 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.583343    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hqfsd\""
Jul 27 20:22:52.590689 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.590662    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"]
Jul 27 20:22:52.695635 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.695601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dgh4l\" (UID: \"bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"
Jul 27 20:22:52.695833 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.695643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbq6n\" (UniqueName: \"kubernetes.io/projected/dfaef796-b214-4318-a774-805d734db22a-kube-api-access-lbq6n\") pod \"kserve-controller-manager-d6f4b65b8-v478z\" (UID: \"dfaef796-b214-4318-a774-805d734db22a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z"
Jul 27 20:22:52.695833 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.695722    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdf28\" (UniqueName: \"kubernetes.io/projected/bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9-kube-api-access-rdf28\") pod \"llmisvc-controller-manager-777c6bd7d5-dgh4l\" (UID: \"bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"
Jul 27 20:22:52.695833 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.695803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfaef796-b214-4318-a774-805d734db22a-cert\") pod \"kserve-controller-manager-d6f4b65b8-v478z\" (UID: \"dfaef796-b214-4318-a774-805d734db22a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z"
Jul 27 20:22:52.797532 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.797491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dgh4l\" (UID: \"bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"
Jul 27 20:22:52.797532 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.797546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbq6n\" (UniqueName: \"kubernetes.io/projected/dfaef796-b214-4318-a774-805d734db22a-kube-api-access-lbq6n\") pod \"kserve-controller-manager-d6f4b65b8-v478z\" (UID: \"dfaef796-b214-4318-a774-805d734db22a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z"
Jul 27 20:22:52.797816 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.797605    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdf28\" (UniqueName: \"kubernetes.io/projected/bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9-kube-api-access-rdf28\") pod \"llmisvc-controller-manager-777c6bd7d5-dgh4l\" (UID: \"bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"
Jul 27 20:22:52.797816 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.797672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfaef796-b214-4318-a774-805d734db22a-cert\") pod \"kserve-controller-manager-d6f4b65b8-v478z\" (UID: \"dfaef796-b214-4318-a774-805d734db22a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z"
Jul 27 20:22:52.797816 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:22:52.797686    2580 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 27 20:22:52.797970 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:22:52.797816    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9-cert podName:bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9 nodeName:}" failed. No retries permitted until 2026-07-27 20:22:53.297790621 +0000 UTC m=+328.953945961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9-cert") pod "llmisvc-controller-manager-777c6bd7d5-dgh4l" (UID: "bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9") : secret "llmisvc-webhook-server-cert" not found
Jul 27 20:22:52.800525 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.800500    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfaef796-b214-4318-a774-805d734db22a-cert\") pod \"kserve-controller-manager-d6f4b65b8-v478z\" (UID: \"dfaef796-b214-4318-a774-805d734db22a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z"
Jul 27 20:22:52.811999 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.811968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbq6n\" (UniqueName: \"kubernetes.io/projected/dfaef796-b214-4318-a774-805d734db22a-kube-api-access-lbq6n\") pod \"kserve-controller-manager-d6f4b65b8-v478z\" (UID: \"dfaef796-b214-4318-a774-805d734db22a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z"
Jul 27 20:22:52.813449 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.813382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdf28\" (UniqueName: \"kubernetes.io/projected/bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9-kube-api-access-rdf28\") pod \"llmisvc-controller-manager-777c6bd7d5-dgh4l\" (UID: \"bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"
Jul 27 20:22:52.884799 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:52.884759    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z"
Jul 27 20:22:53.061724 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.061682    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:22:53.061867 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.061841    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:22:53.209284 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:22:53.209256    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfaef796_b214_4318_a774_805d734db22a.slice/crio-249748a5f582ede9a8b0cebaf05f55a7dcc2511ee68635f933d42ca42d489a63 WatchSource:0}: Error finding container 249748a5f582ede9a8b0cebaf05f55a7dcc2511ee68635f933d42ca42d489a63: Status 404 returned error can't find the container with id 249748a5f582ede9a8b0cebaf05f55a7dcc2511ee68635f933d42ca42d489a63
Jul 27 20:22:53.216604 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.216579    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v478z"]
Jul 27 20:22:53.302347 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.302306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dgh4l\" (UID: \"bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"
Jul 27 20:22:53.304630 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.304609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dgh4l\" (UID: \"bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"
Jul 27 20:22:53.496888 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.496795    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"
Jul 27 20:22:53.538286 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.538234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2" event={"ID":"505f4a06-57ee-475c-bd78-24f4d9359815","Type":"ContainerStarted","Data":"659f7f112a2bcbe6b06855a0319f6ba8a74b0e9dc0a8cb8def937548b0ac7b0e"}
Jul 27 20:22:53.542006 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.541920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4" event={"ID":"34d1e0b3-c5b6-4a4b-8748-31632b92828c","Type":"ContainerStarted","Data":"3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0"}
Jul 27 20:22:53.542006 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.541993    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:53.543429 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.543396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z" event={"ID":"dfaef796-b214-4318-a774-805d734db22a","Type":"ContainerStarted","Data":"249748a5f582ede9a8b0cebaf05f55a7dcc2511ee68635f933d42ca42d489a63"}
Jul 27 20:22:53.562783 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.562686    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59b675654c-dcxj2" podStartSLOduration=1.746013151 podStartE2EDuration="5.562663356s" totalImagesPullingTime="3.816650205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:22:53.560000145 +0000 UTC m=+329.216155490" watchObservedRunningTime="2026-07-27 20:22:53.562663356 +0000 UTC m=+329.218818699"
Jul 27 20:22:53.618241 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.618179    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4" podStartSLOduration=1.413866242 podStartE2EDuration="4.618157425s" totalImagesPullingTime="3.204291183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:22:53.60962384 +0000 UTC m=+329.265779183" watchObservedRunningTime="2026-07-27 20:22:53.618157425 +0000 UTC m=+329.274312769"
Jul 27 20:22:53.689968 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:53.689944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"]
Jul 27 20:22:53.692193 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:22:53.692163    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbc98a047_2fd0_45ca_9c2c_c7d9cb934dd9.slice/crio-df52805e3b4d5403b14aaf99389e72aacc017db33c0f017513092212137c8946 WatchSource:0}: Error finding container df52805e3b4d5403b14aaf99389e72aacc017db33c0f017513092212137c8946: Status 404 returned error can't find the container with id df52805e3b4d5403b14aaf99389e72aacc017db33c0f017513092212137c8946
Jul 27 20:22:54.306788 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.306738    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"]
Jul 27 20:22:54.309807 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.309788    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.313071 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.313052    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vlm7b\""
Jul 27 20:22:54.344490 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.344459    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"]
Jul 27 20:22:54.414193 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.414158    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.414358 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.414208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.414358 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.414267    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.414358 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.414329    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27snj\" (UniqueName: \"kubernetes.io/projected/6f101355-fb89-44aa-9771-e1d80fb4ac8a-kube-api-access-27snj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.414574 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.414360    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.414574 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.414440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.414574 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.414499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.414574 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.414557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.414787 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.414631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.515446 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.515404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.515619 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.515467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.515619 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.515535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.515619 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.515566    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.515619 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.515591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.515841 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.515619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27snj\" (UniqueName: \"kubernetes.io/projected/6f101355-fb89-44aa-9771-e1d80fb4ac8a-kube-api-access-27snj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.516290 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.515868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.516290 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.515874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.516290 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.515918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.516290 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.515963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.516534 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.516512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.517075 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.517048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.517318 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.517272    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.517459 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.517425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.519609 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.519586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.519711 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.519605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.526391 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.526354    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27snj\" (UniqueName: \"kubernetes.io/projected/6f101355-fb89-44aa-9771-e1d80fb4ac8a-kube-api-access-27snj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.527101 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.527076    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f101355-fb89-44aa-9771-e1d80fb4ac8a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz\" (UID: \"6f101355-fb89-44aa-9771-e1d80fb4ac8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:54.553040 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.553006    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l" event={"ID":"bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9","Type":"ContainerStarted","Data":"df52805e3b4d5403b14aaf99389e72aacc017db33c0f017513092212137c8946"}
Jul 27 20:22:54.555242 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.555217    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:54.621173 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:54.620901    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:55.168117 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:55.168082    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"]
Jul 27 20:22:55.381116 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:55.381062    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"]
Jul 27 20:22:55.384534 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:22:55.384501    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f101355_fb89_44aa_9771_e1d80fb4ac8a.slice/crio-a7641863a1ee1d9946693f45dd58ec35092f3193fd939feda8fad46a115680cf WatchSource:0}: Error finding container a7641863a1ee1d9946693f45dd58ec35092f3193fd939feda8fad46a115680cf: Status 404 returned error can't find the container with id a7641863a1ee1d9946693f45dd58ec35092f3193fd939feda8fad46a115680cf
Jul 27 20:22:55.561807 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:55.561739    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz" event={"ID":"6f101355-fb89-44aa-9771-e1d80fb4ac8a","Type":"ContainerStarted","Data":"a7641863a1ee1d9946693f45dd58ec35092f3193fd939feda8fad46a115680cf"}
Jul 27 20:22:56.568638 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:56.568581    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4" podUID="34d1e0b3-c5b6-4a4b-8748-31632b92828c" containerName="discovery" containerID="cri-o://3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0" gracePeriod=30
Jul 27 20:22:57.081950 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.081924    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:57.243914 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.243821    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-kubeconfig\") pod \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") "
Jul 27 20:22:57.243914 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.243882    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-csr-ca-configmap\") pod \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") "
Jul 27 20:22:57.244143 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.243919    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-cacerts\") pod \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") "
Jul 27 20:22:57.244143 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.243976    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-csr-dns-cert\") pod \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") "
Jul 27 20:22:57.244143 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.244018    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnfvb\" (UniqueName: \"kubernetes.io/projected/34d1e0b3-c5b6-4a4b-8748-31632b92828c-kube-api-access-jnfvb\") pod \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") "
Jul 27 20:22:57.244143 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.244044    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-token\") pod \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") "
Jul 27 20:22:57.244143 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.244074    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/34d1e0b3-c5b6-4a4b-8748-31632b92828c-local-certs\") pod \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\" (UID: \"34d1e0b3-c5b6-4a4b-8748-31632b92828c\") "
Jul 27 20:22:57.244397 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.244302    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "34d1e0b3-c5b6-4a4b-8748-31632b92828c" (UID: "34d1e0b3-c5b6-4a4b-8748-31632b92828c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:22:57.247003 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.246964    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "34d1e0b3-c5b6-4a4b-8748-31632b92828c" (UID: "34d1e0b3-c5b6-4a4b-8748-31632b92828c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:22:57.247126 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.247066    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-token" (OuterVolumeSpecName: "istio-token") pod "34d1e0b3-c5b6-4a4b-8748-31632b92828c" (UID: "34d1e0b3-c5b6-4a4b-8748-31632b92828c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:22:57.247487 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.247463    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34d1e0b3-c5b6-4a4b-8748-31632b92828c-local-certs" (OuterVolumeSpecName: "local-certs") pod "34d1e0b3-c5b6-4a4b-8748-31632b92828c" (UID: "34d1e0b3-c5b6-4a4b-8748-31632b92828c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:57.247618 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.247562    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-cacerts" (OuterVolumeSpecName: "cacerts") pod "34d1e0b3-c5b6-4a4b-8748-31632b92828c" (UID: "34d1e0b3-c5b6-4a4b-8748-31632b92828c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:22:57.247812 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.247787    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34d1e0b3-c5b6-4a4b-8748-31632b92828c-kube-api-access-jnfvb" (OuterVolumeSpecName: "kube-api-access-jnfvb") pod "34d1e0b3-c5b6-4a4b-8748-31632b92828c" (UID: "34d1e0b3-c5b6-4a4b-8748-31632b92828c"). InnerVolumeSpecName "kube-api-access-jnfvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:22:57.248170 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.248144    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "34d1e0b3-c5b6-4a4b-8748-31632b92828c" (UID: "34d1e0b3-c5b6-4a4b-8748-31632b92828c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:22:57.345906 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.345869    2580 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-kubeconfig\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:22:57.345906 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.345906    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-csr-ca-configmap\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:22:57.346140 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.345922    2580 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-cacerts\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:22:57.346140 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.345938    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-csr-dns-cert\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:22:57.346140 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.345953    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnfvb\" (UniqueName: \"kubernetes.io/projected/34d1e0b3-c5b6-4a4b-8748-31632b92828c-kube-api-access-jnfvb\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:22:57.346140 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.345967    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34d1e0b3-c5b6-4a4b-8748-31632b92828c-istio-token\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:22:57.346140 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.345980    2580 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/34d1e0b3-c5b6-4a4b-8748-31632b92828c-local-certs\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:22:57.576869 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.576829    2580 generic.go:356] "Generic (PLEG): container finished" podID="34d1e0b3-c5b6-4a4b-8748-31632b92828c" containerID="3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0" exitCode=0
Jul 27 20:22:57.577351 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.576877    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"
Jul 27 20:22:57.577351 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.576918    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4" event={"ID":"34d1e0b3-c5b6-4a4b-8748-31632b92828c","Type":"ContainerDied","Data":"3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0"}
Jul 27 20:22:57.577351 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.576971    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4" event={"ID":"34d1e0b3-c5b6-4a4b-8748-31632b92828c","Type":"ContainerDied","Data":"67d559223b594a16b6525e8d1739f7e8e644c51c5307745d0cf41f8bf2f6bf41"}
Jul 27 20:22:57.577351 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.577040    2580 scope.go:117] "RemoveContainer" containerID="3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0"
Jul 27 20:22:57.579295 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.579261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l" event={"ID":"bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9","Type":"ContainerStarted","Data":"29e5eb6f9cfd236a86ea1c673202bcb61fd48c41e2ef1a7e1709fe2d54cd8b57"}
Jul 27 20:22:57.579574 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.579554    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"
Jul 27 20:22:57.581661 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.581633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z" event={"ID":"dfaef796-b214-4318-a774-805d734db22a","Type":"ContainerStarted","Data":"3513d5f59b71c5fd7a6009b91380c85a5e80c6f654f3176daccaac3fc0fde055"}
Jul 27 20:22:57.581822 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.581804    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z"
Jul 27 20:22:57.588137 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.588114    2580 scope.go:117] "RemoveContainer" containerID="3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0"
Jul 27 20:22:57.588421 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:22:57.588403    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0\": container with ID starting with 3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0 not found: ID does not exist" containerID="3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0"
Jul 27 20:22:57.588483 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.588430    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0"} err="failed to get container status \"3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0\": rpc error: code = NotFound desc = could not find container \"3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0\": container with ID starting with 3981dceda2552e704bf0dd447da8153c5b909c0990b9fe95491f8ef03b7071e0 not found: ID does not exist"
Jul 27 20:22:57.598927 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.598873    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l" podStartSLOduration=2.369388039 podStartE2EDuration="5.598858753s" totalImagesPullingTime="3.229470714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:22:57.596921258 +0000 UTC m=+333.253076602" watchObservedRunningTime="2026-07-27 20:22:57.598858753 +0000 UTC m=+333.255014095"
Jul 27 20:22:57.611666 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.611630    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"]
Jul 27 20:22:57.616818 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.616786    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cj6m4"]
Jul 27 20:22:57.628812 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:57.628732    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z" podStartSLOduration=1.919836316 podStartE2EDuration="5.628711569s" totalImagesPullingTime="3.708875253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:22:57.628043713 +0000 UTC m=+333.284199069" watchObservedRunningTime="2026-07-27 20:22:57.628711569 +0000 UTC m=+333.284866915"
Jul 27 20:22:58.849517 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:58.849473    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:22:58.849835 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:58.849575    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:22:58.849835 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:58.849606    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:22:58.901780 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:58.901740    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34d1e0b3-c5b6-4a4b-8748-31632b92828c" path="/var/lib/kubelet/pods/34d1e0b3-c5b6-4a4b-8748-31632b92828c/volumes"
Jul 27 20:22:59.514164 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:59.514133    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9d6v5"
Jul 27 20:22:59.594850 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:59.594817    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz" event={"ID":"6f101355-fb89-44aa-9771-e1d80fb4ac8a","Type":"ContainerStarted","Data":"a9b63c1e3092cddc0c2c257372243532c9198d5898582a78fa82993f1a4431db"}
Jul 27 20:22:59.615528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:59.615478    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz" podStartSLOduration=2.153273078 podStartE2EDuration="5.615460086s" totalImagesPullingTime="3.462187008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:22:59.614360682 +0000 UTC m=+335.270516024" watchObservedRunningTime="2026-07-27 20:22:59.615460086 +0000 UTC m=+335.271615433"
Jul 27 20:22:59.622037 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:59.622012    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:22:59.627179 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:22:59.627152    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:23:00.599676 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:00.599648    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:23:00.600783 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:00.600732    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz"
Jul 27 20:23:28.590906 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:28.590867    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dgh4l"
Jul 27 20:23:28.593791 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:28.593775    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v478z"
Jul 27 20:23:43.520919 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.520880    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9sf72"]
Jul 27 20:23:43.521303 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.521246    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34d1e0b3-c5b6-4a4b-8748-31632b92828c" containerName="discovery"
Jul 27 20:23:43.521303 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.521257    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="34d1e0b3-c5b6-4a4b-8748-31632b92828c" containerName="discovery"
Jul 27 20:23:43.521380 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.521331    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="34d1e0b3-c5b6-4a4b-8748-31632b92828c" containerName="discovery"
Jul 27 20:23:43.531428 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.531396    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9sf72"
Jul 27 20:23:43.532894 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.532867    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9sf72"]
Jul 27 20:23:43.534197 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.534172    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 20:23:43.534459 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.534440    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 20:23:43.535115 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.535095    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-r2l64\""
Jul 27 20:23:43.666365 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.666305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fj4j\" (UniqueName: \"kubernetes.io/projected/2016c411-8a27-4bb2-b49d-ac87ab6ef81f-kube-api-access-6fj4j\") pod \"kuadrant-operator-catalog-9sf72\" (UID: \"2016c411-8a27-4bb2-b49d-ac87ab6ef81f\") " pod="kuadrant-system/kuadrant-operator-catalog-9sf72"
Jul 27 20:23:43.766974 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.766941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fj4j\" (UniqueName: \"kubernetes.io/projected/2016c411-8a27-4bb2-b49d-ac87ab6ef81f-kube-api-access-6fj4j\") pod \"kuadrant-operator-catalog-9sf72\" (UID: \"2016c411-8a27-4bb2-b49d-ac87ab6ef81f\") " pod="kuadrant-system/kuadrant-operator-catalog-9sf72"
Jul 27 20:23:43.774993 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.774917    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fj4j\" (UniqueName: \"kubernetes.io/projected/2016c411-8a27-4bb2-b49d-ac87ab6ef81f-kube-api-access-6fj4j\") pod \"kuadrant-operator-catalog-9sf72\" (UID: \"2016c411-8a27-4bb2-b49d-ac87ab6ef81f\") " pod="kuadrant-system/kuadrant-operator-catalog-9sf72"
Jul 27 20:23:43.843054 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.843011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9sf72"
Jul 27 20:23:43.886161 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.886125    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9sf72"]
Jul 27 20:23:43.979362 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:43.979338    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9sf72"]
Jul 27 20:23:43.981547 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:23:43.981521    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2016c411_8a27_4bb2_b49d_ac87ab6ef81f.slice/crio-07c042e7dbfe9beb97a26bdddc1929c9f514b300a528521877dab8a37c5f9543 WatchSource:0}: Error finding container 07c042e7dbfe9beb97a26bdddc1929c9f514b300a528521877dab8a37c5f9543: Status 404 returned error can't find the container with id 07c042e7dbfe9beb97a26bdddc1929c9f514b300a528521877dab8a37c5f9543
Jul 27 20:23:44.096080 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:44.096046    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2nxm9"]
Jul 27 20:23:44.099035 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:44.099018    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2nxm9"
Jul 27 20:23:44.107880 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:44.107853    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2nxm9"]
Jul 27 20:23:44.271009 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:44.270974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfc95\" (UniqueName: \"kubernetes.io/projected/1ecb2cd3-6906-4dd4-a647-d2ba7d1b09cf-kube-api-access-lfc95\") pod \"kuadrant-operator-catalog-2nxm9\" (UID: \"1ecb2cd3-6906-4dd4-a647-d2ba7d1b09cf\") " pod="kuadrant-system/kuadrant-operator-catalog-2nxm9"
Jul 27 20:23:44.371974 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:44.371887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfc95\" (UniqueName: \"kubernetes.io/projected/1ecb2cd3-6906-4dd4-a647-d2ba7d1b09cf-kube-api-access-lfc95\") pod \"kuadrant-operator-catalog-2nxm9\" (UID: \"1ecb2cd3-6906-4dd4-a647-d2ba7d1b09cf\") " pod="kuadrant-system/kuadrant-operator-catalog-2nxm9"
Jul 27 20:23:44.379691 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:44.379663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfc95\" (UniqueName: \"kubernetes.io/projected/1ecb2cd3-6906-4dd4-a647-d2ba7d1b09cf-kube-api-access-lfc95\") pod \"kuadrant-operator-catalog-2nxm9\" (UID: \"1ecb2cd3-6906-4dd4-a647-d2ba7d1b09cf\") " pod="kuadrant-system/kuadrant-operator-catalog-2nxm9"
Jul 27 20:23:44.409717 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:44.409678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2nxm9"
Jul 27 20:23:44.754227 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:44.754137    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2nxm9"]
Jul 27 20:23:44.815664 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:44.815626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9sf72" event={"ID":"2016c411-8a27-4bb2-b49d-ac87ab6ef81f","Type":"ContainerStarted","Data":"07c042e7dbfe9beb97a26bdddc1929c9f514b300a528521877dab8a37c5f9543"}
Jul 27 20:23:44.839550 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:23:44.839503    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecb2cd3_6906_4dd4_a647_d2ba7d1b09cf.slice/crio-1fb81f6c7951cc17df91e330fbd205d9824c3927ab8c6fe2e0cd63fb6a610418 WatchSource:0}: Error finding container 1fb81f6c7951cc17df91e330fbd205d9824c3927ab8c6fe2e0cd63fb6a610418: Status 404 returned error can't find the container with id 1fb81f6c7951cc17df91e330fbd205d9824c3927ab8c6fe2e0cd63fb6a610418
Jul 27 20:23:45.824910 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:45.824871    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2nxm9" event={"ID":"1ecb2cd3-6906-4dd4-a647-d2ba7d1b09cf","Type":"ContainerStarted","Data":"1fb81f6c7951cc17df91e330fbd205d9824c3927ab8c6fe2e0cd63fb6a610418"}
Jul 27 20:23:46.831676 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:46.831633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9sf72" event={"ID":"2016c411-8a27-4bb2-b49d-ac87ab6ef81f","Type":"ContainerStarted","Data":"494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853"}
Jul 27 20:23:46.831676 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:46.831659    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9sf72" podUID="2016c411-8a27-4bb2-b49d-ac87ab6ef81f" containerName="registry-server" containerID="cri-o://494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853" gracePeriod=2
Jul 27 20:23:46.833414 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:46.833385    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2nxm9" event={"ID":"1ecb2cd3-6906-4dd4-a647-d2ba7d1b09cf","Type":"ContainerStarted","Data":"210ac2b4785a85ce306588a7073590610953571672c4600b8ec6d031b92edf6e"}
Jul 27 20:23:46.848239 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:46.848193    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9sf72" podStartSLOduration=1.6450326469999998 podStartE2EDuration="3.848175705s" totalImagesPullingTime="2.203143058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:23:46.846569036 +0000 UTC m=+382.502724400" watchObservedRunningTime="2026-07-27 20:23:46.848175705 +0000 UTC m=+382.504331049"
Jul 27 20:23:46.865017 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:46.864968    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2nxm9" podStartSLOduration=1.5161664099999999 podStartE2EDuration="2.864953333s" totalImagesPullingTime="1.348786923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:23:46.8632955 +0000 UTC m=+382.519450843" watchObservedRunningTime="2026-07-27 20:23:46.864953333 +0000 UTC m=+382.521108676"
Jul 27 20:23:47.081926 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.081859    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9sf72"
Jul 27 20:23:47.198271 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.198226    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fj4j\" (UniqueName: \"kubernetes.io/projected/2016c411-8a27-4bb2-b49d-ac87ab6ef81f-kube-api-access-6fj4j\") pod \"2016c411-8a27-4bb2-b49d-ac87ab6ef81f\" (UID: \"2016c411-8a27-4bb2-b49d-ac87ab6ef81f\") "
Jul 27 20:23:47.200357 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.200329    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2016c411-8a27-4bb2-b49d-ac87ab6ef81f-kube-api-access-6fj4j" (OuterVolumeSpecName: "kube-api-access-6fj4j") pod "2016c411-8a27-4bb2-b49d-ac87ab6ef81f" (UID: "2016c411-8a27-4bb2-b49d-ac87ab6ef81f"). InnerVolumeSpecName "kube-api-access-6fj4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:23:47.299767 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.299721    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fj4j\" (UniqueName: \"kubernetes.io/projected/2016c411-8a27-4bb2-b49d-ac87ab6ef81f-kube-api-access-6fj4j\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:23:47.839398 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.839362    2580 generic.go:356] "Generic (PLEG): container finished" podID="2016c411-8a27-4bb2-b49d-ac87ab6ef81f" containerID="494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853" exitCode=0
Jul 27 20:23:47.839836 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.839413    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9sf72"
Jul 27 20:23:47.839836 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.839447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9sf72" event={"ID":"2016c411-8a27-4bb2-b49d-ac87ab6ef81f","Type":"ContainerDied","Data":"494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853"}
Jul 27 20:23:47.839836 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.839496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9sf72" event={"ID":"2016c411-8a27-4bb2-b49d-ac87ab6ef81f","Type":"ContainerDied","Data":"07c042e7dbfe9beb97a26bdddc1929c9f514b300a528521877dab8a37c5f9543"}
Jul 27 20:23:47.839836 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.839516    2580 scope.go:117] "RemoveContainer" containerID="494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853"
Jul 27 20:23:47.849130 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.849108    2580 scope.go:117] "RemoveContainer" containerID="494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853"
Jul 27 20:23:47.849435 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:23:47.849415    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853\": container with ID starting with 494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853 not found: ID does not exist" containerID="494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853"
Jul 27 20:23:47.849499 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.849451    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853"} err="failed to get container status \"494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853\": rpc error: code = NotFound desc = could not find container \"494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853\": container with ID starting with 494eb76075b042f1967c57d001cb51a056c56ae935e702cf1ad04bfa12905853 not found: ID does not exist"
Jul 27 20:23:47.859607 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.859575    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9sf72"]
Jul 27 20:23:47.861896 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:47.861873    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9sf72"]
Jul 27 20:23:48.901816 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:48.901783    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2016c411-8a27-4bb2-b49d-ac87ab6ef81f" path="/var/lib/kubelet/pods/2016c411-8a27-4bb2-b49d-ac87ab6ef81f/volumes"
Jul 27 20:23:54.410344 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:54.410299    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2nxm9"
Jul 27 20:23:54.410865 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:54.410374    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2nxm9"
Jul 27 20:23:54.432972 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:54.432942    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2nxm9"
Jul 27 20:23:54.902459 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:54.902431    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2nxm9"
Jul 27 20:23:59.134108 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.134068    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"]
Jul 27 20:23:59.134612 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.134435    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2016c411-8a27-4bb2-b49d-ac87ab6ef81f" containerName="registry-server"
Jul 27 20:23:59.134612 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.134445    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2016c411-8a27-4bb2-b49d-ac87ab6ef81f" containerName="registry-server"
Jul 27 20:23:59.134612 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.134508    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2016c411-8a27-4bb2-b49d-ac87ab6ef81f" containerName="registry-server"
Jul 27 20:23:59.139055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.139035    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:23:59.141339 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.141316    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9wrkj\""
Jul 27 20:23:59.145023 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.144999    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"]
Jul 27 20:23:59.200192 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.200160    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbfkr\" (UniqueName: \"kubernetes.io/projected/92388ca6-1733-4b12-89c7-673632de1ac4-kube-api-access-dbfkr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4\" (UID: \"92388ca6-1733-4b12-89c7-673632de1ac4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:23:59.200192 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.200195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92388ca6-1733-4b12-89c7-673632de1ac4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4\" (UID: \"92388ca6-1733-4b12-89c7-673632de1ac4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:23:59.200414 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.200224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92388ca6-1733-4b12-89c7-673632de1ac4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4\" (UID: \"92388ca6-1733-4b12-89c7-673632de1ac4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:23:59.301159 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.301101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbfkr\" (UniqueName: \"kubernetes.io/projected/92388ca6-1733-4b12-89c7-673632de1ac4-kube-api-access-dbfkr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4\" (UID: \"92388ca6-1733-4b12-89c7-673632de1ac4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:23:59.301159 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.301160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92388ca6-1733-4b12-89c7-673632de1ac4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4\" (UID: \"92388ca6-1733-4b12-89c7-673632de1ac4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:23:59.301444 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.301206    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92388ca6-1733-4b12-89c7-673632de1ac4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4\" (UID: \"92388ca6-1733-4b12-89c7-673632de1ac4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:23:59.301669 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.301648    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92388ca6-1733-4b12-89c7-673632de1ac4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4\" (UID: \"92388ca6-1733-4b12-89c7-673632de1ac4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:23:59.301669 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.301661    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92388ca6-1733-4b12-89c7-673632de1ac4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4\" (UID: \"92388ca6-1733-4b12-89c7-673632de1ac4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:23:59.309615 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.309581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbfkr\" (UniqueName: \"kubernetes.io/projected/92388ca6-1733-4b12-89c7-673632de1ac4-kube-api-access-dbfkr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4\" (UID: \"92388ca6-1733-4b12-89c7-673632de1ac4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:23:59.448515 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.448420    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:23:59.584053 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.584022    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"]
Jul 27 20:23:59.585821 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:23:59.585782    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92388ca6_1733_4b12_89c7_673632de1ac4.slice/crio-2a2cddcabb9b5aeca931256dea2ca6e23e8cf6ec8d238733f29f00dc9d2bd768 WatchSource:0}: Error finding container 2a2cddcabb9b5aeca931256dea2ca6e23e8cf6ec8d238733f29f00dc9d2bd768: Status 404 returned error can't find the container with id 2a2cddcabb9b5aeca931256dea2ca6e23e8cf6ec8d238733f29f00dc9d2bd768
Jul 27 20:23:59.729500 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.729420    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"]
Jul 27 20:23:59.733084 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.733067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:23:59.740391 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.740363    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"]
Jul 27 20:23:59.806343 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.806305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f231303-b6d4-4e5d-a587-42375dcf5a20-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx\" (UID: \"1f231303-b6d4-4e5d-a587-42375dcf5a20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:23:59.806532 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.806363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f231303-b6d4-4e5d-a587-42375dcf5a20-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx\" (UID: \"1f231303-b6d4-4e5d-a587-42375dcf5a20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:23:59.806532 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.806445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvw74\" (UniqueName: \"kubernetes.io/projected/1f231303-b6d4-4e5d-a587-42375dcf5a20-kube-api-access-kvw74\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx\" (UID: \"1f231303-b6d4-4e5d-a587-42375dcf5a20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:23:59.903497 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.903459    2580 generic.go:356] "Generic (PLEG): container finished" podID="92388ca6-1733-4b12-89c7-673632de1ac4" containerID="81c3de3881996bd77dc274b223600ff7ea8479f691ba224ea7d41e8c730d67bf" exitCode=0
Jul 27 20:23:59.903660 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.903547    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4" event={"ID":"92388ca6-1733-4b12-89c7-673632de1ac4","Type":"ContainerDied","Data":"81c3de3881996bd77dc274b223600ff7ea8479f691ba224ea7d41e8c730d67bf"}
Jul 27 20:23:59.903660 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.903588    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4" event={"ID":"92388ca6-1733-4b12-89c7-673632de1ac4","Type":"ContainerStarted","Data":"2a2cddcabb9b5aeca931256dea2ca6e23e8cf6ec8d238733f29f00dc9d2bd768"}
Jul 27 20:23:59.907578 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.907554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f231303-b6d4-4e5d-a587-42375dcf5a20-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx\" (UID: \"1f231303-b6d4-4e5d-a587-42375dcf5a20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:23:59.907685 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.907595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f231303-b6d4-4e5d-a587-42375dcf5a20-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx\" (UID: \"1f231303-b6d4-4e5d-a587-42375dcf5a20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:23:59.907685 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.907644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvw74\" (UniqueName: \"kubernetes.io/projected/1f231303-b6d4-4e5d-a587-42375dcf5a20-kube-api-access-kvw74\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx\" (UID: \"1f231303-b6d4-4e5d-a587-42375dcf5a20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:23:59.907976 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.907956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f231303-b6d4-4e5d-a587-42375dcf5a20-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx\" (UID: \"1f231303-b6d4-4e5d-a587-42375dcf5a20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:23:59.908066 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.908043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f231303-b6d4-4e5d-a587-42375dcf5a20-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx\" (UID: \"1f231303-b6d4-4e5d-a587-42375dcf5a20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:23:59.916194 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:23:59.916174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvw74\" (UniqueName: \"kubernetes.io/projected/1f231303-b6d4-4e5d-a587-42375dcf5a20-kube-api-access-kvw74\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx\" (UID: \"1f231303-b6d4-4e5d-a587-42375dcf5a20\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:24:00.066548 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.066506    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:24:00.199975 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.199947    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"]
Jul 27 20:24:00.201940 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:24:00.201914    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f231303_b6d4_4e5d_a587_42375dcf5a20.slice/crio-54c12fe0e53c0b7dd91416870a70cfcb75278c1d6a35c02ffc1b82d5cc9fbb90 WatchSource:0}: Error finding container 54c12fe0e53c0b7dd91416870a70cfcb75278c1d6a35c02ffc1b82d5cc9fbb90: Status 404 returned error can't find the container with id 54c12fe0e53c0b7dd91416870a70cfcb75278c1d6a35c02ffc1b82d5cc9fbb90
Jul 27 20:24:00.332012 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.331931    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"]
Jul 27 20:24:00.335550 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.335529    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:00.343352 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.343328    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"]
Jul 27 20:24:00.412910 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.412876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sl4q\" (UniqueName: \"kubernetes.io/projected/ae72ac99-02d5-41fc-a256-1af902eac455-kube-api-access-7sl4q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk\" (UID: \"ae72ac99-02d5-41fc-a256-1af902eac455\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:00.412910 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.412915    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae72ac99-02d5-41fc-a256-1af902eac455-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk\" (UID: \"ae72ac99-02d5-41fc-a256-1af902eac455\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:00.413130 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.412953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae72ac99-02d5-41fc-a256-1af902eac455-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk\" (UID: \"ae72ac99-02d5-41fc-a256-1af902eac455\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:00.514279 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.514244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sl4q\" (UniqueName: \"kubernetes.io/projected/ae72ac99-02d5-41fc-a256-1af902eac455-kube-api-access-7sl4q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk\" (UID: \"ae72ac99-02d5-41fc-a256-1af902eac455\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:00.514447 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.514284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae72ac99-02d5-41fc-a256-1af902eac455-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk\" (UID: \"ae72ac99-02d5-41fc-a256-1af902eac455\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:00.514447 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.514415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae72ac99-02d5-41fc-a256-1af902eac455-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk\" (UID: \"ae72ac99-02d5-41fc-a256-1af902eac455\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:00.514631 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.514613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae72ac99-02d5-41fc-a256-1af902eac455-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk\" (UID: \"ae72ac99-02d5-41fc-a256-1af902eac455\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:00.514804 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.514786    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae72ac99-02d5-41fc-a256-1af902eac455-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk\" (UID: \"ae72ac99-02d5-41fc-a256-1af902eac455\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:00.523022 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.522987    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sl4q\" (UniqueName: \"kubernetes.io/projected/ae72ac99-02d5-41fc-a256-1af902eac455-kube-api-access-7sl4q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk\" (UID: \"ae72ac99-02d5-41fc-a256-1af902eac455\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:00.675908 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.675871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:00.741468 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.741433    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"]
Jul 27 20:24:00.746243 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.746218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:00.753981 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.753952    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"]
Jul 27 20:24:00.814203 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.814180    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"]
Jul 27 20:24:00.816173 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:24:00.816144    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae72ac99_02d5_41fc_a256_1af902eac455.slice/crio-d70291c6b6d33f72b026de348471d6c18bb223882b4edcdf8f306deefce49ca4 WatchSource:0}: Error finding container d70291c6b6d33f72b026de348471d6c18bb223882b4edcdf8f306deefce49ca4: Status 404 returned error can't find the container with id d70291c6b6d33f72b026de348471d6c18bb223882b4edcdf8f306deefce49ca4
Jul 27 20:24:00.817311 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.817284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p22hp\" (UniqueName: \"kubernetes.io/projected/1f6b017c-b54f-47e1-8004-aecc817c11e2-kube-api-access-p22hp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29\" (UID: \"1f6b017c-b54f-47e1-8004-aecc817c11e2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:00.817404 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.817328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f6b017c-b54f-47e1-8004-aecc817c11e2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29\" (UID: \"1f6b017c-b54f-47e1-8004-aecc817c11e2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:00.817565 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.817547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f6b017c-b54f-47e1-8004-aecc817c11e2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29\" (UID: \"1f6b017c-b54f-47e1-8004-aecc817c11e2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:00.910107 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.910074    2580 generic.go:356] "Generic (PLEG): container finished" podID="92388ca6-1733-4b12-89c7-673632de1ac4" containerID="4e722c660da843f7a013ff91351190e68d58116de1b9c6bb8fd553b98186f28c" exitCode=0
Jul 27 20:24:00.910234 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.910177    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4" event={"ID":"92388ca6-1733-4b12-89c7-673632de1ac4","Type":"ContainerDied","Data":"4e722c660da843f7a013ff91351190e68d58116de1b9c6bb8fd553b98186f28c"}
Jul 27 20:24:00.911807 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.911776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk" event={"ID":"ae72ac99-02d5-41fc-a256-1af902eac455","Type":"ContainerStarted","Data":"37f57f9293a23158494234dd23dc6bbeeb9b54c9183fd03d5f832dae7aecdf0c"}
Jul 27 20:24:00.911922 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.911830    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk" event={"ID":"ae72ac99-02d5-41fc-a256-1af902eac455","Type":"ContainerStarted","Data":"d70291c6b6d33f72b026de348471d6c18bb223882b4edcdf8f306deefce49ca4"}
Jul 27 20:24:00.913441 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.913418    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f231303-b6d4-4e5d-a587-42375dcf5a20" containerID="3422be2a5de4e5671c298cfe4b404355b7b9ea35dbd6c5ab33788441bcafa3d7" exitCode=0
Jul 27 20:24:00.913532 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.913454    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx" event={"ID":"1f231303-b6d4-4e5d-a587-42375dcf5a20","Type":"ContainerDied","Data":"3422be2a5de4e5671c298cfe4b404355b7b9ea35dbd6c5ab33788441bcafa3d7"}
Jul 27 20:24:00.913532 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.913485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx" event={"ID":"1f231303-b6d4-4e5d-a587-42375dcf5a20","Type":"ContainerStarted","Data":"54c12fe0e53c0b7dd91416870a70cfcb75278c1d6a35c02ffc1b82d5cc9fbb90"}
Jul 27 20:24:00.921079 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.921050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p22hp\" (UniqueName: \"kubernetes.io/projected/1f6b017c-b54f-47e1-8004-aecc817c11e2-kube-api-access-p22hp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29\" (UID: \"1f6b017c-b54f-47e1-8004-aecc817c11e2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:00.921224 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.921111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f6b017c-b54f-47e1-8004-aecc817c11e2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29\" (UID: \"1f6b017c-b54f-47e1-8004-aecc817c11e2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:00.921287 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.921226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f6b017c-b54f-47e1-8004-aecc817c11e2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29\" (UID: \"1f6b017c-b54f-47e1-8004-aecc817c11e2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:00.921590 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.921568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f6b017c-b54f-47e1-8004-aecc817c11e2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29\" (UID: \"1f6b017c-b54f-47e1-8004-aecc817c11e2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:00.921685 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.921564    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f6b017c-b54f-47e1-8004-aecc817c11e2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29\" (UID: \"1f6b017c-b54f-47e1-8004-aecc817c11e2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:00.933864 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:00.933838    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p22hp\" (UniqueName: \"kubernetes.io/projected/1f6b017c-b54f-47e1-8004-aecc817c11e2-kube-api-access-p22hp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29\" (UID: \"1f6b017c-b54f-47e1-8004-aecc817c11e2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:01.057537 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:01.057494    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:01.197107 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:01.197081    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"]
Jul 27 20:24:01.198460 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:24:01.198433    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6b017c_b54f_47e1_8004_aecc817c11e2.slice/crio-9412335f441bb13c87ff053e75809d41296c6ab9439f61429405dfc2c6ef278b WatchSource:0}: Error finding container 9412335f441bb13c87ff053e75809d41296c6ab9439f61429405dfc2c6ef278b: Status 404 returned error can't find the container with id 9412335f441bb13c87ff053e75809d41296c6ab9439f61429405dfc2c6ef278b
Jul 27 20:24:01.924785 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:01.924690    2580 generic.go:356] "Generic (PLEG): container finished" podID="92388ca6-1733-4b12-89c7-673632de1ac4" containerID="9a6a61bda48057ca63c011c58c5c7865ea83c1c6eb0e47f3f46b122c2def3fb4" exitCode=0
Jul 27 20:24:01.925162 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:01.924776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4" event={"ID":"92388ca6-1733-4b12-89c7-673632de1ac4","Type":"ContainerDied","Data":"9a6a61bda48057ca63c011c58c5c7865ea83c1c6eb0e47f3f46b122c2def3fb4"}
Jul 27 20:24:01.926228 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:01.926201    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f6b017c-b54f-47e1-8004-aecc817c11e2" containerID="254a624e42ef22e1fd62ae2cb3deb0fe15d5f8057434ee4ecd4eb23227325c94" exitCode=0
Jul 27 20:24:01.926345 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:01.926280    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29" event={"ID":"1f6b017c-b54f-47e1-8004-aecc817c11e2","Type":"ContainerDied","Data":"254a624e42ef22e1fd62ae2cb3deb0fe15d5f8057434ee4ecd4eb23227325c94"}
Jul 27 20:24:01.926345 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:01.926317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29" event={"ID":"1f6b017c-b54f-47e1-8004-aecc817c11e2","Type":"ContainerStarted","Data":"9412335f441bb13c87ff053e75809d41296c6ab9439f61429405dfc2c6ef278b"}
Jul 27 20:24:01.927847 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:01.927821    2580 generic.go:356] "Generic (PLEG): container finished" podID="ae72ac99-02d5-41fc-a256-1af902eac455" containerID="37f57f9293a23158494234dd23dc6bbeeb9b54c9183fd03d5f832dae7aecdf0c" exitCode=0
Jul 27 20:24:01.927945 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:01.927852    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk" event={"ID":"ae72ac99-02d5-41fc-a256-1af902eac455","Type":"ContainerDied","Data":"37f57f9293a23158494234dd23dc6bbeeb9b54c9183fd03d5f832dae7aecdf0c"}
Jul 27 20:24:01.930082 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:01.930027    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f231303-b6d4-4e5d-a587-42375dcf5a20" containerID="e8fd470aa4d391d5493ae8328f2f7b7dcf4985ca9d1401bd8e0fc52b2e36aeb0" exitCode=0
Jul 27 20:24:01.930141 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:01.930088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx" event={"ID":"1f231303-b6d4-4e5d-a587-42375dcf5a20","Type":"ContainerDied","Data":"e8fd470aa4d391d5493ae8328f2f7b7dcf4985ca9d1401bd8e0fc52b2e36aeb0"}
Jul 27 20:24:02.939777 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:02.939725    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f231303-b6d4-4e5d-a587-42375dcf5a20" containerID="5f53039d3958dcfbeb294ebbebaf6df0e5cd6075111d04f3d2fe5f416ba840e8" exitCode=0
Jul 27 20:24:02.940132 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:02.939780    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx" event={"ID":"1f231303-b6d4-4e5d-a587-42375dcf5a20","Type":"ContainerDied","Data":"5f53039d3958dcfbeb294ebbebaf6df0e5cd6075111d04f3d2fe5f416ba840e8"}
Jul 27 20:24:02.941960 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:02.941937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29" event={"ID":"1f6b017c-b54f-47e1-8004-aecc817c11e2","Type":"ContainerStarted","Data":"e6e1ae592c2c72a61feec2cf42897565392670f62f771ca7240c7521cba74d12"}
Jul 27 20:24:02.944134 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:02.944108    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk" event={"ID":"ae72ac99-02d5-41fc-a256-1af902eac455","Type":"ContainerStarted","Data":"811e005d28c8c5f30a286a2d7001b69a9ce83e1af3987755e6af4bc73624393c"}
Jul 27 20:24:03.090135 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.090108    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:24:03.139292 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.139263    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbfkr\" (UniqueName: \"kubernetes.io/projected/92388ca6-1733-4b12-89c7-673632de1ac4-kube-api-access-dbfkr\") pod \"92388ca6-1733-4b12-89c7-673632de1ac4\" (UID: \"92388ca6-1733-4b12-89c7-673632de1ac4\") "
Jul 27 20:24:03.139442 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.139301    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92388ca6-1733-4b12-89c7-673632de1ac4-bundle\") pod \"92388ca6-1733-4b12-89c7-673632de1ac4\" (UID: \"92388ca6-1733-4b12-89c7-673632de1ac4\") "
Jul 27 20:24:03.139442 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.139323    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92388ca6-1733-4b12-89c7-673632de1ac4-util\") pod \"92388ca6-1733-4b12-89c7-673632de1ac4\" (UID: \"92388ca6-1733-4b12-89c7-673632de1ac4\") "
Jul 27 20:24:03.139878 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.139857    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92388ca6-1733-4b12-89c7-673632de1ac4-bundle" (OuterVolumeSpecName: "bundle") pod "92388ca6-1733-4b12-89c7-673632de1ac4" (UID: "92388ca6-1733-4b12-89c7-673632de1ac4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:24:03.141280 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.141253    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92388ca6-1733-4b12-89c7-673632de1ac4-kube-api-access-dbfkr" (OuterVolumeSpecName: "kube-api-access-dbfkr") pod "92388ca6-1733-4b12-89c7-673632de1ac4" (UID: "92388ca6-1733-4b12-89c7-673632de1ac4"). InnerVolumeSpecName "kube-api-access-dbfkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:24:03.144951 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.144919    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92388ca6-1733-4b12-89c7-673632de1ac4-util" (OuterVolumeSpecName: "util") pod "92388ca6-1733-4b12-89c7-673632de1ac4" (UID: "92388ca6-1733-4b12-89c7-673632de1ac4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:24:03.240994 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.240963    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbfkr\" (UniqueName: \"kubernetes.io/projected/92388ca6-1733-4b12-89c7-673632de1ac4-kube-api-access-dbfkr\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:24:03.240994 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.240988    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92388ca6-1733-4b12-89c7-673632de1ac4-bundle\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:24:03.240994 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.240999    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92388ca6-1733-4b12-89c7-673632de1ac4-util\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:24:03.950813 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.950774    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4" event={"ID":"92388ca6-1733-4b12-89c7-673632de1ac4","Type":"ContainerDied","Data":"2a2cddcabb9b5aeca931256dea2ca6e23e8cf6ec8d238733f29f00dc9d2bd768"}
Jul 27 20:24:03.951176 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.950835    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a2cddcabb9b5aeca931256dea2ca6e23e8cf6ec8d238733f29f00dc9d2bd768"
Jul 27 20:24:03.951176 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.950791    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4"
Jul 27 20:24:03.952588 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.952563    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f6b017c-b54f-47e1-8004-aecc817c11e2" containerID="e6e1ae592c2c72a61feec2cf42897565392670f62f771ca7240c7521cba74d12" exitCode=0
Jul 27 20:24:03.952727 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.952596    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29" event={"ID":"1f6b017c-b54f-47e1-8004-aecc817c11e2","Type":"ContainerDied","Data":"e6e1ae592c2c72a61feec2cf42897565392670f62f771ca7240c7521cba74d12"}
Jul 27 20:24:03.954629 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.954601    2580 generic.go:356] "Generic (PLEG): container finished" podID="ae72ac99-02d5-41fc-a256-1af902eac455" containerID="811e005d28c8c5f30a286a2d7001b69a9ce83e1af3987755e6af4bc73624393c" exitCode=0
Jul 27 20:24:03.954735 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:03.954681    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk" event={"ID":"ae72ac99-02d5-41fc-a256-1af902eac455","Type":"ContainerDied","Data":"811e005d28c8c5f30a286a2d7001b69a9ce83e1af3987755e6af4bc73624393c"}
Jul 27 20:24:04.107402 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.107372    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:24:04.147314 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.147280    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvw74\" (UniqueName: \"kubernetes.io/projected/1f231303-b6d4-4e5d-a587-42375dcf5a20-kube-api-access-kvw74\") pod \"1f231303-b6d4-4e5d-a587-42375dcf5a20\" (UID: \"1f231303-b6d4-4e5d-a587-42375dcf5a20\") "
Jul 27 20:24:04.147449 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.147421    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f231303-b6d4-4e5d-a587-42375dcf5a20-bundle\") pod \"1f231303-b6d4-4e5d-a587-42375dcf5a20\" (UID: \"1f231303-b6d4-4e5d-a587-42375dcf5a20\") "
Jul 27 20:24:04.147495 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.147460    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f231303-b6d4-4e5d-a587-42375dcf5a20-util\") pod \"1f231303-b6d4-4e5d-a587-42375dcf5a20\" (UID: \"1f231303-b6d4-4e5d-a587-42375dcf5a20\") "
Jul 27 20:24:04.147930 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.147906    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f231303-b6d4-4e5d-a587-42375dcf5a20-bundle" (OuterVolumeSpecName: "bundle") pod "1f231303-b6d4-4e5d-a587-42375dcf5a20" (UID: "1f231303-b6d4-4e5d-a587-42375dcf5a20"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:24:04.149379 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.149349    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f231303-b6d4-4e5d-a587-42375dcf5a20-kube-api-access-kvw74" (OuterVolumeSpecName: "kube-api-access-kvw74") pod "1f231303-b6d4-4e5d-a587-42375dcf5a20" (UID: "1f231303-b6d4-4e5d-a587-42375dcf5a20"). InnerVolumeSpecName "kube-api-access-kvw74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:24:04.152701 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.152681    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f231303-b6d4-4e5d-a587-42375dcf5a20-util" (OuterVolumeSpecName: "util") pod "1f231303-b6d4-4e5d-a587-42375dcf5a20" (UID: "1f231303-b6d4-4e5d-a587-42375dcf5a20"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:24:04.248881 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.248843    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f231303-b6d4-4e5d-a587-42375dcf5a20-bundle\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:24:04.248881 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.248871    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f231303-b6d4-4e5d-a587-42375dcf5a20-util\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:24:04.248881 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.248885    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvw74\" (UniqueName: \"kubernetes.io/projected/1f231303-b6d4-4e5d-a587-42375dcf5a20-kube-api-access-kvw74\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:24:04.962169 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.962134    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f6b017c-b54f-47e1-8004-aecc817c11e2" containerID="a6826061ee1048d9ae7a0bb2952cd50e0c1df746b1e1fd4eed65757ab1162d74" exitCode=0
Jul 27 20:24:04.962557 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.962196    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29" event={"ID":"1f6b017c-b54f-47e1-8004-aecc817c11e2","Type":"ContainerDied","Data":"a6826061ee1048d9ae7a0bb2952cd50e0c1df746b1e1fd4eed65757ab1162d74"}
Jul 27 20:24:04.964278 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.964250    2580 generic.go:356] "Generic (PLEG): container finished" podID="ae72ac99-02d5-41fc-a256-1af902eac455" containerID="1382ee423125132e459d6f11bf353c21c13e24f2a95193f1648343ca9e6e4712" exitCode=0
Jul 27 20:24:04.964386 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.964321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk" event={"ID":"ae72ac99-02d5-41fc-a256-1af902eac455","Type":"ContainerDied","Data":"1382ee423125132e459d6f11bf353c21c13e24f2a95193f1648343ca9e6e4712"}
Jul 27 20:24:04.966324 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.966303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx" event={"ID":"1f231303-b6d4-4e5d-a587-42375dcf5a20","Type":"ContainerDied","Data":"54c12fe0e53c0b7dd91416870a70cfcb75278c1d6a35c02ffc1b82d5cc9fbb90"}
Jul 27 20:24:04.966433 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.966329    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx"
Jul 27 20:24:04.966433 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:04.966338    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54c12fe0e53c0b7dd91416870a70cfcb75278c1d6a35c02ffc1b82d5cc9fbb90"
Jul 27 20:24:06.110991 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.110956    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:06.138661 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.138634    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:06.168180 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.168150    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f6b017c-b54f-47e1-8004-aecc817c11e2-util\") pod \"1f6b017c-b54f-47e1-8004-aecc817c11e2\" (UID: \"1f6b017c-b54f-47e1-8004-aecc817c11e2\") "
Jul 27 20:24:06.168362 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.168214    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p22hp\" (UniqueName: \"kubernetes.io/projected/1f6b017c-b54f-47e1-8004-aecc817c11e2-kube-api-access-p22hp\") pod \"1f6b017c-b54f-47e1-8004-aecc817c11e2\" (UID: \"1f6b017c-b54f-47e1-8004-aecc817c11e2\") "
Jul 27 20:24:06.168362 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.168242    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f6b017c-b54f-47e1-8004-aecc817c11e2-bundle\") pod \"1f6b017c-b54f-47e1-8004-aecc817c11e2\" (UID: \"1f6b017c-b54f-47e1-8004-aecc817c11e2\") "
Jul 27 20:24:06.168790 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.168741    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6b017c-b54f-47e1-8004-aecc817c11e2-bundle" (OuterVolumeSpecName: "bundle") pod "1f6b017c-b54f-47e1-8004-aecc817c11e2" (UID: "1f6b017c-b54f-47e1-8004-aecc817c11e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:24:06.170369 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.170339    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f6b017c-b54f-47e1-8004-aecc817c11e2-kube-api-access-p22hp" (OuterVolumeSpecName: "kube-api-access-p22hp") pod "1f6b017c-b54f-47e1-8004-aecc817c11e2" (UID: "1f6b017c-b54f-47e1-8004-aecc817c11e2"). InnerVolumeSpecName "kube-api-access-p22hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:24:06.173538 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.173514    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6b017c-b54f-47e1-8004-aecc817c11e2-util" (OuterVolumeSpecName: "util") pod "1f6b017c-b54f-47e1-8004-aecc817c11e2" (UID: "1f6b017c-b54f-47e1-8004-aecc817c11e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:24:06.269828 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.269701    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae72ac99-02d5-41fc-a256-1af902eac455-bundle\") pod \"ae72ac99-02d5-41fc-a256-1af902eac455\" (UID: \"ae72ac99-02d5-41fc-a256-1af902eac455\") "
Jul 27 20:24:06.269828 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.269796    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sl4q\" (UniqueName: \"kubernetes.io/projected/ae72ac99-02d5-41fc-a256-1af902eac455-kube-api-access-7sl4q\") pod \"ae72ac99-02d5-41fc-a256-1af902eac455\" (UID: \"ae72ac99-02d5-41fc-a256-1af902eac455\") "
Jul 27 20:24:06.270058 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.269856    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae72ac99-02d5-41fc-a256-1af902eac455-util\") pod \"ae72ac99-02d5-41fc-a256-1af902eac455\" (UID: \"ae72ac99-02d5-41fc-a256-1af902eac455\") "
Jul 27 20:24:06.270167 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.270150    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p22hp\" (UniqueName: \"kubernetes.io/projected/1f6b017c-b54f-47e1-8004-aecc817c11e2-kube-api-access-p22hp\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:24:06.270218 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.270173    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f6b017c-b54f-47e1-8004-aecc817c11e2-bundle\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:24:06.270218 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.270187    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f6b017c-b54f-47e1-8004-aecc817c11e2-util\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:24:06.270386 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.270346    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae72ac99-02d5-41fc-a256-1af902eac455-bundle" (OuterVolumeSpecName: "bundle") pod "ae72ac99-02d5-41fc-a256-1af902eac455" (UID: "ae72ac99-02d5-41fc-a256-1af902eac455"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:24:06.272102 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.272078    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae72ac99-02d5-41fc-a256-1af902eac455-kube-api-access-7sl4q" (OuterVolumeSpecName: "kube-api-access-7sl4q") pod "ae72ac99-02d5-41fc-a256-1af902eac455" (UID: "ae72ac99-02d5-41fc-a256-1af902eac455"). InnerVolumeSpecName "kube-api-access-7sl4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:24:06.349737 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.349694    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae72ac99-02d5-41fc-a256-1af902eac455-util" (OuterVolumeSpecName: "util") pod "ae72ac99-02d5-41fc-a256-1af902eac455" (UID: "ae72ac99-02d5-41fc-a256-1af902eac455"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:24:06.371382 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.371353    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae72ac99-02d5-41fc-a256-1af902eac455-bundle\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:24:06.371382 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.371382    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sl4q\" (UniqueName: \"kubernetes.io/projected/ae72ac99-02d5-41fc-a256-1af902eac455-kube-api-access-7sl4q\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:24:06.371497 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.371393    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae72ac99-02d5-41fc-a256-1af902eac455-util\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:24:06.984141 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.984107    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29"
Jul 27 20:24:06.984141 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.984133    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29" event={"ID":"1f6b017c-b54f-47e1-8004-aecc817c11e2","Type":"ContainerDied","Data":"9412335f441bb13c87ff053e75809d41296c6ab9439f61429405dfc2c6ef278b"}
Jul 27 20:24:06.984385 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.984215    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9412335f441bb13c87ff053e75809d41296c6ab9439f61429405dfc2c6ef278b"
Jul 27 20:24:06.986208 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.986172    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk"
Jul 27 20:24:06.986208 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.986193    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk" event={"ID":"ae72ac99-02d5-41fc-a256-1af902eac455","Type":"ContainerDied","Data":"d70291c6b6d33f72b026de348471d6c18bb223882b4edcdf8f306deefce49ca4"}
Jul 27 20:24:06.986415 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:06.986239    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d70291c6b6d33f72b026de348471d6c18bb223882b4edcdf8f306deefce49ca4"
Jul 27 20:24:15.358486 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358448    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x"]
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358850    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f231303-b6d4-4e5d-a587-42375dcf5a20" containerName="util"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358864    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f231303-b6d4-4e5d-a587-42375dcf5a20" containerName="util"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358874    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae72ac99-02d5-41fc-a256-1af902eac455" containerName="util"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358880    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae72ac99-02d5-41fc-a256-1af902eac455" containerName="util"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358886    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6b017c-b54f-47e1-8004-aecc817c11e2" containerName="pull"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358892    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6b017c-b54f-47e1-8004-aecc817c11e2" containerName="pull"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358900    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6b017c-b54f-47e1-8004-aecc817c11e2" containerName="extract"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358905    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6b017c-b54f-47e1-8004-aecc817c11e2" containerName="extract"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358912    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae72ac99-02d5-41fc-a256-1af902eac455" containerName="extract"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358916    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae72ac99-02d5-41fc-a256-1af902eac455" containerName="extract"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358927    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92388ca6-1733-4b12-89c7-673632de1ac4" containerName="util"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358932    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="92388ca6-1733-4b12-89c7-673632de1ac4" containerName="util"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358939    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f231303-b6d4-4e5d-a587-42375dcf5a20" containerName="pull"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358944    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f231303-b6d4-4e5d-a587-42375dcf5a20" containerName="pull"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358951    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae72ac99-02d5-41fc-a256-1af902eac455" containerName="pull"
Jul 27 20:24:15.358947 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358956    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae72ac99-02d5-41fc-a256-1af902eac455" containerName="pull"
Jul 27 20:24:15.359416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358970    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92388ca6-1733-4b12-89c7-673632de1ac4" containerName="pull"
Jul 27 20:24:15.359416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358975    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="92388ca6-1733-4b12-89c7-673632de1ac4" containerName="pull"
Jul 27 20:24:15.359416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358981    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6b017c-b54f-47e1-8004-aecc817c11e2" containerName="util"
Jul 27 20:24:15.359416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358986    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6b017c-b54f-47e1-8004-aecc817c11e2" containerName="util"
Jul 27 20:24:15.359416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.358994    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92388ca6-1733-4b12-89c7-673632de1ac4" containerName="extract"
Jul 27 20:24:15.359416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.359000    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="92388ca6-1733-4b12-89c7-673632de1ac4" containerName="extract"
Jul 27 20:24:15.359416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.359006    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f231303-b6d4-4e5d-a587-42375dcf5a20" containerName="extract"
Jul 27 20:24:15.359416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.359011    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f231303-b6d4-4e5d-a587-42375dcf5a20" containerName="extract"
Jul 27 20:24:15.359416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.359060    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="92388ca6-1733-4b12-89c7-673632de1ac4" containerName="extract"
Jul 27 20:24:15.359416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.359065    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae72ac99-02d5-41fc-a256-1af902eac455" containerName="extract"
Jul 27 20:24:15.359416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.359074    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f6b017c-b54f-47e1-8004-aecc817c11e2" containerName="extract"
Jul 27 20:24:15.359416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.359081    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f231303-b6d4-4e5d-a587-42375dcf5a20" containerName="extract"
Jul 27 20:24:15.364343 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.364321    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x"
Jul 27 20:24:15.366616 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.366591    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mf6rt\""
Jul 27 20:24:15.366766 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.366632    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 27 20:24:15.373961 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.373934    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x"]
Jul 27 20:24:15.447815 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.447777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp4zf\" (UniqueName: \"kubernetes.io/projected/762d4d63-7f89-4379-9854-b89dae61a3ce-kube-api-access-sp4zf\") pod \"dns-operator-controller-manager-864dd78c4c-s8x9x\" (UID: \"762d4d63-7f89-4379-9854-b89dae61a3ce\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x"
Jul 27 20:24:15.549091 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.549051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp4zf\" (UniqueName: \"kubernetes.io/projected/762d4d63-7f89-4379-9854-b89dae61a3ce-kube-api-access-sp4zf\") pod \"dns-operator-controller-manager-864dd78c4c-s8x9x\" (UID: \"762d4d63-7f89-4379-9854-b89dae61a3ce\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x"
Jul 27 20:24:15.559051 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.559024    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp4zf\" (UniqueName: \"kubernetes.io/projected/762d4d63-7f89-4379-9854-b89dae61a3ce-kube-api-access-sp4zf\") pod \"dns-operator-controller-manager-864dd78c4c-s8x9x\" (UID: \"762d4d63-7f89-4379-9854-b89dae61a3ce\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x"
Jul 27 20:24:15.674599 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.674509    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x"
Jul 27 20:24:15.808986 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:15.808957    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x"]
Jul 27 20:24:15.811057 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:24:15.811031    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762d4d63_7f89_4379_9854_b89dae61a3ce.slice/crio-387bc694bfb0d9e8ba81002530956a8f8b3955f196fa6c67808d5ac1855b5084 WatchSource:0}: Error finding container 387bc694bfb0d9e8ba81002530956a8f8b3955f196fa6c67808d5ac1855b5084: Status 404 returned error can't find the container with id 387bc694bfb0d9e8ba81002530956a8f8b3955f196fa6c67808d5ac1855b5084
Jul 27 20:24:16.034557 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:16.034524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x" event={"ID":"762d4d63-7f89-4379-9854-b89dae61a3ce","Type":"ContainerStarted","Data":"387bc694bfb0d9e8ba81002530956a8f8b3955f196fa6c67808d5ac1855b5084"}
Jul 27 20:24:17.530073 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.530034    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-766f949564-nww57"]
Jul 27 20:24:17.534122 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.534088    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.543569 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.543542    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766f949564-nww57"]
Jul 27 20:24:17.668646 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.668607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e54ced22-ea40-44e2-8286-6d3a8a926b23-console-serving-cert\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.668646 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.668646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e54ced22-ea40-44e2-8286-6d3a8a926b23-trusted-ca-bundle\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.668931 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.668672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e54ced22-ea40-44e2-8286-6d3a8a926b23-oauth-serving-cert\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.668931 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.668784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5bmt\" (UniqueName: \"kubernetes.io/projected/e54ced22-ea40-44e2-8286-6d3a8a926b23-kube-api-access-g5bmt\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.668931 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.668836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e54ced22-ea40-44e2-8286-6d3a8a926b23-console-config\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.668931 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.668891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e54ced22-ea40-44e2-8286-6d3a8a926b23-console-oauth-config\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.669059 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.668937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e54ced22-ea40-44e2-8286-6d3a8a926b23-service-ca\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.769729 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.769701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e54ced22-ea40-44e2-8286-6d3a8a926b23-console-oauth-config\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.769862 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.769788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e54ced22-ea40-44e2-8286-6d3a8a926b23-service-ca\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.769862 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.769829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e54ced22-ea40-44e2-8286-6d3a8a926b23-console-serving-cert\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.769862 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.769848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e54ced22-ea40-44e2-8286-6d3a8a926b23-trusted-ca-bundle\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.770031 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.769877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e54ced22-ea40-44e2-8286-6d3a8a926b23-oauth-serving-cert\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.770141 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.770097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5bmt\" (UniqueName: \"kubernetes.io/projected/e54ced22-ea40-44e2-8286-6d3a8a926b23-kube-api-access-g5bmt\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.770480 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.770456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e54ced22-ea40-44e2-8286-6d3a8a926b23-console-config\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.770757 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.770715    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e54ced22-ea40-44e2-8286-6d3a8a926b23-service-ca\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.770881 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.770857    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e54ced22-ea40-44e2-8286-6d3a8a926b23-trusted-ca-bundle\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.770956 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.770905    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e54ced22-ea40-44e2-8286-6d3a8a926b23-oauth-serving-cert\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.771111 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.771090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e54ced22-ea40-44e2-8286-6d3a8a926b23-console-config\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.772483 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.772459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e54ced22-ea40-44e2-8286-6d3a8a926b23-console-oauth-config\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.772574 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.772530    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e54ced22-ea40-44e2-8286-6d3a8a926b23-console-serving-cert\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.777520 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.777497    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5bmt\" (UniqueName: \"kubernetes.io/projected/e54ced22-ea40-44e2-8286-6d3a8a926b23-kube-api-access-g5bmt\") pod \"console-766f949564-nww57\" (UID: \"e54ced22-ea40-44e2-8286-6d3a8a926b23\") " pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.848543 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.848507    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:17.986130 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:17.986099    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766f949564-nww57"]
Jul 27 20:24:17.987919 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:24:17.987896    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode54ced22_ea40_44e2_8286_6d3a8a926b23.slice/crio-f6f80f0c41d362533a172c1a18dda5f774604ae1c033e6083d5cad02130a4a78 WatchSource:0}: Error finding container f6f80f0c41d362533a172c1a18dda5f774604ae1c033e6083d5cad02130a4a78: Status 404 returned error can't find the container with id f6f80f0c41d362533a172c1a18dda5f774604ae1c033e6083d5cad02130a4a78
Jul 27 20:24:18.047042 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:18.047011    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766f949564-nww57" event={"ID":"e54ced22-ea40-44e2-8286-6d3a8a926b23","Type":"ContainerStarted","Data":"f6f80f0c41d362533a172c1a18dda5f774604ae1c033e6083d5cad02130a4a78"}
Jul 27 20:24:18.048659 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:18.048633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x" event={"ID":"762d4d63-7f89-4379-9854-b89dae61a3ce","Type":"ContainerStarted","Data":"b88becf35c90a8c1d3a6284fb15c6ec66f293e7757d690a3bcd87066320b42c1"}
Jul 27 20:24:18.048921 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:18.048775    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x"
Jul 27 20:24:18.066929 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:18.066878    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x" podStartSLOduration=1.171700448 podStartE2EDuration="3.066860923s" totalImagesPullingTime="1.895160475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:24:18.0642339 +0000 UTC m=+413.720389247" watchObservedRunningTime="2026-07-27 20:24:18.066860923 +0000 UTC m=+413.723016266"
Jul 27 20:24:18.860560 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:18.860522    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"]
Jul 27 20:24:18.864164 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:18.864146    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:24:18.866573 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:18.866548    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5tnn5\""
Jul 27 20:24:18.872910 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:18.872886    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"]
Jul 27 20:24:18.982712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:18.982676    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4mjd\" (UniqueName: \"kubernetes.io/projected/674505c6-f139-4114-bc6e-cbec521fd4a5-kube-api-access-f4mjd\") pod \"limitador-operator-controller-manager-859d7b78bd-cxfhm\" (UID: \"674505c6-f139-4114-bc6e-cbec521fd4a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:24:19.056186 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:19.056153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766f949564-nww57" event={"ID":"e54ced22-ea40-44e2-8286-6d3a8a926b23","Type":"ContainerStarted","Data":"bc2ba7ebd572cffc6d206f156dbb2d485008621d9f1556b20726751830396b58"}
Jul 27 20:24:19.075218 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:19.075168    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-766f949564-nww57" podStartSLOduration=2.075150758 podStartE2EDuration="2.075150758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:24:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:24:19.075016334 +0000 UTC m=+414.731171676" watchObservedRunningTime="2026-07-27 20:24:19.075150758 +0000 UTC m=+414.731306100"
Jul 27 20:24:19.083149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:19.083120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4mjd\" (UniqueName: \"kubernetes.io/projected/674505c6-f139-4114-bc6e-cbec521fd4a5-kube-api-access-f4mjd\") pod \"limitador-operator-controller-manager-859d7b78bd-cxfhm\" (UID: \"674505c6-f139-4114-bc6e-cbec521fd4a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:24:19.092493 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:19.092463    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4mjd\" (UniqueName: \"kubernetes.io/projected/674505c6-f139-4114-bc6e-cbec521fd4a5-kube-api-access-f4mjd\") pod \"limitador-operator-controller-manager-859d7b78bd-cxfhm\" (UID: \"674505c6-f139-4114-bc6e-cbec521fd4a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:24:19.176287 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:19.176202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:24:19.320892 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:19.320865    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"]
Jul 27 20:24:19.323103 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:24:19.323073    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674505c6_f139_4114_bc6e_cbec521fd4a5.slice/crio-02c5b7bd5dc2d9275b176ae0d0e3ff1d49150b4289731f38c86c168b7b84f38a WatchSource:0}: Error finding container 02c5b7bd5dc2d9275b176ae0d0e3ff1d49150b4289731f38c86c168b7b84f38a: Status 404 returned error can't find the container with id 02c5b7bd5dc2d9275b176ae0d0e3ff1d49150b4289731f38c86c168b7b84f38a
Jul 27 20:24:20.069967 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:20.069925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm" event={"ID":"674505c6-f139-4114-bc6e-cbec521fd4a5","Type":"ContainerStarted","Data":"02c5b7bd5dc2d9275b176ae0d0e3ff1d49150b4289731f38c86c168b7b84f38a"}
Jul 27 20:24:21.076959 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:21.076924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm" event={"ID":"674505c6-f139-4114-bc6e-cbec521fd4a5","Type":"ContainerStarted","Data":"302278f2a520dfee7658b663d0c46a28627eff90385301676dbbb5fac8e9b61c"}
Jul 27 20:24:21.077385 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:21.076983    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:24:21.100515 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:21.100463    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm" podStartSLOduration=1.505352019 podStartE2EDuration="3.100447947s" totalImagesPullingTime="1.595095928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:24:21.099192833 +0000 UTC m=+416.755348175" watchObservedRunningTime="2026-07-27 20:24:21.100447947 +0000 UTC m=+416.756603290"
Jul 27 20:24:22.792858 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:22.792804    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ldc54"]
Jul 27 20:24:22.796546 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:22.796522    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ldc54"
Jul 27 20:24:22.798850 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:22.798827    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dm4v7\""
Jul 27 20:24:22.810300 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:22.810274    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ldc54"]
Jul 27 20:24:22.923228 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:22.923192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g65c7\" (UniqueName: \"kubernetes.io/projected/0a08926b-049f-4722-846c-41b4ea4fd1c7-kube-api-access-g65c7\") pod \"authorino-operator-75cc8d5cb7-ldc54\" (UID: \"0a08926b-049f-4722-846c-41b4ea4fd1c7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ldc54"
Jul 27 20:24:23.024801 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:23.024728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g65c7\" (UniqueName: \"kubernetes.io/projected/0a08926b-049f-4722-846c-41b4ea4fd1c7-kube-api-access-g65c7\") pod \"authorino-operator-75cc8d5cb7-ldc54\" (UID: \"0a08926b-049f-4722-846c-41b4ea4fd1c7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ldc54"
Jul 27 20:24:23.033436 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:23.033408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g65c7\" (UniqueName: \"kubernetes.io/projected/0a08926b-049f-4722-846c-41b4ea4fd1c7-kube-api-access-g65c7\") pod \"authorino-operator-75cc8d5cb7-ldc54\" (UID: \"0a08926b-049f-4722-846c-41b4ea4fd1c7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ldc54"
Jul 27 20:24:23.106724 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:23.106619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ldc54"
Jul 27 20:24:23.241482 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:23.241456    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ldc54"]
Jul 27 20:24:23.243666 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:24:23.243638    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a08926b_049f_4722_846c_41b4ea4fd1c7.slice/crio-659fbe2e3de8bce6d410b403ae9a6212c61b6301fb6deb82db92c9959b4c0ca8 WatchSource:0}: Error finding container 659fbe2e3de8bce6d410b403ae9a6212c61b6301fb6deb82db92c9959b4c0ca8: Status 404 returned error can't find the container with id 659fbe2e3de8bce6d410b403ae9a6212c61b6301fb6deb82db92c9959b4c0ca8
Jul 27 20:24:24.097074 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:24.097036    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ldc54" event={"ID":"0a08926b-049f-4722-846c-41b4ea4fd1c7","Type":"ContainerStarted","Data":"659fbe2e3de8bce6d410b403ae9a6212c61b6301fb6deb82db92c9959b4c0ca8"}
Jul 27 20:24:26.109931 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:26.109890    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ldc54" event={"ID":"0a08926b-049f-4722-846c-41b4ea4fd1c7","Type":"ContainerStarted","Data":"b5a3d42b70e29928a75c16731ac54b19b2b6a94d692b21682be3427457e43c94"}
Jul 27 20:24:26.110310 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:26.109954    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ldc54"
Jul 27 20:24:26.136049 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:26.135999    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ldc54" podStartSLOduration=2.00436824 podStartE2EDuration="4.135984624s" totalImagesPullingTime="2.131616384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:24:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:24:26.133736553 +0000 UTC m=+421.789891899" watchObservedRunningTime="2026-07-27 20:24:26.135984624 +0000 UTC m=+421.792139967"
Jul 27 20:24:27.337553 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.337524    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"]
Jul 27 20:24:27.342331 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.342313    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:24:27.344768 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.344737    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-55ddz\""
Jul 27 20:24:27.356164 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.356140    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"]
Jul 27 20:24:27.374657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.374397    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09c0cb71-58af-45ad-9274-b462bb6c6d84-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" (UID: \"09c0cb71-58af-45ad-9274-b462bb6c6d84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:24:27.374657 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.374477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk6z8\" (UniqueName: \"kubernetes.io/projected/09c0cb71-58af-45ad-9274-b462bb6c6d84-kube-api-access-hk6z8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" (UID: \"09c0cb71-58af-45ad-9274-b462bb6c6d84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:24:27.475482 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.475429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk6z8\" (UniqueName: \"kubernetes.io/projected/09c0cb71-58af-45ad-9274-b462bb6c6d84-kube-api-access-hk6z8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" (UID: \"09c0cb71-58af-45ad-9274-b462bb6c6d84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:24:27.475658 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.475574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09c0cb71-58af-45ad-9274-b462bb6c6d84-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" (UID: \"09c0cb71-58af-45ad-9274-b462bb6c6d84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:24:27.476008 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.475988    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09c0cb71-58af-45ad-9274-b462bb6c6d84-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" (UID: \"09c0cb71-58af-45ad-9274-b462bb6c6d84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:24:27.487583 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.487557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk6z8\" (UniqueName: \"kubernetes.io/projected/09c0cb71-58af-45ad-9274-b462bb6c6d84-kube-api-access-hk6z8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" (UID: \"09c0cb71-58af-45ad-9274-b462bb6c6d84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:24:27.652127 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.652028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:24:27.790111 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.790040    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"]
Jul 27 20:24:27.792401 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:24:27.792369    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c0cb71_58af_45ad_9274_b462bb6c6d84.slice/crio-fa7bdeb72c3502aafcbf0c5c67319f2aa64ffc33b4904890c72be9ce30ac49be WatchSource:0}: Error finding container fa7bdeb72c3502aafcbf0c5c67319f2aa64ffc33b4904890c72be9ce30ac49be: Status 404 returned error can't find the container with id fa7bdeb72c3502aafcbf0c5c67319f2aa64ffc33b4904890c72be9ce30ac49be
Jul 27 20:24:27.848790 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.848732    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:27.848972 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.848805    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:27.853646 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:27.853619    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:28.121955 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:28.121921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx" event={"ID":"09c0cb71-58af-45ad-9274-b462bb6c6d84","Type":"ContainerStarted","Data":"fa7bdeb72c3502aafcbf0c5c67319f2aa64ffc33b4904890c72be9ce30ac49be"}
Jul 27 20:24:28.125762 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:28.125723    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-766f949564-nww57"
Jul 27 20:24:28.192463 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:28.192432    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56fdc9db94-s7jpp"]
Jul 27 20:24:29.058710 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:29.058681    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s8x9x"
Jul 27 20:24:32.085510 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:32.085476    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:24:34.172599 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:34.172561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx" event={"ID":"09c0cb71-58af-45ad-9274-b462bb6c6d84","Type":"ContainerStarted","Data":"b94b31d1e79320ad37da137b247dab250ffa0c8f67298965dcddf55f52b5c5e4"}
Jul 27 20:24:34.173017 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:34.172681    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:24:34.191709 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:34.191395    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx" podStartSLOduration=1.293659595 podStartE2EDuration="7.191374334s" totalImagesPullingTime="5.897714739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:24:34.190323133 +0000 UTC m=+429.846478475" watchObservedRunningTime="2026-07-27 20:24:34.191374334 +0000 UTC m=+429.847529678"
Jul 27 20:24:36.393634 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.393572    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"]
Jul 27 20:24:36.398849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.398828    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"
Jul 27 20:24:36.401026 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.401001    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 20:24:36.401191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.401030    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9wrkj\""
Jul 27 20:24:36.401191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.401030    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 20:24:36.405704 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.405679    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"]
Jul 27 20:24:36.440905 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.440870    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/91237c94-9c3b-4508-8f24-2d8e5f551ef8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rx77d\" (UID: \"91237c94-9c3b-4508-8f24-2d8e5f551ef8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"
Jul 27 20:24:36.441054 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.440910    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5kbb\" (UniqueName: \"kubernetes.io/projected/91237c94-9c3b-4508-8f24-2d8e5f551ef8-kube-api-access-c5kbb\") pod \"kuadrant-console-plugin-66b5774985-rx77d\" (UID: \"91237c94-9c3b-4508-8f24-2d8e5f551ef8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"
Jul 27 20:24:36.441054 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.440932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/91237c94-9c3b-4508-8f24-2d8e5f551ef8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rx77d\" (UID: \"91237c94-9c3b-4508-8f24-2d8e5f551ef8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"
Jul 27 20:24:36.541707 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.541667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/91237c94-9c3b-4508-8f24-2d8e5f551ef8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rx77d\" (UID: \"91237c94-9c3b-4508-8f24-2d8e5f551ef8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"
Jul 27 20:24:36.541912 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.541719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5kbb\" (UniqueName: \"kubernetes.io/projected/91237c94-9c3b-4508-8f24-2d8e5f551ef8-kube-api-access-c5kbb\") pod \"kuadrant-console-plugin-66b5774985-rx77d\" (UID: \"91237c94-9c3b-4508-8f24-2d8e5f551ef8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"
Jul 27 20:24:36.541912 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.541780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/91237c94-9c3b-4508-8f24-2d8e5f551ef8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rx77d\" (UID: \"91237c94-9c3b-4508-8f24-2d8e5f551ef8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"
Jul 27 20:24:36.541912 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:24:36.541842    2580 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 27 20:24:36.542072 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:24:36.541914    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91237c94-9c3b-4508-8f24-2d8e5f551ef8-plugin-serving-cert podName:91237c94-9c3b-4508-8f24-2d8e5f551ef8 nodeName:}" failed. No retries permitted until 2026-07-27 20:24:37.041894456 +0000 UTC m=+432.698049784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/91237c94-9c3b-4508-8f24-2d8e5f551ef8-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-rx77d" (UID: "91237c94-9c3b-4508-8f24-2d8e5f551ef8") : secret "plugin-serving-cert" not found
Jul 27 20:24:36.542434 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.542416    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/91237c94-9c3b-4508-8f24-2d8e5f551ef8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rx77d\" (UID: \"91237c94-9c3b-4508-8f24-2d8e5f551ef8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"
Jul 27 20:24:36.550136 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:36.550107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5kbb\" (UniqueName: \"kubernetes.io/projected/91237c94-9c3b-4508-8f24-2d8e5f551ef8-kube-api-access-c5kbb\") pod \"kuadrant-console-plugin-66b5774985-rx77d\" (UID: \"91237c94-9c3b-4508-8f24-2d8e5f551ef8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"
Jul 27 20:24:37.046149 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:37.046098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/91237c94-9c3b-4508-8f24-2d8e5f551ef8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rx77d\" (UID: \"91237c94-9c3b-4508-8f24-2d8e5f551ef8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"
Jul 27 20:24:37.048527 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:37.048502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/91237c94-9c3b-4508-8f24-2d8e5f551ef8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rx77d\" (UID: \"91237c94-9c3b-4508-8f24-2d8e5f551ef8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"
Jul 27 20:24:37.117548 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:37.117516    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ldc54"
Jul 27 20:24:37.309955 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:37.309865    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"
Jul 27 20:24:37.449471 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:37.449443    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d"]
Jul 27 20:24:37.451370 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:24:37.451334    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91237c94_9c3b_4508_8f24_2d8e5f551ef8.slice/crio-b74eeb8653fdb71fab10557156847578542ca3340d601e7cbe9273f004009678 WatchSource:0}: Error finding container b74eeb8653fdb71fab10557156847578542ca3340d601e7cbe9273f004009678: Status 404 returned error can't find the container with id b74eeb8653fdb71fab10557156847578542ca3340d601e7cbe9273f004009678
Jul 27 20:24:38.195017 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:38.194983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d" event={"ID":"91237c94-9c3b-4508-8f24-2d8e5f551ef8","Type":"ContainerStarted","Data":"b74eeb8653fdb71fab10557156847578542ca3340d601e7cbe9273f004009678"}
Jul 27 20:24:45.180279 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:45.180246    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:24:46.382049 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.382012    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"]
Jul 27 20:24:46.390725 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.390695    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:24:46.398867 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.398836    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"]
Jul 27 20:24:46.427792 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.427742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c7098d9-0a6c-488f-af2d-315512cbc063-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hlp6x\" (UID: \"7c7098d9-0a6c-488f-af2d-315512cbc063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:24:46.427979 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.427917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjm46\" (UniqueName: \"kubernetes.io/projected/7c7098d9-0a6c-488f-af2d-315512cbc063-kube-api-access-kjm46\") pod \"kuadrant-operator-controller-manager-55467d9f7-hlp6x\" (UID: \"7c7098d9-0a6c-488f-af2d-315512cbc063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:24:46.528887 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.528842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjm46\" (UniqueName: \"kubernetes.io/projected/7c7098d9-0a6c-488f-af2d-315512cbc063-kube-api-access-kjm46\") pod \"kuadrant-operator-controller-manager-55467d9f7-hlp6x\" (UID: \"7c7098d9-0a6c-488f-af2d-315512cbc063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:24:46.529076 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.528958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c7098d9-0a6c-488f-af2d-315512cbc063-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hlp6x\" (UID: \"7c7098d9-0a6c-488f-af2d-315512cbc063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:24:46.529323 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.529300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c7098d9-0a6c-488f-af2d-315512cbc063-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hlp6x\" (UID: \"7c7098d9-0a6c-488f-af2d-315512cbc063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:24:46.538697 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.538669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjm46\" (UniqueName: \"kubernetes.io/projected/7c7098d9-0a6c-488f-af2d-315512cbc063-kube-api-access-kjm46\") pod \"kuadrant-operator-controller-manager-55467d9f7-hlp6x\" (UID: \"7c7098d9-0a6c-488f-af2d-315512cbc063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:24:46.705431 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.705213    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:24:46.814899 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.814866    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"]
Jul 27 20:24:46.820553 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.820524    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"]
Jul 27 20:24:46.846722 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.846691    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"]
Jul 27 20:24:46.846969 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.846937    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" containerName="manager" containerID="cri-o://b94b31d1e79320ad37da137b247dab250ffa0c8f67298965dcddf55f52b5c5e4" gracePeriod=2
Jul 27 20:24:46.857861 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.857821    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"]
Jul 27 20:24:46.874996 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.874960    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"]
Jul 27 20:24:46.875228 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.875200    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" containerName="manager" containerID="cri-o://302278f2a520dfee7658b663d0c46a28627eff90385301676dbbb5fac8e9b61c" gracePeriod=2
Jul 27 20:24:46.877776 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.877739    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"]
Jul 27 20:24:46.878309 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.878287    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" containerName="manager"
Jul 27 20:24:46.878444 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.878430    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" containerName="manager"
Jul 27 20:24:46.878683 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.878664    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" containerName="manager"
Jul 27 20:24:46.882473 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.882450    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"
Jul 27 20:24:46.884273 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.884246    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"]
Jul 27 20:24:46.885182 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:24:46.885150    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:24:46.887867 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:24:46.887832    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxfhm\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:24:46.891606 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.891586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"]
Jul 27 20:24:46.908521 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.908490    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp"]
Jul 27 20:24:46.909046 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.909026    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" containerName="manager"
Jul 27 20:24:46.909046 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.909046    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" containerName="manager"
Jul 27 20:24:46.909237 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.909161    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" containerName="manager"
Jul 27 20:24:46.912424 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.912402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp"
Jul 27 20:24:46.914104 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:24:46.914005    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:24:46.924145 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.924113    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp"]
Jul 27 20:24:46.932602 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.932570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd8s4\" (UniqueName: \"kubernetes.io/projected/8fa5522d-fe95-4f8b-8e4c-d6b425cec567-kube-api-access-kd8s4\") pod \"limitador-operator-controller-manager-859d7b78bd-xxzhp\" (UID: \"8fa5522d-fe95-4f8b-8e4c-d6b425cec567\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp"
Jul 27 20:24:46.932775 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.932709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fb8088-7bc4-4dd5-a51d-9027eec5c973-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hh44p\" (UID: \"f9fb8088-7bc4-4dd5-a51d-9027eec5c973\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"
Jul 27 20:24:46.932846 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:46.932780    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnlm9\" (UniqueName: \"kubernetes.io/projected/f9fb8088-7bc4-4dd5-a51d-9027eec5c973-kube-api-access-qnlm9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hh44p\" (UID: \"f9fb8088-7bc4-4dd5-a51d-9027eec5c973\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"
Jul 27 20:24:47.033864 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:47.033824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnlm9\" (UniqueName: \"kubernetes.io/projected/f9fb8088-7bc4-4dd5-a51d-9027eec5c973-kube-api-access-qnlm9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hh44p\" (UID: \"f9fb8088-7bc4-4dd5-a51d-9027eec5c973\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"
Jul 27 20:24:47.034051 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:47.033900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd8s4\" (UniqueName: \"kubernetes.io/projected/8fa5522d-fe95-4f8b-8e4c-d6b425cec567-kube-api-access-kd8s4\") pod \"limitador-operator-controller-manager-859d7b78bd-xxzhp\" (UID: \"8fa5522d-fe95-4f8b-8e4c-d6b425cec567\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp"
Jul 27 20:24:47.034051 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:47.034010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fb8088-7bc4-4dd5-a51d-9027eec5c973-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hh44p\" (UID: \"f9fb8088-7bc4-4dd5-a51d-9027eec5c973\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"
Jul 27 20:24:47.034431 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:47.034400    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fb8088-7bc4-4dd5-a51d-9027eec5c973-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hh44p\" (UID: \"f9fb8088-7bc4-4dd5-a51d-9027eec5c973\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"
Jul 27 20:24:47.043692 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:47.043663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd8s4\" (UniqueName: \"kubernetes.io/projected/8fa5522d-fe95-4f8b-8e4c-d6b425cec567-kube-api-access-kd8s4\") pod \"limitador-operator-controller-manager-859d7b78bd-xxzhp\" (UID: \"8fa5522d-fe95-4f8b-8e4c-d6b425cec567\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp"
Jul 27 20:24:47.043856 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:47.043672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnlm9\" (UniqueName: \"kubernetes.io/projected/f9fb8088-7bc4-4dd5-a51d-9027eec5c973-kube-api-access-qnlm9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hh44p\" (UID: \"f9fb8088-7bc4-4dd5-a51d-9027eec5c973\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"
Jul 27 20:24:47.273637 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:47.273554    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"
Jul 27 20:24:47.280474 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:47.280444    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp"
Jul 27 20:24:53.214822 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:24:53.214758    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56fdc9db94-s7jpp" podUID="b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" containerName="console" containerID="cri-o://052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568" gracePeriod=15
Jul 27 20:25:00.180630 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.179024    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:25:00.185405 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.182795    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:25:00.185405 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.183078    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:25:00.185540 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.185405    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:25:00.187811 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.187216    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxfhm\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:25:00.246816 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.246691    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"]
Jul 27 20:25:00.247050 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:25:00.247019    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9fb8088_7bc4_4dd5_a51d_9027eec5c973.slice/crio-4531390a3ed59d68e4e319b3dc512dec5ab1b4e860b7e9828e576efccca67011 WatchSource:0}: Error finding container 4531390a3ed59d68e4e319b3dc512dec5ab1b4e860b7e9828e576efccca67011: Status 404 returned error can't find the container with id 4531390a3ed59d68e4e319b3dc512dec5ab1b4e860b7e9828e576efccca67011
Jul 27 20:25:00.252602 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.252236    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:25:00.270245 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.270214    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk6z8\" (UniqueName: \"kubernetes.io/projected/09c0cb71-58af-45ad-9274-b462bb6c6d84-kube-api-access-hk6z8\") pod \"09c0cb71-58af-45ad-9274-b462bb6c6d84\" (UID: \"09c0cb71-58af-45ad-9274-b462bb6c6d84\") "
Jul 27 20:25:00.270374 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.270297    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4mjd\" (UniqueName: \"kubernetes.io/projected/674505c6-f139-4114-bc6e-cbec521fd4a5-kube-api-access-f4mjd\") pod \"674505c6-f139-4114-bc6e-cbec521fd4a5\" (UID: \"674505c6-f139-4114-bc6e-cbec521fd4a5\") "
Jul 27 20:25:00.270374 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.270327    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09c0cb71-58af-45ad-9274-b462bb6c6d84-extensions-socket-volume\") pod \"09c0cb71-58af-45ad-9274-b462bb6c6d84\" (UID: \"09c0cb71-58af-45ad-9274-b462bb6c6d84\") "
Jul 27 20:25:00.270966 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.270938    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c0cb71-58af-45ad-9274-b462bb6c6d84-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "09c0cb71-58af-45ad-9274-b462bb6c6d84" (UID: "09c0cb71-58af-45ad-9274-b462bb6c6d84"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:25:00.272237 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.272213    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09c0cb71-58af-45ad-9274-b462bb6c6d84-kube-api-access-hk6z8" (OuterVolumeSpecName: "kube-api-access-hk6z8") pod "09c0cb71-58af-45ad-9274-b462bb6c6d84" (UID: "09c0cb71-58af-45ad-9274-b462bb6c6d84"). InnerVolumeSpecName "kube-api-access-hk6z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:25:00.272649 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.272635    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674505c6-f139-4114-bc6e-cbec521fd4a5-kube-api-access-f4mjd" (OuterVolumeSpecName: "kube-api-access-f4mjd") pod "674505c6-f139-4114-bc6e-cbec521fd4a5" (UID: "674505c6-f139-4114-bc6e-cbec521fd4a5"). InnerVolumeSpecName "kube-api-access-f4mjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:25:00.278697 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.278663    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxfhm\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:25:00.280605 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.280574    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:25:00.284491 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:25:00.284453    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa5522d_fe95_4f8b_8e4c_d6b425cec567.slice/crio-4237f05b54a68a7816120fe796a2d7ea901b213f6d6b1c7683b19c6ecdf42cb8 WatchSource:0}: Error finding container 4237f05b54a68a7816120fe796a2d7ea901b213f6d6b1c7683b19c6ecdf42cb8: Status 404 returned error can't find the container with id 4237f05b54a68a7816120fe796a2d7ea901b213f6d6b1c7683b19c6ecdf42cb8
Jul 27 20:25:00.284600 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.284565    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp"]
Jul 27 20:25:00.343264 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.343229    2580 generic.go:356] "Generic (PLEG): container finished" podID="09c0cb71-58af-45ad-9274-b462bb6c6d84" containerID="b94b31d1e79320ad37da137b247dab250ffa0c8f67298965dcddf55f52b5c5e4" exitCode=0
Jul 27 20:25:00.343391 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.343273    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:25:00.343391 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.343300    2580 scope.go:117] "RemoveContainer" containerID="b94b31d1e79320ad37da137b247dab250ffa0c8f67298965dcddf55f52b5c5e4"
Jul 27 20:25:00.344961 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.344938    2580 generic.go:356] "Generic (PLEG): container finished" podID="674505c6-f139-4114-bc6e-cbec521fd4a5" containerID="302278f2a520dfee7658b663d0c46a28627eff90385301676dbbb5fac8e9b61c" exitCode=0
Jul 27 20:25:00.345108 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.344987    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:25:00.345514 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.345394    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxfhm\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:25:00.347425 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.347165    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:25:00.347425 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.347364    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d" event={"ID":"91237c94-9c3b-4508-8f24-2d8e5f551ef8","Type":"ContainerStarted","Data":"5139461c5ca0e89ccf6bd108ba2a31e89dfdeddce9eebb9c5030496d2e9645b3"}
Jul 27 20:25:00.349145 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.349113    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxfhm\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:25:00.349639 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.349616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp" event={"ID":"8fa5522d-fe95-4f8b-8e4c-d6b425cec567","Type":"ContainerStarted","Data":"d66afc3fd1c831bfc9a7468452b68b43e3cc76dd67e29119a185126ecc8d161d"}
Jul 27 20:25:00.349734 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.349670    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp"
Jul 27 20:25:00.349734 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.349688    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp" event={"ID":"8fa5522d-fe95-4f8b-8e4c-d6b425cec567","Type":"ContainerStarted","Data":"4237f05b54a68a7816120fe796a2d7ea901b213f6d6b1c7683b19c6ecdf42cb8"}
Jul 27 20:25:00.350973 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.350946    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:25:00.352482 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.352214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p" event={"ID":"f9fb8088-7bc4-4dd5-a51d-9027eec5c973","Type":"ContainerStarted","Data":"f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59"}
Jul 27 20:25:00.352482 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.352263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p" event={"ID":"f9fb8088-7bc4-4dd5-a51d-9027eec5c973","Type":"ContainerStarted","Data":"4531390a3ed59d68e4e319b3dc512dec5ab1b4e860b7e9828e576efccca67011"}
Jul 27 20:25:00.352482 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.352290    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"
Jul 27 20:25:00.353083 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.352944    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:25:00.354059 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.354033    2580 generic.go:356] "Generic (PLEG): container finished" podID="b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" containerID="052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568" exitCode=0
Jul 27 20:25:00.354144 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.354073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56fdc9db94-s7jpp" event={"ID":"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5","Type":"ContainerDied","Data":"052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568"}
Jul 27 20:25:00.354144 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.354109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56fdc9db94-s7jpp" event={"ID":"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5","Type":"ContainerDied","Data":"e1f8937ddd4722f8cb5f0dd2655c72aca4d50adf4e8d406ca2e5c14ba61def3d"}
Jul 27 20:25:00.354144 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.354075    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56fdc9db94-s7jpp"
Jul 27 20:25:00.358715 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.358696    2580 scope.go:117] "RemoveContainer" containerID="b94b31d1e79320ad37da137b247dab250ffa0c8f67298965dcddf55f52b5c5e4"
Jul 27 20:25:00.359123 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.359094    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b94b31d1e79320ad37da137b247dab250ffa0c8f67298965dcddf55f52b5c5e4\": container with ID starting with b94b31d1e79320ad37da137b247dab250ffa0c8f67298965dcddf55f52b5c5e4 not found: ID does not exist" containerID="b94b31d1e79320ad37da137b247dab250ffa0c8f67298965dcddf55f52b5c5e4"
Jul 27 20:25:00.359217 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.359134    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b94b31d1e79320ad37da137b247dab250ffa0c8f67298965dcddf55f52b5c5e4"} err="failed to get container status \"b94b31d1e79320ad37da137b247dab250ffa0c8f67298965dcddf55f52b5c5e4\": rpc error: code = NotFound desc = could not find container \"b94b31d1e79320ad37da137b247dab250ffa0c8f67298965dcddf55f52b5c5e4\": container with ID starting with b94b31d1e79320ad37da137b247dab250ffa0c8f67298965dcddf55f52b5c5e4 not found: ID does not exist"
Jul 27 20:25:00.359217 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.359155    2580 scope.go:117] "RemoveContainer" containerID="302278f2a520dfee7658b663d0c46a28627eff90385301676dbbb5fac8e9b61c"
Jul 27 20:25:00.368166 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.368131    2580 scope.go:117] "RemoveContainer" containerID="302278f2a520dfee7658b663d0c46a28627eff90385301676dbbb5fac8e9b61c"
Jul 27 20:25:00.368545 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.368513    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"302278f2a520dfee7658b663d0c46a28627eff90385301676dbbb5fac8e9b61c\": container with ID starting with 302278f2a520dfee7658b663d0c46a28627eff90385301676dbbb5fac8e9b61c not found: ID does not exist" containerID="302278f2a520dfee7658b663d0c46a28627eff90385301676dbbb5fac8e9b61c"
Jul 27 20:25:00.368638 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.368553    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"302278f2a520dfee7658b663d0c46a28627eff90385301676dbbb5fac8e9b61c"} err="failed to get container status \"302278f2a520dfee7658b663d0c46a28627eff90385301676dbbb5fac8e9b61c\": rpc error: code = NotFound desc = could not find container \"302278f2a520dfee7658b663d0c46a28627eff90385301676dbbb5fac8e9b61c\": container with ID starting with 302278f2a520dfee7658b663d0c46a28627eff90385301676dbbb5fac8e9b61c not found: ID does not exist"
Jul 27 20:25:00.368638 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.368575    2580 scope.go:117] "RemoveContainer" containerID="052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568"
Jul 27 20:25:00.369116 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.369070    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rx77d" podStartSLOduration=1.659824713 podStartE2EDuration="24.369055709s" totalImagesPullingTime="22.709230996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:24:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:25:00.367874064 +0000 UTC m=+456.024029408" watchObservedRunningTime="2026-07-27 20:25:00.369055709 +0000 UTC m=+456.025211051"
Jul 27 20:25:00.372771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.371239    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-oauth-serving-cert\") pod \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") "
Jul 27 20:25:00.372771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.371299    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-trusted-ca-bundle\") pod \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") "
Jul 27 20:25:00.372771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.371341    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-serving-cert\") pod \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") "
Jul 27 20:25:00.372771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.371373    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgbrp\" (UniqueName: \"kubernetes.io/projected/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-kube-api-access-xgbrp\") pod \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") "
Jul 27 20:25:00.372771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.371439    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-config\") pod \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") "
Jul 27 20:25:00.372771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.371472    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-service-ca\") pod \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") "
Jul 27 20:25:00.372771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.371511    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-oauth-config\") pod \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\" (UID: \"b0ea0967-ef40-4afb-a502-2bdbc9a3aea5\") "
Jul 27 20:25:00.372771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.372021    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk6z8\" (UniqueName: \"kubernetes.io/projected/09c0cb71-58af-45ad-9274-b462bb6c6d84-kube-api-access-hk6z8\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:00.372771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.372063    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4mjd\" (UniqueName: \"kubernetes.io/projected/674505c6-f139-4114-bc6e-cbec521fd4a5-kube-api-access-f4mjd\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:00.372771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.372084    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09c0cb71-58af-45ad-9274-b462bb6c6d84-extensions-socket-volume\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:00.373321 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.372804    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" (UID: "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:25:00.373321 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.373090    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-config" (OuterVolumeSpecName: "console-config") pod "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" (UID: "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:25:00.373321 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.373213    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" (UID: "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:25:00.375497 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.373543    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" (UID: "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:25:00.375497 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.374442    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" (UID: "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:25:00.379555 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.379266    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" (UID: "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:25:00.379788 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.379574    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-kube-api-access-xgbrp" (OuterVolumeSpecName: "kube-api-access-xgbrp") pod "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" (UID: "b0ea0967-ef40-4afb-a502-2bdbc9a3aea5"). InnerVolumeSpecName "kube-api-access-xgbrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:25:00.386629 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.386547    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp" podStartSLOduration=14.386532662 podStartE2EDuration="14.386532662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:25:00.384810009 +0000 UTC m=+456.040965352" watchObservedRunningTime="2026-07-27 20:25:00.386532662 +0000 UTC m=+456.042688007"
Jul 27 20:25:00.386775 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.386707    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxfhm\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:25:00.389433 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.389416    2580 scope.go:117] "RemoveContainer" containerID="052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568"
Jul 27 20:25:00.389782 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.389761    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568\": container with ID starting with 052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568 not found: ID does not exist" containerID="052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568"
Jul 27 20:25:00.389867 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.389787    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568"} err="failed to get container status \"052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568\": rpc error: code = NotFound desc = could not find container \"052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568\": container with ID starting with 052320f406639286628b3e9795bd7f32f4f3b1c9c88af5f81f0e9664a832d568 not found: ID does not exist"
Jul 27 20:25:00.391528 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.391500    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxfhm\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:25:00.412076 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.412024    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p" podStartSLOduration=14.412007933 podStartE2EDuration="14.412007933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:25:00.41110312 +0000 UTC m=+456.067258463" watchObservedRunningTime="2026-07-27 20:25:00.412007933 +0000 UTC m=+456.068163281"
Jul 27 20:25:00.413171 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.413140    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:25:00.473283 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.473247    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-config\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:00.473283 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.473276    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:00.473283 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.473286    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-oauth-config\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:00.473283 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.473296    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-oauth-serving-cert\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:00.473584 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.473308    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-trusted-ca-bundle\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:00.473584 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.473324    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-console-serving-cert\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:00.473584 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.473401    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgbrp\" (UniqueName: \"kubernetes.io/projected/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5-kube-api-access-xgbrp\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:00.665076 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.665042    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxfhm\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxfhm"
Jul 27 20:25:00.667126 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:00.667097    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7ngxx\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7ngxx"
Jul 27 20:25:00.681883 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.681856    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56fdc9db94-s7jpp"]
Jul 27 20:25:00.685970 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.685948    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56fdc9db94-s7jpp"]
Jul 27 20:25:00.903031 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.902997    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09c0cb71-58af-45ad-9274-b462bb6c6d84" path="/var/lib/kubelet/pods/09c0cb71-58af-45ad-9274-b462bb6c6d84/volumes"
Jul 27 20:25:00.903339 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.903327    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="674505c6-f139-4114-bc6e-cbec521fd4a5" path="/var/lib/kubelet/pods/674505c6-f139-4114-bc6e-cbec521fd4a5/volumes"
Jul 27 20:25:00.903696 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:00.903684    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" path="/var/lib/kubelet/pods/b0ea0967-ef40-4afb-a502-2bdbc9a3aea5/volumes"
Jul 27 20:25:02.656688 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:02.656651    2580 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-hlp6x_kuadrant-system_7c7098d9-0a6c-488f-af2d-315512cbc063_0(ba9a1cadedace42539df44002c91b8e3670cb1873184329645d4bc77ecf8a60c): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-hlp6x to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 27 20:25:02.656972 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:02.656715    2580 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-hlp6x_kuadrant-system_7c7098d9-0a6c-488f-af2d-315512cbc063_0(ba9a1cadedace42539df44002c91b8e3670cb1873184329645d4bc77ecf8a60c): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-hlp6x to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:25:02.902579 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:02.902490    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"]
Jul 27 20:25:02.902760 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:02.902701    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p" podUID="f9fb8088-7bc4-4dd5-a51d-9027eec5c973" containerName="manager" containerID="cri-o://f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59" gracePeriod=10
Jul 27 20:25:03.168642 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.168576    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"
Jul 27 20:25:03.295051 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.295009    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnlm9\" (UniqueName: \"kubernetes.io/projected/f9fb8088-7bc4-4dd5-a51d-9027eec5c973-kube-api-access-qnlm9\") pod \"f9fb8088-7bc4-4dd5-a51d-9027eec5c973\" (UID: \"f9fb8088-7bc4-4dd5-a51d-9027eec5c973\") "
Jul 27 20:25:03.295051 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.295057    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fb8088-7bc4-4dd5-a51d-9027eec5c973-extensions-socket-volume\") pod \"f9fb8088-7bc4-4dd5-a51d-9027eec5c973\" (UID: \"f9fb8088-7bc4-4dd5-a51d-9027eec5c973\") "
Jul 27 20:25:03.295457 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.295433    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9fb8088-7bc4-4dd5-a51d-9027eec5c973-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f9fb8088-7bc4-4dd5-a51d-9027eec5c973" (UID: "f9fb8088-7bc4-4dd5-a51d-9027eec5c973"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:25:03.297204 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.297177    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9fb8088-7bc4-4dd5-a51d-9027eec5c973-kube-api-access-qnlm9" (OuterVolumeSpecName: "kube-api-access-qnlm9") pod "f9fb8088-7bc4-4dd5-a51d-9027eec5c973" (UID: "f9fb8088-7bc4-4dd5-a51d-9027eec5c973"). InnerVolumeSpecName "kube-api-access-qnlm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:25:03.373893 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.373858    2580 generic.go:356] "Generic (PLEG): container finished" podID="f9fb8088-7bc4-4dd5-a51d-9027eec5c973" containerID="f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59" exitCode=0
Jul 27 20:25:03.374069 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.373908    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"
Jul 27 20:25:03.374069 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.373939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p" event={"ID":"f9fb8088-7bc4-4dd5-a51d-9027eec5c973","Type":"ContainerDied","Data":"f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59"}
Jul 27 20:25:03.374069 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.374002    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p" event={"ID":"f9fb8088-7bc4-4dd5-a51d-9027eec5c973","Type":"ContainerDied","Data":"4531390a3ed59d68e4e319b3dc512dec5ab1b4e860b7e9828e576efccca67011"}
Jul 27 20:25:03.374069 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.374015    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:25:03.374069 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.374042    2580 scope.go:117] "RemoveContainer" containerID="f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59"
Jul 27 20:25:03.376249 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:03.376223    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hlp6x\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="7c7098d9-0a6c-488f-af2d-315512cbc063" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:25:03.382006 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.381984    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:25:03.384572 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:03.384548    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hlp6x\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="7c7098d9-0a6c-488f-af2d-315512cbc063" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:25:03.384572 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.384566    2580 scope.go:117] "RemoveContainer" containerID="f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59"
Jul 27 20:25:03.384883 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:03.384862    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59\": container with ID starting with f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59 not found: ID does not exist" containerID="f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59"
Jul 27 20:25:03.384960 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.384893    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59"} err="failed to get container status \"f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59\": rpc error: code = NotFound desc = could not find container \"f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59\": container with ID starting with f140bb42532a271825e81c570d584bbca33904cc9db301d772a803280a739e59 not found: ID does not exist"
Jul 27 20:25:03.395929 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.395903    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnlm9\" (UniqueName: \"kubernetes.io/projected/f9fb8088-7bc4-4dd5-a51d-9027eec5c973-kube-api-access-qnlm9\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:03.395929 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.395931    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9fb8088-7bc4-4dd5-a51d-9027eec5c973-extensions-socket-volume\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:03.398852 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.398824    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"]
Jul 27 20:25:03.412940 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.412912    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hh44p"]
Jul 27 20:25:03.496892 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.496792    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjm46\" (UniqueName: \"kubernetes.io/projected/7c7098d9-0a6c-488f-af2d-315512cbc063-kube-api-access-kjm46\") pod \"7c7098d9-0a6c-488f-af2d-315512cbc063\" (UID: \"7c7098d9-0a6c-488f-af2d-315512cbc063\") "
Jul 27 20:25:03.496892 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.496872    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c7098d9-0a6c-488f-af2d-315512cbc063-extensions-socket-volume\") pod \"7c7098d9-0a6c-488f-af2d-315512cbc063\" (UID: \"7c7098d9-0a6c-488f-af2d-315512cbc063\") "
Jul 27 20:25:03.497172 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.497144    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c7098d9-0a6c-488f-af2d-315512cbc063-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7c7098d9-0a6c-488f-af2d-315512cbc063" (UID: "7c7098d9-0a6c-488f-af2d-315512cbc063"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:25:03.499072 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.499046    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c7098d9-0a6c-488f-af2d-315512cbc063-kube-api-access-kjm46" (OuterVolumeSpecName: "kube-api-access-kjm46") pod "7c7098d9-0a6c-488f-af2d-315512cbc063" (UID: "7c7098d9-0a6c-488f-af2d-315512cbc063"). InnerVolumeSpecName "kube-api-access-kjm46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:25:03.598157 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.598121    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c7098d9-0a6c-488f-af2d-315512cbc063-extensions-socket-volume\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:03.598157 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:03.598150    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjm46\" (UniqueName: \"kubernetes.io/projected/7c7098d9-0a6c-488f-af2d-315512cbc063-kube-api-access-kjm46\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:04.380869 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:04.380842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:25:04.387027 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:04.386984    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hlp6x\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="7c7098d9-0a6c-488f-af2d-315512cbc063" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:25:04.391416 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:04.391387    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hlp6x\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="7c7098d9-0a6c-488f-af2d-315512cbc063" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:25:04.902590 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:04.902556    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hlp6x\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="7c7098d9-0a6c-488f-af2d-315512cbc063" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hlp6x"
Jul 27 20:25:04.903422 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:04.903400    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c7098d9-0a6c-488f-af2d-315512cbc063" path="/var/lib/kubelet/pods/7c7098d9-0a6c-488f-af2d-315512cbc063/volumes"
Jul 27 20:25:04.903671 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:04.903659    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9fb8088-7bc4-4dd5-a51d-9027eec5c973" path="/var/lib/kubelet/pods/f9fb8088-7bc4-4dd5-a51d-9027eec5c973/volumes"
Jul 27 20:25:11.364359 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:11.364324    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xxzhp"
Jul 27 20:25:19.268138 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.268096    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"]
Jul 27 20:25:19.269044 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.269016    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" containerName="console"
Jul 27 20:25:19.269044 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.269045    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" containerName="console"
Jul 27 20:25:19.269212 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.269082    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9fb8088-7bc4-4dd5-a51d-9027eec5c973" containerName="manager"
Jul 27 20:25:19.269212 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.269102    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9fb8088-7bc4-4dd5-a51d-9027eec5c973" containerName="manager"
Jul 27 20:25:19.269212 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.269198    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ea0967-ef40-4afb-a502-2bdbc9a3aea5" containerName="console"
Jul 27 20:25:19.269313 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.269219    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9fb8088-7bc4-4dd5-a51d-9027eec5c973" containerName="manager"
Jul 27 20:25:19.271584 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.271564    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.274108 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.274091    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-77x64\""
Jul 27 20:25:19.284182 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.284160    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"]
Jul 27 20:25:19.457983 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.457944    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.457983 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.457990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.458215 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.458006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.458215 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.458098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.458215 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.458202    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.458336 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.458249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.458336 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.458277    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.458336 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.458300    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7b76\" (UniqueName: \"kubernetes.io/projected/60e7f197-5fb2-47ed-9000-fd326c12eb3f-kube-api-access-b7b76\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.458433 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.458363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.559616 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.559571    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.559856 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.559645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.559856 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.559676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.559856 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.559702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.559856 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.559729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7b76\" (UniqueName: \"kubernetes.io/projected/60e7f197-5fb2-47ed-9000-fd326c12eb3f-kube-api-access-b7b76\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.559856 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.559779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.559856 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.559812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.559856 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.559837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.560302 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.559861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.560302 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.560108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.560392 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.560311    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.560485 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.560463    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.560568 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.560504    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.560813 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.560790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.562183 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.562160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.562352 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.562328    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.568899 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.568874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7b76\" (UniqueName: \"kubernetes.io/projected/60e7f197-5fb2-47ed-9000-fd326c12eb3f-kube-api-access-b7b76\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.571012 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.570989    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e7f197-5fb2-47ed-9000-fd326c12eb3f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xr7hz\" (UID: \"60e7f197-5fb2-47ed-9000-fd326c12eb3f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.581847 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.581827    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:19.729029 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.728999    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"]
Jul 27 20:25:19.731337 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:25:19.731307    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e7f197_5fb2_47ed_9000_fd326c12eb3f.slice/crio-8f083d9862cd23156c4d4cd79ff65b55450a33d5ff0ef926a42fa5ffff4db577 WatchSource:0}: Error finding container 8f083d9862cd23156c4d4cd79ff65b55450a33d5ff0ef926a42fa5ffff4db577: Status 404 returned error can't find the container with id 8f083d9862cd23156c4d4cd79ff65b55450a33d5ff0ef926a42fa5ffff4db577
Jul 27 20:25:19.734110 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.734077    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:25:19.734201 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.734143    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:25:19.734201 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:19.734171    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:25:20.473942 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:20.473900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz" event={"ID":"60e7f197-5fb2-47ed-9000-fd326c12eb3f","Type":"ContainerStarted","Data":"7d0df0367b3822dcc656519bc5e172d2c79d94f5bc8e8c66c1fab4440470353c"}
Jul 27 20:25:20.474326 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:20.473961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz" event={"ID":"60e7f197-5fb2-47ed-9000-fd326c12eb3f","Type":"ContainerStarted","Data":"8f083d9862cd23156c4d4cd79ff65b55450a33d5ff0ef926a42fa5ffff4db577"}
Jul 27 20:25:20.492870 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:20.492772    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz" podStartSLOduration=1.492739193 podStartE2EDuration="1.492739193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:25:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:25:20.491658397 +0000 UTC m=+476.147813740" watchObservedRunningTime="2026-07-27 20:25:20.492739193 +0000 UTC m=+476.148894539"
Jul 27 20:25:20.582120 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:20.582086    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:20.586964 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:20.586938    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:21.479398 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:21.479366    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:21.480282 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:21.480264    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:25:33.320120 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.320088    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"]
Jul 27 20:25:33.354830 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.354800    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"]
Jul 27 20:25:33.354997 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.354913    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"
Jul 27 20:25:33.357371 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.357345    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 20:25:33.369263 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.369236    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd948fbd-4eeb-40c1-b660-de0823c85859-config-file\") pod \"limitador-limitador-64c94fd64f-zvtxm\" (UID: \"fd948fbd-4eeb-40c1-b660-de0823c85859\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"
Jul 27 20:25:33.369396 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.369284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm5zs\" (UniqueName: \"kubernetes.io/projected/fd948fbd-4eeb-40c1-b660-de0823c85859-kube-api-access-gm5zs\") pod \"limitador-limitador-64c94fd64f-zvtxm\" (UID: \"fd948fbd-4eeb-40c1-b660-de0823c85859\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"
Jul 27 20:25:33.411055 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.411003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"]
Jul 27 20:25:33.470132 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.470094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd948fbd-4eeb-40c1-b660-de0823c85859-config-file\") pod \"limitador-limitador-64c94fd64f-zvtxm\" (UID: \"fd948fbd-4eeb-40c1-b660-de0823c85859\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"
Jul 27 20:25:33.470132 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.470145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm5zs\" (UniqueName: \"kubernetes.io/projected/fd948fbd-4eeb-40c1-b660-de0823c85859-kube-api-access-gm5zs\") pod \"limitador-limitador-64c94fd64f-zvtxm\" (UID: \"fd948fbd-4eeb-40c1-b660-de0823c85859\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"
Jul 27 20:25:33.470737 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.470716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd948fbd-4eeb-40c1-b660-de0823c85859-config-file\") pod \"limitador-limitador-64c94fd64f-zvtxm\" (UID: \"fd948fbd-4eeb-40c1-b660-de0823c85859\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"
Jul 27 20:25:33.477995 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.477962    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm5zs\" (UniqueName: \"kubernetes.io/projected/fd948fbd-4eeb-40c1-b660-de0823c85859-kube-api-access-gm5zs\") pod \"limitador-limitador-64c94fd64f-zvtxm\" (UID: \"fd948fbd-4eeb-40c1-b660-de0823c85859\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"
Jul 27 20:25:33.665361 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.665270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"
Jul 27 20:25:33.801579 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:33.801550    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"]
Jul 27 20:25:33.802848 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:25:33.802820    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd948fbd_4eeb_40c1_b660_de0823c85859.slice/crio-a93d534b72fc551bc464dae32c71d4719ba34496132286056af1f6595993d87b WatchSource:0}: Error finding container a93d534b72fc551bc464dae32c71d4719ba34496132286056af1f6595993d87b: Status 404 returned error can't find the container with id a93d534b72fc551bc464dae32c71d4719ba34496132286056af1f6595993d87b
Jul 27 20:25:34.396299 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:34.396263    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-qxfmh"]
Jul 27 20:25:34.399790 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:34.399770    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qxfmh"
Jul 27 20:25:34.401962 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:34.401933    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-glsmt\""
Jul 27 20:25:34.403590 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:34.403548    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qxfmh"]
Jul 27 20:25:34.477706 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:34.477660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfxtb\" (UniqueName: \"kubernetes.io/projected/3f7f0084-daf7-4cf2-86bb-ab9177f363f6-kube-api-access-nfxtb\") pod \"authorino-75d556bd77-qxfmh\" (UID: \"3f7f0084-daf7-4cf2-86bb-ab9177f363f6\") " pod="kuadrant-system/authorino-75d556bd77-qxfmh"
Jul 27 20:25:34.561810 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:34.561720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm" event={"ID":"fd948fbd-4eeb-40c1-b660-de0823c85859","Type":"ContainerStarted","Data":"a93d534b72fc551bc464dae32c71d4719ba34496132286056af1f6595993d87b"}
Jul 27 20:25:34.578915 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:34.578873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfxtb\" (UniqueName: \"kubernetes.io/projected/3f7f0084-daf7-4cf2-86bb-ab9177f363f6-kube-api-access-nfxtb\") pod \"authorino-75d556bd77-qxfmh\" (UID: \"3f7f0084-daf7-4cf2-86bb-ab9177f363f6\") " pod="kuadrant-system/authorino-75d556bd77-qxfmh"
Jul 27 20:25:34.588807 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:34.588771    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfxtb\" (UniqueName: \"kubernetes.io/projected/3f7f0084-daf7-4cf2-86bb-ab9177f363f6-kube-api-access-nfxtb\") pod \"authorino-75d556bd77-qxfmh\" (UID: \"3f7f0084-daf7-4cf2-86bb-ab9177f363f6\") " pod="kuadrant-system/authorino-75d556bd77-qxfmh"
Jul 27 20:25:34.710737 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:34.710654    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qxfmh"
Jul 27 20:25:34.889949 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:34.889919    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qxfmh"]
Jul 27 20:25:34.891943 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:25:34.891910    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f7f0084_daf7_4cf2_86bb_ab9177f363f6.slice/crio-22acddac6f32a80aa46839777f1d85bbdbd6d139ec9338255f27c788d2e09beb WatchSource:0}: Error finding container 22acddac6f32a80aa46839777f1d85bbdbd6d139ec9338255f27c788d2e09beb: Status 404 returned error can't find the container with id 22acddac6f32a80aa46839777f1d85bbdbd6d139ec9338255f27c788d2e09beb
Jul 27 20:25:35.570347 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:35.570306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qxfmh" event={"ID":"3f7f0084-daf7-4cf2-86bb-ab9177f363f6","Type":"ContainerStarted","Data":"22acddac6f32a80aa46839777f1d85bbdbd6d139ec9338255f27c788d2e09beb"}
Jul 27 20:25:37.587902 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:37.587864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm" event={"ID":"fd948fbd-4eeb-40c1-b660-de0823c85859","Type":"ContainerStarted","Data":"223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f"}
Jul 27 20:25:37.588332 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:37.587985    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"
Jul 27 20:25:37.607934 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:37.607879    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm" podStartSLOduration=1.801897138 podStartE2EDuration="4.607862301s" totalImagesPullingTime="2.805965163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:25:37.606356794 +0000 UTC m=+493.262512138" watchObservedRunningTime="2026-07-27 20:25:37.607862301 +0000 UTC m=+493.264017644"
Jul 27 20:25:39.601675 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:39.601633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qxfmh" event={"ID":"3f7f0084-daf7-4cf2-86bb-ab9177f363f6","Type":"ContainerStarted","Data":"015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc"}
Jul 27 20:25:39.617146 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:39.617087    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-qxfmh" podStartSLOduration=1.574196452 podStartE2EDuration="5.617072192s" totalImagesPullingTime="4.04287574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:25:39.616805819 +0000 UTC m=+495.272961162" watchObservedRunningTime="2026-07-27 20:25:39.617072192 +0000 UTC m=+495.273227532"
Jul 27 20:25:48.596102 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:48.596067    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"
Jul 27 20:25:48.747935 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:48.747893    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"]
Jul 27 20:25:48.748165 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:48.748128    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm" podUID="fd948fbd-4eeb-40c1-b660-de0823c85859" containerName="limitador" containerID="cri-o://223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f" gracePeriod=30
Jul 27 20:25:49.294663 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.294636    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"
Jul 27 20:25:49.418241 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.418136    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd948fbd-4eeb-40c1-b660-de0823c85859-config-file\") pod \"fd948fbd-4eeb-40c1-b660-de0823c85859\" (UID: \"fd948fbd-4eeb-40c1-b660-de0823c85859\") "
Jul 27 20:25:49.418241 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.418189    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm5zs\" (UniqueName: \"kubernetes.io/projected/fd948fbd-4eeb-40c1-b660-de0823c85859-kube-api-access-gm5zs\") pod \"fd948fbd-4eeb-40c1-b660-de0823c85859\" (UID: \"fd948fbd-4eeb-40c1-b660-de0823c85859\") "
Jul 27 20:25:49.418562 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.418538    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd948fbd-4eeb-40c1-b660-de0823c85859-config-file" (OuterVolumeSpecName: "config-file") pod "fd948fbd-4eeb-40c1-b660-de0823c85859" (UID: "fd948fbd-4eeb-40c1-b660-de0823c85859"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:25:49.421279 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.421230    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd948fbd-4eeb-40c1-b660-de0823c85859-kube-api-access-gm5zs" (OuterVolumeSpecName: "kube-api-access-gm5zs") pod "fd948fbd-4eeb-40c1-b660-de0823c85859" (UID: "fd948fbd-4eeb-40c1-b660-de0823c85859"). InnerVolumeSpecName "kube-api-access-gm5zs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:25:49.519687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.519654    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd948fbd-4eeb-40c1-b660-de0823c85859-config-file\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:49.519687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.519683    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm5zs\" (UniqueName: \"kubernetes.io/projected/fd948fbd-4eeb-40c1-b660-de0823c85859-kube-api-access-gm5zs\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:25:49.658655 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.658623    2580 generic.go:356] "Generic (PLEG): container finished" podID="fd948fbd-4eeb-40c1-b660-de0823c85859" containerID="223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f" exitCode=0
Jul 27 20:25:49.659091 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.658662    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm" event={"ID":"fd948fbd-4eeb-40c1-b660-de0823c85859","Type":"ContainerDied","Data":"223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f"}
Jul 27 20:25:49.659091 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.658672    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"
Jul 27 20:25:49.659091 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.658701    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zvtxm" event={"ID":"fd948fbd-4eeb-40c1-b660-de0823c85859","Type":"ContainerDied","Data":"a93d534b72fc551bc464dae32c71d4719ba34496132286056af1f6595993d87b"}
Jul 27 20:25:49.659091 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.658722    2580 scope.go:117] "RemoveContainer" containerID="223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f"
Jul 27 20:25:49.668102 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.668079    2580 scope.go:117] "RemoveContainer" containerID="223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f"
Jul 27 20:25:49.668366 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:25:49.668324    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f\": container with ID starting with 223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f not found: ID does not exist" containerID="223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f"
Jul 27 20:25:49.668366 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.668349    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f"} err="failed to get container status \"223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f\": rpc error: code = NotFound desc = could not find container \"223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f\": container with ID starting with 223ed82e71b2248eb38b811a2c65fb23ae5ac6946ad125f255fc99317cf1782f not found: ID does not exist"
Jul 27 20:25:49.679759 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.679729    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"]
Jul 27 20:25:49.683948 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:49.683927    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zvtxm"]
Jul 27 20:25:50.901941 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:50.901911    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd948fbd-4eeb-40c1-b660-de0823c85859" path="/var/lib/kubelet/pods/fd948fbd-4eeb-40c1-b660-de0823c85859/volumes"
Jul 27 20:25:53.389179 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.389139    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"]
Jul 27 20:25:53.389664 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.389644    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd948fbd-4eeb-40c1-b660-de0823c85859" containerName="limitador"
Jul 27 20:25:53.389723 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.389669    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd948fbd-4eeb-40c1-b660-de0823c85859" containerName="limitador"
Jul 27 20:25:53.389812 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.389801    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd948fbd-4eeb-40c1-b660-de0823c85859" containerName="limitador"
Jul 27 20:25:53.392604 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.392584    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"
Jul 27 20:25:53.395826 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.395797    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 27 20:25:53.395954 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.395839    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7khdc\""
Jul 27 20:25:53.395954 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.395861    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 20:25:53.395954 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.395849    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 20:25:53.400658 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.400638    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"]
Jul 27 20:25:53.453328 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.453289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/72ced759-bb14-48e1-99c6-94c0689f510b-data\") pod \"postgres-69fb4594cf-wt7xj\" (UID: \"72ced759-bb14-48e1-99c6-94c0689f510b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"
Jul 27 20:25:53.453328 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.453330    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrjlf\" (UniqueName: \"kubernetes.io/projected/72ced759-bb14-48e1-99c6-94c0689f510b-kube-api-access-jrjlf\") pod \"postgres-69fb4594cf-wt7xj\" (UID: \"72ced759-bb14-48e1-99c6-94c0689f510b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"
Jul 27 20:25:53.554581 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.554546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/72ced759-bb14-48e1-99c6-94c0689f510b-data\") pod \"postgres-69fb4594cf-wt7xj\" (UID: \"72ced759-bb14-48e1-99c6-94c0689f510b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"
Jul 27 20:25:53.554581 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.554585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrjlf\" (UniqueName: \"kubernetes.io/projected/72ced759-bb14-48e1-99c6-94c0689f510b-kube-api-access-jrjlf\") pod \"postgres-69fb4594cf-wt7xj\" (UID: \"72ced759-bb14-48e1-99c6-94c0689f510b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"
Jul 27 20:25:53.554965 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.554945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/72ced759-bb14-48e1-99c6-94c0689f510b-data\") pod \"postgres-69fb4594cf-wt7xj\" (UID: \"72ced759-bb14-48e1-99c6-94c0689f510b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"
Jul 27 20:25:53.566141 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.566114    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrjlf\" (UniqueName: \"kubernetes.io/projected/72ced759-bb14-48e1-99c6-94c0689f510b-kube-api-access-jrjlf\") pod \"postgres-69fb4594cf-wt7xj\" (UID: \"72ced759-bb14-48e1-99c6-94c0689f510b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"
Jul 27 20:25:53.704381 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.704286    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"
Jul 27 20:25:53.839970 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:53.839943    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"]
Jul 27 20:25:53.841594 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:25:53.841569    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ced759_bb14_48e1_99c6_94c0689f510b.slice/crio-05fbc5c84ae0cada1a77d7ea778cdafb934f1d8c78778ee3e08402e8c78f6292 WatchSource:0}: Error finding container 05fbc5c84ae0cada1a77d7ea778cdafb934f1d8c78778ee3e08402e8c78f6292: Status 404 returned error can't find the container with id 05fbc5c84ae0cada1a77d7ea778cdafb934f1d8c78778ee3e08402e8c78f6292
Jul 27 20:25:54.694043 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:54.693946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj" event={"ID":"72ced759-bb14-48e1-99c6-94c0689f510b","Type":"ContainerStarted","Data":"05fbc5c84ae0cada1a77d7ea778cdafb934f1d8c78778ee3e08402e8c78f6292"}
Jul 27 20:25:58.723092 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:58.723050    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj" event={"ID":"72ced759-bb14-48e1-99c6-94c0689f510b","Type":"ContainerStarted","Data":"a2472a4b6856835d1ad87ef996c3183e461496152c7cd162063bf10fdfff24e6"}
Jul 27 20:25:58.723492 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:58.723279    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"
Jul 27 20:25:58.738530 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:25:58.738475    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj" podStartSLOduration=1.065636162 podStartE2EDuration="5.738460672s" totalImagesPullingTime="4.67282451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:25:58.737931582 +0000 UTC m=+514.394086948" watchObservedRunningTime="2026-07-27 20:25:58.738460672 +0000 UTC m=+514.394616016"
Jul 27 20:26:04.755987 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:04.755953    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wt7xj"
Jul 27 20:26:07.261868 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.261826    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qxfmh"]
Jul 27 20:26:07.262297 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.262012    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-qxfmh" podUID="3f7f0084-daf7-4cf2-86bb-ab9177f363f6" containerName="authorino" containerID="cri-o://015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc" gracePeriod=30
Jul 27 20:26:07.585163 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.585126    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qxfmh"
Jul 27 20:26:07.684191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.684157    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfxtb\" (UniqueName: \"kubernetes.io/projected/3f7f0084-daf7-4cf2-86bb-ab9177f363f6-kube-api-access-nfxtb\") pod \"3f7f0084-daf7-4cf2-86bb-ab9177f363f6\" (UID: \"3f7f0084-daf7-4cf2-86bb-ab9177f363f6\") "
Jul 27 20:26:07.686282 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.686251    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f7f0084-daf7-4cf2-86bb-ab9177f363f6-kube-api-access-nfxtb" (OuterVolumeSpecName: "kube-api-access-nfxtb") pod "3f7f0084-daf7-4cf2-86bb-ab9177f363f6" (UID: "3f7f0084-daf7-4cf2-86bb-ab9177f363f6"). InnerVolumeSpecName "kube-api-access-nfxtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:26:07.774630 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.774588    2580 generic.go:356] "Generic (PLEG): container finished" podID="3f7f0084-daf7-4cf2-86bb-ab9177f363f6" containerID="015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc" exitCode=0
Jul 27 20:26:07.774630 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.774623    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qxfmh"
Jul 27 20:26:07.774851 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.774665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qxfmh" event={"ID":"3f7f0084-daf7-4cf2-86bb-ab9177f363f6","Type":"ContainerDied","Data":"015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc"}
Jul 27 20:26:07.774851 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.774705    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qxfmh" event={"ID":"3f7f0084-daf7-4cf2-86bb-ab9177f363f6","Type":"ContainerDied","Data":"22acddac6f32a80aa46839777f1d85bbdbd6d139ec9338255f27c788d2e09beb"}
Jul 27 20:26:07.774851 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.774726    2580 scope.go:117] "RemoveContainer" containerID="015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc"
Jul 27 20:26:07.784032 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.784016    2580 scope.go:117] "RemoveContainer" containerID="015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc"
Jul 27 20:26:07.784311 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:26:07.784293    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc\": container with ID starting with 015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc not found: ID does not exist" containerID="015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc"
Jul 27 20:26:07.784383 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.784319    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc"} err="failed to get container status \"015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc\": rpc error: code = NotFound desc = could not find container \"015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc\": container with ID starting with 015b2226b59aedffb6bd936bb6606ffff32ebc044ce7e52de851a9b3661733dc not found: ID does not exist"
Jul 27 20:26:07.784713 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.784699    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfxtb\" (UniqueName: \"kubernetes.io/projected/3f7f0084-daf7-4cf2-86bb-ab9177f363f6-kube-api-access-nfxtb\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:26:07.798709 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.798648    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qxfmh"]
Jul 27 20:26:07.803840 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:07.803820    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qxfmh"]
Jul 27 20:26:08.902040 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:08.902007    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f7f0084-daf7-4cf2-86bb-ab9177f363f6" path="/var/lib/kubelet/pods/3f7f0084-daf7-4cf2-86bb-ab9177f363f6/volumes"
Jul 27 20:26:11.873984 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:11.873948    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b4c6959fd-vmqfq"]
Jul 27 20:26:11.874352 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:11.874341    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f7f0084-daf7-4cf2-86bb-ab9177f363f6" containerName="authorino"
Jul 27 20:26:11.874408 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:11.874352    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f7f0084-daf7-4cf2-86bb-ab9177f363f6" containerName="authorino"
Jul 27 20:26:11.874449 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:11.874429    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f7f0084-daf7-4cf2-86bb-ab9177f363f6" containerName="authorino"
Jul 27 20:26:11.888796 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:11.888742    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b4c6959fd-vmqfq"]
Jul 27 20:26:11.888976 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:11.888862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b4c6959fd-vmqfq"
Jul 27 20:26:11.891255 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:11.891220    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 20:26:11.891394 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:11.891303    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-svv94\""
Jul 27 20:26:11.891394 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:11.891355    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 20:26:12.023021 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.022978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rkfm\" (UniqueName: \"kubernetes.io/projected/6c8a6157-be1a-4d58-add2-0fbe6178059e-kube-api-access-9rkfm\") pod \"maas-controller-b4c6959fd-vmqfq\" (UID: \"6c8a6157-be1a-4d58-add2-0fbe6178059e\") " pod="opendatahub/maas-controller-b4c6959fd-vmqfq"
Jul 27 20:26:12.023413 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.023380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c8a6157-be1a-4d58-add2-0fbe6178059e-webhook-cert\") pod \"maas-controller-b4c6959fd-vmqfq\" (UID: \"6c8a6157-be1a-4d58-add2-0fbe6178059e\") " pod="opendatahub/maas-controller-b4c6959fd-vmqfq"
Jul 27 20:26:12.037494 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.037457    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cbc7b97fc-thtgc"]
Jul 27 20:26:12.040034 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.040017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cbc7b97fc-thtgc"
Jul 27 20:26:12.051301 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.051270    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cbc7b97fc-thtgc"]
Jul 27 20:26:12.124735 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.124636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c8a6157-be1a-4d58-add2-0fbe6178059e-webhook-cert\") pod \"maas-controller-b4c6959fd-vmqfq\" (UID: \"6c8a6157-be1a-4d58-add2-0fbe6178059e\") " pod="opendatahub/maas-controller-b4c6959fd-vmqfq"
Jul 27 20:26:12.124735 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.124736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rkfm\" (UniqueName: \"kubernetes.io/projected/6c8a6157-be1a-4d58-add2-0fbe6178059e-kube-api-access-9rkfm\") pod \"maas-controller-b4c6959fd-vmqfq\" (UID: \"6c8a6157-be1a-4d58-add2-0fbe6178059e\") " pod="opendatahub/maas-controller-b4c6959fd-vmqfq"
Jul 27 20:26:12.127145 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.127115    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c8a6157-be1a-4d58-add2-0fbe6178059e-webhook-cert\") pod \"maas-controller-b4c6959fd-vmqfq\" (UID: \"6c8a6157-be1a-4d58-add2-0fbe6178059e\") " pod="opendatahub/maas-controller-b4c6959fd-vmqfq"
Jul 27 20:26:12.133132 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.133104    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rkfm\" (UniqueName: \"kubernetes.io/projected/6c8a6157-be1a-4d58-add2-0fbe6178059e-kube-api-access-9rkfm\") pod \"maas-controller-b4c6959fd-vmqfq\" (UID: \"6c8a6157-be1a-4d58-add2-0fbe6178059e\") " pod="opendatahub/maas-controller-b4c6959fd-vmqfq"
Jul 27 20:26:12.199582 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.199541    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b4c6959fd-vmqfq"
Jul 27 20:26:12.226107 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.226074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmpxh\" (UniqueName: \"kubernetes.io/projected/2ee01a5d-7a5e-4778-9112-9d55d1c84187-kube-api-access-jmpxh\") pod \"maas-controller-6cbc7b97fc-thtgc\" (UID: \"2ee01a5d-7a5e-4778-9112-9d55d1c84187\") " pod="opendatahub/maas-controller-6cbc7b97fc-thtgc"
Jul 27 20:26:12.226280 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.226167    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ee01a5d-7a5e-4778-9112-9d55d1c84187-webhook-cert\") pod \"maas-controller-6cbc7b97fc-thtgc\" (UID: \"2ee01a5d-7a5e-4778-9112-9d55d1c84187\") " pod="opendatahub/maas-controller-6cbc7b97fc-thtgc"
Jul 27 20:26:12.327451 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.327415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmpxh\" (UniqueName: \"kubernetes.io/projected/2ee01a5d-7a5e-4778-9112-9d55d1c84187-kube-api-access-jmpxh\") pod \"maas-controller-6cbc7b97fc-thtgc\" (UID: \"2ee01a5d-7a5e-4778-9112-9d55d1c84187\") " pod="opendatahub/maas-controller-6cbc7b97fc-thtgc"
Jul 27 20:26:12.327618 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.327512    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ee01a5d-7a5e-4778-9112-9d55d1c84187-webhook-cert\") pod \"maas-controller-6cbc7b97fc-thtgc\" (UID: \"2ee01a5d-7a5e-4778-9112-9d55d1c84187\") " pod="opendatahub/maas-controller-6cbc7b97fc-thtgc"
Jul 27 20:26:12.330175 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.330149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ee01a5d-7a5e-4778-9112-9d55d1c84187-webhook-cert\") pod \"maas-controller-6cbc7b97fc-thtgc\" (UID: \"2ee01a5d-7a5e-4778-9112-9d55d1c84187\") " pod="opendatahub/maas-controller-6cbc7b97fc-thtgc"
Jul 27 20:26:12.337166 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.337129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmpxh\" (UniqueName: \"kubernetes.io/projected/2ee01a5d-7a5e-4778-9112-9d55d1c84187-kube-api-access-jmpxh\") pod \"maas-controller-6cbc7b97fc-thtgc\" (UID: \"2ee01a5d-7a5e-4778-9112-9d55d1c84187\") " pod="opendatahub/maas-controller-6cbc7b97fc-thtgc"
Jul 27 20:26:12.340553 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.340522    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b4c6959fd-vmqfq"]
Jul 27 20:26:12.340991 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:26:12.340958    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8a6157_be1a_4d58_add2_0fbe6178059e.slice/crio-41e5cda3fac1550eaf000d49bc0b09f8e59451b4f529ea41dcedee471111f8fc WatchSource:0}: Error finding container 41e5cda3fac1550eaf000d49bc0b09f8e59451b4f529ea41dcedee471111f8fc: Status 404 returned error can't find the container with id 41e5cda3fac1550eaf000d49bc0b09f8e59451b4f529ea41dcedee471111f8fc
Jul 27 20:26:12.352636 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.352609    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cbc7b97fc-thtgc"
Jul 27 20:26:12.490300 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.490270    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cbc7b97fc-thtgc"]
Jul 27 20:26:12.491836 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:26:12.491806    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee01a5d_7a5e_4778_9112_9d55d1c84187.slice/crio-ba8e015489f3c2b7b04690a60fd5f143426ec110fbbd9494d750d3974bb6b6d8 WatchSource:0}: Error finding container ba8e015489f3c2b7b04690a60fd5f143426ec110fbbd9494d750d3974bb6b6d8: Status 404 returned error can't find the container with id ba8e015489f3c2b7b04690a60fd5f143426ec110fbbd9494d750d3974bb6b6d8
Jul 27 20:26:12.806279 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.806233    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cbc7b97fc-thtgc" event={"ID":"2ee01a5d-7a5e-4778-9112-9d55d1c84187","Type":"ContainerStarted","Data":"ba8e015489f3c2b7b04690a60fd5f143426ec110fbbd9494d750d3974bb6b6d8"}
Jul 27 20:26:12.807528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:12.807501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b4c6959fd-vmqfq" event={"ID":"6c8a6157-be1a-4d58-add2-0fbe6178059e","Type":"ContainerStarted","Data":"41e5cda3fac1550eaf000d49bc0b09f8e59451b4f529ea41dcedee471111f8fc"}
Jul 27 20:26:15.827529 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:15.827479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cbc7b97fc-thtgc" event={"ID":"2ee01a5d-7a5e-4778-9112-9d55d1c84187","Type":"ContainerStarted","Data":"a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe"}
Jul 27 20:26:15.827995 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:15.827602    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cbc7b97fc-thtgc"
Jul 27 20:26:15.829156 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:15.829124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b4c6959fd-vmqfq" event={"ID":"6c8a6157-be1a-4d58-add2-0fbe6178059e","Type":"ContainerStarted","Data":"369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1"}
Jul 27 20:26:15.829259 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:15.829198    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b4c6959fd-vmqfq"
Jul 27 20:26:15.846551 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:15.846492    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cbc7b97fc-thtgc" podStartSLOduration=1.538889699 podStartE2EDuration="3.846475051s" totalImagesPullingTime="2.307585352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:26:15.845794738 +0000 UTC m=+531.501950080" watchObservedRunningTime="2026-07-27 20:26:15.846475051 +0000 UTC m=+531.502630395"
Jul 27 20:26:15.868660 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:15.868603    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b4c6959fd-vmqfq" podStartSLOduration=2.400091127 podStartE2EDuration="4.868586163s" totalImagesPullingTime="2.468495036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:26:15.867083628 +0000 UTC m=+531.523238972" watchObservedRunningTime="2026-07-27 20:26:15.868586163 +0000 UTC m=+531.524741530"
Jul 27 20:26:26.838368 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:26.838333    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cbc7b97fc-thtgc"
Jul 27 20:26:26.838830 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:26.838498    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b4c6959fd-vmqfq"
Jul 27 20:26:26.895536 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:26.895498    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b4c6959fd-vmqfq"]
Jul 27 20:26:26.895818 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:26.895790    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b4c6959fd-vmqfq" podUID="6c8a6157-be1a-4d58-add2-0fbe6178059e" containerName="manager" containerID="cri-o://369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1" gracePeriod=30
Jul 27 20:26:27.148104 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.148077    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b4c6959fd-vmqfq"
Jul 27 20:26:27.270114 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.270072    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rkfm\" (UniqueName: \"kubernetes.io/projected/6c8a6157-be1a-4d58-add2-0fbe6178059e-kube-api-access-9rkfm\") pod \"6c8a6157-be1a-4d58-add2-0fbe6178059e\" (UID: \"6c8a6157-be1a-4d58-add2-0fbe6178059e\") "
Jul 27 20:26:27.270295 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.270154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c8a6157-be1a-4d58-add2-0fbe6178059e-webhook-cert\") pod \"6c8a6157-be1a-4d58-add2-0fbe6178059e\" (UID: \"6c8a6157-be1a-4d58-add2-0fbe6178059e\") "
Jul 27 20:26:27.272383 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.272351    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c8a6157-be1a-4d58-add2-0fbe6178059e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6c8a6157-be1a-4d58-add2-0fbe6178059e" (UID: "6c8a6157-be1a-4d58-add2-0fbe6178059e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:26:27.272490 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.272417    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c8a6157-be1a-4d58-add2-0fbe6178059e-kube-api-access-9rkfm" (OuterVolumeSpecName: "kube-api-access-9rkfm") pod "6c8a6157-be1a-4d58-add2-0fbe6178059e" (UID: "6c8a6157-be1a-4d58-add2-0fbe6178059e"). InnerVolumeSpecName "kube-api-access-9rkfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:26:27.371423 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.371389    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c8a6157-be1a-4d58-add2-0fbe6178059e-webhook-cert\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:26:27.371423 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.371418    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rkfm\" (UniqueName: \"kubernetes.io/projected/6c8a6157-be1a-4d58-add2-0fbe6178059e-kube-api-access-9rkfm\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:26:27.900385 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.900350    2580 generic.go:356] "Generic (PLEG): container finished" podID="6c8a6157-be1a-4d58-add2-0fbe6178059e" containerID="369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1" exitCode=0
Jul 27 20:26:27.900834 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.900390    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b4c6959fd-vmqfq"
Jul 27 20:26:27.900834 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.900435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b4c6959fd-vmqfq" event={"ID":"6c8a6157-be1a-4d58-add2-0fbe6178059e","Type":"ContainerDied","Data":"369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1"}
Jul 27 20:26:27.900834 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.900484    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b4c6959fd-vmqfq" event={"ID":"6c8a6157-be1a-4d58-add2-0fbe6178059e","Type":"ContainerDied","Data":"41e5cda3fac1550eaf000d49bc0b09f8e59451b4f529ea41dcedee471111f8fc"}
Jul 27 20:26:27.900834 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.900509    2580 scope.go:117] "RemoveContainer" containerID="369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1"
Jul 27 20:26:27.910299 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.910280    2580 scope.go:117] "RemoveContainer" containerID="369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1"
Jul 27 20:26:27.910553 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:26:27.910534    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1\": container with ID starting with 369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1 not found: ID does not exist" containerID="369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1"
Jul 27 20:26:27.910598 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.910562    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1"} err="failed to get container status \"369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1\": rpc error: code = NotFound desc = could not find container \"369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1\": container with ID starting with 369013fea323b597b828baaffd20db0a03ddf3242c42ed8b7038c50bdff74cd1 not found: ID does not exist"
Jul 27 20:26:27.923308 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.923278    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b4c6959fd-vmqfq"]
Jul 27 20:26:27.928298 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:27.928271    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b4c6959fd-vmqfq"]
Jul 27 20:26:28.902732 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:28.902696    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c8a6157-be1a-4d58-add2-0fbe6178059e" path="/var/lib/kubelet/pods/6c8a6157-be1a-4d58-add2-0fbe6178059e/volumes"
Jul 27 20:26:46.419893 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.419859    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"]
Jul 27 20:26:46.420349 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.420246    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c8a6157-be1a-4d58-add2-0fbe6178059e" containerName="manager"
Jul 27 20:26:46.420349 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.420256    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c8a6157-be1a-4d58-add2-0fbe6178059e" containerName="manager"
Jul 27 20:26:46.420349 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.420334    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c8a6157-be1a-4d58-add2-0fbe6178059e" containerName="manager"
Jul 27 20:26:46.424662 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.424642    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:46.430937 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.430908    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 27 20:26:46.430937 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.430920    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-q9t2z\""
Jul 27 20:26:46.445953 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.445921    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"]
Jul 27 20:26:46.553087 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.553048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c638dd28-067b-457c-99d6-683643719783-maas-api-tls\") pod \"maas-api-7685ffc6c7-4wsx7\" (UID: \"c638dd28-067b-457c-99d6-683643719783\") " pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:46.553287 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.553125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c638dd28-067b-457c-99d6-683643719783-openshift-service-ca\") pod \"maas-api-7685ffc6c7-4wsx7\" (UID: \"c638dd28-067b-457c-99d6-683643719783\") " pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:46.553287 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.553161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84bnt\" (UniqueName: \"kubernetes.io/projected/c638dd28-067b-457c-99d6-683643719783-kube-api-access-84bnt\") pod \"maas-api-7685ffc6c7-4wsx7\" (UID: \"c638dd28-067b-457c-99d6-683643719783\") " pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:46.653864 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.653830    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c638dd28-067b-457c-99d6-683643719783-openshift-service-ca\") pod \"maas-api-7685ffc6c7-4wsx7\" (UID: \"c638dd28-067b-457c-99d6-683643719783\") " pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:46.654045 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.653875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84bnt\" (UniqueName: \"kubernetes.io/projected/c638dd28-067b-457c-99d6-683643719783-kube-api-access-84bnt\") pod \"maas-api-7685ffc6c7-4wsx7\" (UID: \"c638dd28-067b-457c-99d6-683643719783\") " pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:46.654045 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.653931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c638dd28-067b-457c-99d6-683643719783-maas-api-tls\") pod \"maas-api-7685ffc6c7-4wsx7\" (UID: \"c638dd28-067b-457c-99d6-683643719783\") " pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:46.654141 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:26:46.654047    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 27 20:26:46.654141 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:26:46.654104    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c638dd28-067b-457c-99d6-683643719783-maas-api-tls podName:c638dd28-067b-457c-99d6-683643719783 nodeName:}" failed. No retries permitted until 2026-07-27 20:26:47.154089467 +0000 UTC m=+562.810244792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c638dd28-067b-457c-99d6-683643719783-maas-api-tls") pod "maas-api-7685ffc6c7-4wsx7" (UID: "c638dd28-067b-457c-99d6-683643719783") : secret "maas-api-serving-cert" not found
Jul 27 20:26:46.654477 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.654459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c638dd28-067b-457c-99d6-683643719783-openshift-service-ca\") pod \"maas-api-7685ffc6c7-4wsx7\" (UID: \"c638dd28-067b-457c-99d6-683643719783\") " pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:46.662498 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.662469    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84bnt\" (UniqueName: \"kubernetes.io/projected/c638dd28-067b-457c-99d6-683643719783-kube-api-access-84bnt\") pod \"maas-api-7685ffc6c7-4wsx7\" (UID: \"c638dd28-067b-457c-99d6-683643719783\") " pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:46.924633 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.924600    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-sb92s"]
Jul 27 20:26:46.928317 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.928298    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s"
Jul 27 20:26:46.930523 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.930495    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 20:26:46.930644 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.930544    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-f5qrf\""
Jul 27 20:26:46.940034 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.940009    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-sb92s"]
Jul 27 20:26:46.957142 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.957094    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"]
Jul 27 20:26:46.961464 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.961440    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"
Jul 27 20:26:46.970833 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:46.970808    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"]
Jul 27 20:26:47.064945 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.058629    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b11532d-e0df-49bf-bf7b-ca20ead9d7bb-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-fg87n\" (UID: \"0b11532d-e0df-49bf-bf7b-ca20ead9d7bb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"
Jul 27 20:26:47.064945 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.058691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmwmk\" (UniqueName: \"kubernetes.io/projected/6d73fc6c-684b-4483-91c7-d61cdce108aa-kube-api-access-mmwmk\") pod \"payload-processing-5cc6cd444b-sb92s\" (UID: \"6d73fc6c-684b-4483-91c7-d61cdce108aa\") " pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s"
Jul 27 20:26:47.064945 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.058818    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6fs\" (UniqueName: \"kubernetes.io/projected/0b11532d-e0df-49bf-bf7b-ca20ead9d7bb-kube-api-access-4b6fs\") pod \"payload-pre-processing-687dbb6cf6-fg87n\" (UID: \"0b11532d-e0df-49bf-bf7b-ca20ead9d7bb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"
Jul 27 20:26:47.064945 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.058890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d73fc6c-684b-4483-91c7-d61cdce108aa-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-sb92s\" (UID: \"6d73fc6c-684b-4483-91c7-d61cdce108aa\") " pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s"
Jul 27 20:26:47.159878 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.159837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6fs\" (UniqueName: \"kubernetes.io/projected/0b11532d-e0df-49bf-bf7b-ca20ead9d7bb-kube-api-access-4b6fs\") pod \"payload-pre-processing-687dbb6cf6-fg87n\" (UID: \"0b11532d-e0df-49bf-bf7b-ca20ead9d7bb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"
Jul 27 20:26:47.160082 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.159909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d73fc6c-684b-4483-91c7-d61cdce108aa-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-sb92s\" (UID: \"6d73fc6c-684b-4483-91c7-d61cdce108aa\") " pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s"
Jul 27 20:26:47.160082 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.159955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c638dd28-067b-457c-99d6-683643719783-maas-api-tls\") pod \"maas-api-7685ffc6c7-4wsx7\" (UID: \"c638dd28-067b-457c-99d6-683643719783\") " pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:47.160082 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.160065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b11532d-e0df-49bf-bf7b-ca20ead9d7bb-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-fg87n\" (UID: \"0b11532d-e0df-49bf-bf7b-ca20ead9d7bb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"
Jul 27 20:26:47.160255 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.160098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmwmk\" (UniqueName: \"kubernetes.io/projected/6d73fc6c-684b-4483-91c7-d61cdce108aa-kube-api-access-mmwmk\") pod \"payload-processing-5cc6cd444b-sb92s\" (UID: \"6d73fc6c-684b-4483-91c7-d61cdce108aa\") " pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s"
Jul 27 20:26:47.160736 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.160712    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d73fc6c-684b-4483-91c7-d61cdce108aa-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-sb92s\" (UID: \"6d73fc6c-684b-4483-91c7-d61cdce108aa\") " pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s"
Jul 27 20:26:47.160861 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.160842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b11532d-e0df-49bf-bf7b-ca20ead9d7bb-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-fg87n\" (UID: \"0b11532d-e0df-49bf-bf7b-ca20ead9d7bb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"
Jul 27 20:26:47.162394 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.162376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c638dd28-067b-457c-99d6-683643719783-maas-api-tls\") pod \"maas-api-7685ffc6c7-4wsx7\" (UID: \"c638dd28-067b-457c-99d6-683643719783\") " pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:47.178523 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.178455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6fs\" (UniqueName: \"kubernetes.io/projected/0b11532d-e0df-49bf-bf7b-ca20ead9d7bb-kube-api-access-4b6fs\") pod \"payload-pre-processing-687dbb6cf6-fg87n\" (UID: \"0b11532d-e0df-49bf-bf7b-ca20ead9d7bb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"
Jul 27 20:26:47.178523 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.178476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmwmk\" (UniqueName: \"kubernetes.io/projected/6d73fc6c-684b-4483-91c7-d61cdce108aa-kube-api-access-mmwmk\") pod \"payload-processing-5cc6cd444b-sb92s\" (UID: \"6d73fc6c-684b-4483-91c7-d61cdce108aa\") " pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s"
Jul 27 20:26:47.240910 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.240879    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s"
Jul 27 20:26:47.272816 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.272782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"
Jul 27 20:26:47.334630 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.334601    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:47.414086 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.413961    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-sb92s"]
Jul 27 20:26:47.415116 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:26:47.415084    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d73fc6c_684b_4483_91c7_d61cdce108aa.slice/crio-188be27b7a605eeffce7ff974599431f035b2e3d8f79bac462c4921bba41c474 WatchSource:0}: Error finding container 188be27b7a605eeffce7ff974599431f035b2e3d8f79bac462c4921bba41c474: Status 404 returned error can't find the container with id 188be27b7a605eeffce7ff974599431f035b2e3d8f79bac462c4921bba41c474
Jul 27 20:26:47.448072 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.448042    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"]
Jul 27 20:26:47.450380 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:26:47.450354    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b11532d_e0df_49bf_bf7b_ca20ead9d7bb.slice/crio-3177fd011a5ed5f361ffdd41428ff7bd52874843d84d174dab32f2823650140a WatchSource:0}: Error finding container 3177fd011a5ed5f361ffdd41428ff7bd52874843d84d174dab32f2823650140a: Status 404 returned error can't find the container with id 3177fd011a5ed5f361ffdd41428ff7bd52874843d84d174dab32f2823650140a
Jul 27 20:26:47.504306 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:47.504281    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"]
Jul 27 20:26:47.506660 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:26:47.506639    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc638dd28_067b_457c_99d6_683643719783.slice/crio-ab2f4157d10cac2d654de44e0cae849f52a18d96c863aa22fbc7bca50945b1f8 WatchSource:0}: Error finding container ab2f4157d10cac2d654de44e0cae849f52a18d96c863aa22fbc7bca50945b1f8: Status 404 returned error can't find the container with id ab2f4157d10cac2d654de44e0cae849f52a18d96c863aa22fbc7bca50945b1f8
Jul 27 20:26:48.024607 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:48.024569    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s" event={"ID":"6d73fc6c-684b-4483-91c7-d61cdce108aa","Type":"ContainerStarted","Data":"188be27b7a605eeffce7ff974599431f035b2e3d8f79bac462c4921bba41c474"}
Jul 27 20:26:48.025850 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:48.025821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7" event={"ID":"c638dd28-067b-457c-99d6-683643719783","Type":"ContainerStarted","Data":"ab2f4157d10cac2d654de44e0cae849f52a18d96c863aa22fbc7bca50945b1f8"}
Jul 27 20:26:48.026943 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:48.026925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n" event={"ID":"0b11532d-e0df-49bf-bf7b-ca20ead9d7bb","Type":"ContainerStarted","Data":"3177fd011a5ed5f361ffdd41428ff7bd52874843d84d174dab32f2823650140a"}
Jul 27 20:26:51.080695 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:51.080650    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n" event={"ID":"0b11532d-e0df-49bf-bf7b-ca20ead9d7bb","Type":"ContainerStarted","Data":"62d25e33106899a6646e6c2621fb26b5f7c6d7537dee236e863ace3f86858b12"}
Jul 27 20:26:51.081193 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:51.080724    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"
Jul 27 20:26:51.082517 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:51.082491    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s" event={"ID":"6d73fc6c-684b-4483-91c7-d61cdce108aa","Type":"ContainerStarted","Data":"69ed8f15c936d1a368f5e6ad7c5f4d8307774d4dd93fa2455bf3477b606fd9e1"}
Jul 27 20:26:51.082658 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:51.082546    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s"
Jul 27 20:26:51.084104 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:51.084076    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7" event={"ID":"c638dd28-067b-457c-99d6-683643719783","Type":"ContainerStarted","Data":"26ee7160fccadf452494edac9c2ffddc2610bad9d429e90ffca2affa33e54b7b"}
Jul 27 20:26:51.084231 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:51.084216    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:51.096460 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:51.096412    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n" podStartSLOduration=2.273921993 podStartE2EDuration="5.096396615s" totalImagesPullingTime="2.822474622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:26:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:26:51.09585024 +0000 UTC m=+566.752005598" watchObservedRunningTime="2026-07-27 20:26:51.096396615 +0000 UTC m=+566.752551984"
Jul 27 20:26:51.112230 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:51.112179    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s" podStartSLOduration=2.271346503 podStartE2EDuration="5.112162465s" totalImagesPullingTime="2.840815962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:26:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:26:51.110218126 +0000 UTC m=+566.766373471" watchObservedRunningTime="2026-07-27 20:26:51.112162465 +0000 UTC m=+566.768317808"
Jul 27 20:26:51.126406 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:51.126357    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7" podStartSLOduration=2.380461521 podStartE2EDuration="5.126342119s" totalImagesPullingTime="2.745880598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:26:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:26:51.125511859 +0000 UTC m=+566.781667227" watchObservedRunningTime="2026-07-27 20:26:51.126342119 +0000 UTC m=+566.782497501"
Jul 27 20:26:55.117044 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:55.117005    2580 generic.go:356] "Generic (PLEG): container finished" podID="60e7f197-5fb2-47ed-9000-fd326c12eb3f" containerID="7d0df0367b3822dcc656519bc5e172d2c79d94f5bc8e8c66c1fab4440470353c" exitCode=0
Jul 27 20:26:55.117485 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:55.117084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz" event={"ID":"60e7f197-5fb2-47ed-9000-fd326c12eb3f","Type":"ContainerDied","Data":"7d0df0367b3822dcc656519bc5e172d2c79d94f5bc8e8c66c1fab4440470353c"}
Jul 27 20:26:55.117485 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:55.117475    2580 scope.go:117] "RemoveContainer" containerID="7d0df0367b3822dcc656519bc5e172d2c79d94f5bc8e8c66c1fab4440470353c"
Jul 27 20:26:55.118473 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:55.118446    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:26:55.118526 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:55.118513    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:26:55.118561 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:55.118546    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:26:56.124892 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:56.124859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz" event={"ID":"60e7f197-5fb2-47ed-9000-fd326c12eb3f","Type":"ContainerStarted","Data":"46ccf8cc71bc594f2a83027d2141194ba58518cea30b2f6631a2e6af686fe733"}
Jul 27 20:26:56.582276 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:56.582237    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:26:56.582490 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:56.582465    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xr7hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 20:26:56.582540 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:56.582517    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz" podUID="60e7f197-5fb2-47ed-9000-fd326c12eb3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 20:26:57.101870 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:57.101840    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7685ffc6c7-4wsx7"
Jul 27 20:26:57.583115 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:57.583076    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xr7hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 20:26:57.583507 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:57.583130    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz" podUID="60e7f197-5fb2-47ed-9000-fd326c12eb3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 20:26:58.582724 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:58.582682    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xr7hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 20:26:58.582926 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:58.582778    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz" podUID="60e7f197-5fb2-47ed-9000-fd326c12eb3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 20:26:59.583138 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:59.583102    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xr7hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 20:26:59.583527 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:26:59.583156    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz" podUID="60e7f197-5fb2-47ed-9000-fd326c12eb3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 20:27:00.585852 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:00.585821    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:27:00.586222 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:00.586110    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:27:00.586921 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:00.586905    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xr7hz"
Jul 27 20:27:02.098614 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:02.098581    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fg87n"
Jul 27 20:27:02.099113 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:02.098659    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-sb92s"
Jul 27 20:27:04.406344 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.406304    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"]
Jul 27 20:27:04.412240 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.412213    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.416484 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.415964    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fvph7\""
Jul 27 20:27:04.416484 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.416195    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 20:27:04.416484 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.416376    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 20:27:04.416484 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.416374    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 27 20:27:04.418353 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.418324    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"]
Jul 27 20:27:04.440295 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.440263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/671966c0-01ee-4c1b-9648-087cb7f361f4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.440446 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.440306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/671966c0-01ee-4c1b-9648-087cb7f361f4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.440446 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.440327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/671966c0-01ee-4c1b-9648-087cb7f361f4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.440446 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.440407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/671966c0-01ee-4c1b-9648-087cb7f361f4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.440446 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.440437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgphx\" (UniqueName: \"kubernetes.io/projected/671966c0-01ee-4c1b-9648-087cb7f361f4-kube-api-access-rgphx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.440587 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.440466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/671966c0-01ee-4c1b-9648-087cb7f361f4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.541013 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.540977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/671966c0-01ee-4c1b-9648-087cb7f361f4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.541013 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.541021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/671966c0-01ee-4c1b-9648-087cb7f361f4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.541278 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.541036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/671966c0-01ee-4c1b-9648-087cb7f361f4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.541278 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.541087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/671966c0-01ee-4c1b-9648-087cb7f361f4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.541278 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.541118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgphx\" (UniqueName: \"kubernetes.io/projected/671966c0-01ee-4c1b-9648-087cb7f361f4-kube-api-access-rgphx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.541278 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.541156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/671966c0-01ee-4c1b-9648-087cb7f361f4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.541487 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.541423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/671966c0-01ee-4c1b-9648-087cb7f361f4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.541580 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.541556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/671966c0-01ee-4c1b-9648-087cb7f361f4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.541678 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.541661    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/671966c0-01ee-4c1b-9648-087cb7f361f4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.543417 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.543396    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/671966c0-01ee-4c1b-9648-087cb7f361f4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.543823 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.543799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/671966c0-01ee-4c1b-9648-087cb7f361f4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.550202 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.550181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgphx\" (UniqueName: \"kubernetes.io/projected/671966c0-01ee-4c1b-9648-087cb7f361f4-kube-api-access-rgphx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc\" (UID: \"671966c0-01ee-4c1b-9648-087cb7f361f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.726479 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.726379    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:04.878928 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:04.878897    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"]
Jul 27 20:27:04.879869 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:27:04.879841    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671966c0_01ee_4c1b_9648_087cb7f361f4.slice/crio-a7a572cc394e6a05f21d9eb36c0e66f24951e544a14d06a34f4b7dc290093ea5 WatchSource:0}: Error finding container a7a572cc394e6a05f21d9eb36c0e66f24951e544a14d06a34f4b7dc290093ea5: Status 404 returned error can't find the container with id a7a572cc394e6a05f21d9eb36c0e66f24951e544a14d06a34f4b7dc290093ea5
Jul 27 20:27:05.178951 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:05.178912    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc" event={"ID":"671966c0-01ee-4c1b-9648-087cb7f361f4","Type":"ContainerStarted","Data":"a7a572cc394e6a05f21d9eb36c0e66f24951e544a14d06a34f4b7dc290093ea5"}
Jul 27 20:27:06.187227 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:06.187189    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc" event={"ID":"671966c0-01ee-4c1b-9648-087cb7f361f4","Type":"ContainerStarted","Data":"549d38dded6b773370c08ff74305280371dcbdeaed67623f8bae9c46fb161a0c"}
Jul 27 20:27:06.205409 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:06.205357    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc" podStartSLOduration=1.025064759 podStartE2EDuration="2.205339457s" totalImagesPullingTime="1.180274698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:27:06.203397687 +0000 UTC m=+581.859553051" watchObservedRunningTime="2026-07-27 20:27:06.205339457 +0000 UTC m=+581.861494814"
Jul 27 20:27:14.726631 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:14.726592    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:14.727148 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:14.726659    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:14.739496 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:14.739472    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:15.254815 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:15.254786    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc"
Jul 27 20:27:26.350557 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:26.350529    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:27:26.351071 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:26.350539    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:27:45.288593 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.288553    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"]
Jul 27 20:27:45.295548 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.295519    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.298104 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.298071    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 20:27:45.303393 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.303368    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"]
Jul 27 20:27:45.327579 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.327544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6171d123-4fd1-438f-957f-c6d063be0af3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.327771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.327601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6171d123-4fd1-438f-957f-c6d063be0af3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.327771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.327637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6171d123-4fd1-438f-957f-c6d063be0af3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.327771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.327680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z247\" (UniqueName: \"kubernetes.io/projected/6171d123-4fd1-438f-957f-c6d063be0af3-kube-api-access-4z247\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.327771 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.327714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6171d123-4fd1-438f-957f-c6d063be0af3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.327936 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.327799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6171d123-4fd1-438f-957f-c6d063be0af3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.428626 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.428592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6171d123-4fd1-438f-957f-c6d063be0af3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.428626 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.428633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6171d123-4fd1-438f-957f-c6d063be0af3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.429021 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.428651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6171d123-4fd1-438f-957f-c6d063be0af3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.429021 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.428672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z247\" (UniqueName: \"kubernetes.io/projected/6171d123-4fd1-438f-957f-c6d063be0af3-kube-api-access-4z247\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.429021 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.428697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6171d123-4fd1-438f-957f-c6d063be0af3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.429021 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.428722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6171d123-4fd1-438f-957f-c6d063be0af3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.429201 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.429087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6171d123-4fd1-438f-957f-c6d063be0af3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.429201 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.429135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6171d123-4fd1-438f-957f-c6d063be0af3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.429201 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.429192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6171d123-4fd1-438f-957f-c6d063be0af3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.431020 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.430997    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6171d123-4fd1-438f-957f-c6d063be0af3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.431508 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.431490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6171d123-4fd1-438f-957f-c6d063be0af3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.435928 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.435907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z247\" (UniqueName: \"kubernetes.io/projected/6171d123-4fd1-438f-957f-c6d063be0af3-kube-api-access-4z247\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g\" (UID: \"6171d123-4fd1-438f-957f-c6d063be0af3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.608555 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.608464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:45.755174 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.755149    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"]
Jul 27 20:27:45.757307 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:27:45.757280    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6171d123_4fd1_438f_957f_c6d063be0af3.slice/crio-014f15003b6f06c70a9656f8104be38ea9cb055131927c0f00425a818e2521d1 WatchSource:0}: Error finding container 014f15003b6f06c70a9656f8104be38ea9cb055131927c0f00425a818e2521d1: Status 404 returned error can't find the container with id 014f15003b6f06c70a9656f8104be38ea9cb055131927c0f00425a818e2521d1
Jul 27 20:27:45.758626 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:45.758609    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:27:46.428975 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:46.428935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g" event={"ID":"6171d123-4fd1-438f-957f-c6d063be0af3","Type":"ContainerStarted","Data":"bbc13a5318f95709f951baecf64f93160447514fec475432d6cbb7dfa4e04b4d"}
Jul 27 20:27:46.429452 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:46.428991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g" event={"ID":"6171d123-4fd1-438f-957f-c6d063be0af3","Type":"ContainerStarted","Data":"014f15003b6f06c70a9656f8104be38ea9cb055131927c0f00425a818e2521d1"}
Jul 27 20:27:46.447789 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:46.447722    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g" podStartSLOduration=1.231200275 podStartE2EDuration="1.447707247s" totalImagesPullingTime="216.506972ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:27:46.446444916 +0000 UTC m=+622.102600262" watchObservedRunningTime="2026-07-27 20:27:46.447707247 +0000 UTC m=+622.103862590"
Jul 27 20:27:55.609143 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:55.609103    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:55.609553 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:55.609169    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:55.621617 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:55.621585    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:27:56.501735 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:27:56.501708    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g"
Jul 27 20:28:30.801954 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.801914    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"]
Jul 27 20:28:30.805787 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.805759    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.808534 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.808507    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 27 20:28:30.817490 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.817459    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"]
Jul 27 20:28:30.896718 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.896682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/877af25c-0809-4835-944c-6ebe41e91221-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.896718 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.896723    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/877af25c-0809-4835-944c-6ebe41e91221-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.896963 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.896810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/877af25c-0809-4835-944c-6ebe41e91221-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.896963 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.896853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/877af25c-0809-4835-944c-6ebe41e91221-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.896963 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.896934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdgjm\" (UniqueName: \"kubernetes.io/projected/877af25c-0809-4835-944c-6ebe41e91221-kube-api-access-wdgjm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.897083 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.896972    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/877af25c-0809-4835-944c-6ebe41e91221-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.997883 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.997845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdgjm\" (UniqueName: \"kubernetes.io/projected/877af25c-0809-4835-944c-6ebe41e91221-kube-api-access-wdgjm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.998084 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.997900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/877af25c-0809-4835-944c-6ebe41e91221-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.998084 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.997949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/877af25c-0809-4835-944c-6ebe41e91221-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.998084 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.997974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/877af25c-0809-4835-944c-6ebe41e91221-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.998084 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.998003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/877af25c-0809-4835-944c-6ebe41e91221-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.998084 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.998040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/877af25c-0809-4835-944c-6ebe41e91221-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.998408 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.998384    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/877af25c-0809-4835-944c-6ebe41e91221-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.998451 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.998392    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/877af25c-0809-4835-944c-6ebe41e91221-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:30.998503 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:30.998485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/877af25c-0809-4835-944c-6ebe41e91221-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:31.000364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:31.000335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/877af25c-0809-4835-944c-6ebe41e91221-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:31.000523 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:31.000505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/877af25c-0809-4835-944c-6ebe41e91221-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:31.005439 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:31.005414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdgjm\" (UniqueName: \"kubernetes.io/projected/877af25c-0809-4835-944c-6ebe41e91221-kube-api-access-wdgjm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h85cj\" (UID: \"877af25c-0809-4835-944c-6ebe41e91221\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:31.117434 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:31.117334    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:31.268478 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:31.268448    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"]
Jul 27 20:28:31.270029 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:28:31.269999    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod877af25c_0809_4835_944c_6ebe41e91221.slice/crio-0862b06e2c004d0b6b49e548c435f275867acf1bc0f8b6cf366c62f608362e90 WatchSource:0}: Error finding container 0862b06e2c004d0b6b49e548c435f275867acf1bc0f8b6cf366c62f608362e90: Status 404 returned error can't find the container with id 0862b06e2c004d0b6b49e548c435f275867acf1bc0f8b6cf366c62f608362e90
Jul 27 20:28:31.704819 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:31.704782    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj" event={"ID":"877af25c-0809-4835-944c-6ebe41e91221","Type":"ContainerStarted","Data":"04c0586276204dbe2aef0410288305187639337897f32e0565470cc1a583c383"}
Jul 27 20:28:31.704819 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:31.704829    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj" event={"ID":"877af25c-0809-4835-944c-6ebe41e91221","Type":"ContainerStarted","Data":"0862b06e2c004d0b6b49e548c435f275867acf1bc0f8b6cf366c62f608362e90"}
Jul 27 20:28:31.723452 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:31.723348    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj" podStartSLOduration=1.5244822679999999 podStartE2EDuration="1.723331318s" totalImagesPullingTime="198.84905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:28:31.720690963 +0000 UTC m=+667.376846308" watchObservedRunningTime="2026-07-27 20:28:31.723331318 +0000 UTC m=+667.379486661"
Jul 27 20:28:41.118326 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:41.118287    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:41.118717 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:41.118339    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:41.131580 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:41.131553    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:28:41.787061 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:28:41.787027    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h85cj"
Jul 27 20:29:44.270074 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.270040    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76454666df-jlxzk"]
Jul 27 20:29:44.273769 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.273739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76454666df-jlxzk"
Jul 27 20:29:44.276877 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.276858    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-glsmt\""
Jul 27 20:29:44.276877 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.276858    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 20:29:44.282513 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.282462    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76454666df-jlxzk"]
Jul 27 20:29:44.340503 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.340470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/61810c8a-925e-49be-b56f-07e0b61f9c7b-tls-cert\") pod \"authorino-76454666df-jlxzk\" (UID: \"61810c8a-925e-49be-b56f-07e0b61f9c7b\") " pod="kuadrant-system/authorino-76454666df-jlxzk"
Jul 27 20:29:44.340681 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.340532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfhnx\" (UniqueName: \"kubernetes.io/projected/61810c8a-925e-49be-b56f-07e0b61f9c7b-kube-api-access-wfhnx\") pod \"authorino-76454666df-jlxzk\" (UID: \"61810c8a-925e-49be-b56f-07e0b61f9c7b\") " pod="kuadrant-system/authorino-76454666df-jlxzk"
Jul 27 20:29:44.441177 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.441141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfhnx\" (UniqueName: \"kubernetes.io/projected/61810c8a-925e-49be-b56f-07e0b61f9c7b-kube-api-access-wfhnx\") pod \"authorino-76454666df-jlxzk\" (UID: \"61810c8a-925e-49be-b56f-07e0b61f9c7b\") " pod="kuadrant-system/authorino-76454666df-jlxzk"
Jul 27 20:29:44.441371 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.441256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/61810c8a-925e-49be-b56f-07e0b61f9c7b-tls-cert\") pod \"authorino-76454666df-jlxzk\" (UID: \"61810c8a-925e-49be-b56f-07e0b61f9c7b\") " pod="kuadrant-system/authorino-76454666df-jlxzk"
Jul 27 20:29:44.443624 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.443604    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/61810c8a-925e-49be-b56f-07e0b61f9c7b-tls-cert\") pod \"authorino-76454666df-jlxzk\" (UID: \"61810c8a-925e-49be-b56f-07e0b61f9c7b\") " pod="kuadrant-system/authorino-76454666df-jlxzk"
Jul 27 20:29:44.448584 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.448560    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfhnx\" (UniqueName: \"kubernetes.io/projected/61810c8a-925e-49be-b56f-07e0b61f9c7b-kube-api-access-wfhnx\") pod \"authorino-76454666df-jlxzk\" (UID: \"61810c8a-925e-49be-b56f-07e0b61f9c7b\") " pod="kuadrant-system/authorino-76454666df-jlxzk"
Jul 27 20:29:44.585684 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.585647    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76454666df-jlxzk"
Jul 27 20:29:44.743632 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:44.743604    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76454666df-jlxzk"]
Jul 27 20:29:44.745482 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:29:44.745449    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61810c8a_925e_49be_b56f_07e0b61f9c7b.slice/crio-8c6e3aa37eaf0657a6c4f4d380093f6501a32c0a064b412337a76076b4c543fb WatchSource:0}: Error finding container 8c6e3aa37eaf0657a6c4f4d380093f6501a32c0a064b412337a76076b4c543fb: Status 404 returned error can't find the container with id 8c6e3aa37eaf0657a6c4f4d380093f6501a32c0a064b412337a76076b4c543fb
Jul 27 20:29:45.151213 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:45.151187    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76454666df-jlxzk" event={"ID":"61810c8a-925e-49be-b56f-07e0b61f9c7b","Type":"ContainerStarted","Data":"8c6e3aa37eaf0657a6c4f4d380093f6501a32c0a064b412337a76076b4c543fb"}
Jul 27 20:29:46.160191 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:46.159722    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76454666df-jlxzk" event={"ID":"61810c8a-925e-49be-b56f-07e0b61f9c7b","Type":"ContainerStarted","Data":"04e9d89068faa9b32957644e9ff138e17f42f755a817f75136c320e378a1f238"}
Jul 27 20:29:46.187505 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:29:46.187447    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76454666df-jlxzk" podStartSLOduration=1.796272103 podStartE2EDuration="2.187428073s" totalImagesPullingTime="391.15597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:29:46.183793642 +0000 UTC m=+741.839948986" watchObservedRunningTime="2026-07-27 20:29:46.187428073 +0000 UTC m=+741.843583416"
Jul 27 20:30:33.054572 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.054540    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cbc7b97fc-thtgc"]
Jul 27 20:30:33.055099 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.054731    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cbc7b97fc-thtgc" podUID="2ee01a5d-7a5e-4778-9112-9d55d1c84187" containerName="manager" containerID="cri-o://a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe" gracePeriod=30
Jul 27 20:30:33.309711 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.309649    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cbc7b97fc-thtgc"
Jul 27 20:30:33.342888 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.342858    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ee01a5d-7a5e-4778-9112-9d55d1c84187-webhook-cert\") pod \"2ee01a5d-7a5e-4778-9112-9d55d1c84187\" (UID: \"2ee01a5d-7a5e-4778-9112-9d55d1c84187\") "
Jul 27 20:30:33.343078 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.342913    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmpxh\" (UniqueName: \"kubernetes.io/projected/2ee01a5d-7a5e-4778-9112-9d55d1c84187-kube-api-access-jmpxh\") pod \"2ee01a5d-7a5e-4778-9112-9d55d1c84187\" (UID: \"2ee01a5d-7a5e-4778-9112-9d55d1c84187\") "
Jul 27 20:30:33.345013 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.344977    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ee01a5d-7a5e-4778-9112-9d55d1c84187-kube-api-access-jmpxh" (OuterVolumeSpecName: "kube-api-access-jmpxh") pod "2ee01a5d-7a5e-4778-9112-9d55d1c84187" (UID: "2ee01a5d-7a5e-4778-9112-9d55d1c84187"). InnerVolumeSpecName "kube-api-access-jmpxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:30:33.345124 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.344990    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ee01a5d-7a5e-4778-9112-9d55d1c84187-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2ee01a5d-7a5e-4778-9112-9d55d1c84187" (UID: "2ee01a5d-7a5e-4778-9112-9d55d1c84187"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:30:33.444102 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.444068    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ee01a5d-7a5e-4778-9112-9d55d1c84187-webhook-cert\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:30:33.444102 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.444099    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmpxh\" (UniqueName: \"kubernetes.io/projected/2ee01a5d-7a5e-4778-9112-9d55d1c84187-kube-api-access-jmpxh\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:30:33.456242 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.456206    2580 generic.go:356] "Generic (PLEG): container finished" podID="2ee01a5d-7a5e-4778-9112-9d55d1c84187" containerID="a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe" exitCode=0
Jul 27 20:30:33.456389 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.456250    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cbc7b97fc-thtgc"
Jul 27 20:30:33.456389 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.456295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cbc7b97fc-thtgc" event={"ID":"2ee01a5d-7a5e-4778-9112-9d55d1c84187","Type":"ContainerDied","Data":"a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe"}
Jul 27 20:30:33.456389 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.456348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cbc7b97fc-thtgc" event={"ID":"2ee01a5d-7a5e-4778-9112-9d55d1c84187","Type":"ContainerDied","Data":"ba8e015489f3c2b7b04690a60fd5f143426ec110fbbd9494d750d3974bb6b6d8"}
Jul 27 20:30:33.456389 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.456370    2580 scope.go:117] "RemoveContainer" containerID="a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe"
Jul 27 20:30:33.478688 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.478667    2580 scope.go:117] "RemoveContainer" containerID="a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe"
Jul 27 20:30:33.479058 ip-10-0-139-20 kubenswrapper[2580]: E0727 20:30:33.479027    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe\": container with ID starting with a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe not found: ID does not exist" containerID="a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe"
Jul 27 20:30:33.479166 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.479068    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe"} err="failed to get container status \"a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe\": rpc error: code = NotFound desc = could not find container \"a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe\": container with ID starting with a46fbb748542876aaec4dbce484c1588b00bf945e6b5fbebc1a79c387835a1fe not found: ID does not exist"
Jul 27 20:30:33.484472 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.484450    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cbc7b97fc-thtgc"]
Jul 27 20:30:33.488202 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:33.488180    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cbc7b97fc-thtgc"]
Jul 27 20:30:34.903958 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:30:34.903926    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ee01a5d-7a5e-4778-9112-9d55d1c84187" path="/var/lib/kubelet/pods/2ee01a5d-7a5e-4778-9112-9d55d1c84187/volumes"
Jul 27 20:32:26.391407 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:32:26.391378    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:32:26.393299 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:32:26.393277    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:37:26.431422 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:37:26.431392    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:37:26.435322 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:37:26.435296    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:42:26.479786 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:42:26.479655    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:42:26.489712 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:42:26.489690    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:45:00.135330 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:00.135288    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf"]
Jul 27 20:45:00.135826 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:00.135781    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ee01a5d-7a5e-4778-9112-9d55d1c84187" containerName="manager"
Jul 27 20:45:00.135826 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:00.135798    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ee01a5d-7a5e-4778-9112-9d55d1c84187" containerName="manager"
Jul 27 20:45:00.135911 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:00.135872    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ee01a5d-7a5e-4778-9112-9d55d1c84187" containerName="manager"
Jul 27 20:45:00.139072 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:00.139056    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf"
Jul 27 20:45:00.141168 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:00.141148    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 20:45:00.145760 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:00.145720    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf"]
Jul 27 20:45:00.152196 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:00.152173    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf"
Jul 27 20:45:00.290147 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:00.290121    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf"]
Jul 27 20:45:00.292248 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:45:00.292216    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64979e15_ce79_408a_8abd_9961d5d78e50.slice/crio-99438b47f1fe3e6d63e4b85028188d5a2a15edf290707acf00ad36ddfea750cc WatchSource:0}: Error finding container 99438b47f1fe3e6d63e4b85028188d5a2a15edf290707acf00ad36ddfea750cc: Status 404 returned error can't find the container with id 99438b47f1fe3e6d63e4b85028188d5a2a15edf290707acf00ad36ddfea750cc
Jul 27 20:45:00.294159 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:00.294143    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:45:00.763584 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:00.763548    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf" event={"ID":"64979e15-ce79-408a-8abd-9961d5d78e50","Type":"ContainerStarted","Data":"99438b47f1fe3e6d63e4b85028188d5a2a15edf290707acf00ad36ddfea750cc"}
Jul 27 20:45:03.783807 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:03.783768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf" event={"ID":"64979e15-ce79-408a-8abd-9961d5d78e50","Type":"ContainerStarted","Data":"3fcaa98cbd79ac8f5390b73b06794aef80e86b8d677f96676ed9db9bfb87c570"}
Jul 27 20:45:03.799731 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:03.799674    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf" podStartSLOduration=0.97075549 podStartE2EDuration="3.799658719s" totalImagesPullingTime="2.828903229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:03.79728638 +0000 UTC m=+1659.453441723" watchObservedRunningTime="2026-07-27 20:45:03.799658719 +0000 UTC m=+1659.455814107"
Jul 27 20:45:04.794789 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:04.794738    2580 generic.go:356] "Generic (PLEG): container finished" podID="64979e15-ce79-408a-8abd-9961d5d78e50" containerID="3fcaa98cbd79ac8f5390b73b06794aef80e86b8d677f96676ed9db9bfb87c570" exitCode=0
Jul 27 20:45:04.795255 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:04.794819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf" event={"ID":"64979e15-ce79-408a-8abd-9961d5d78e50","Type":"ContainerDied","Data":"3fcaa98cbd79ac8f5390b73b06794aef80e86b8d677f96676ed9db9bfb87c570"}
Jul 27 20:45:04.969160 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:04.969116    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf"]
Jul 27 20:45:05.953012 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:05.952985    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf"
Jul 27 20:45:06.809432 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:06.809395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf" event={"ID":"64979e15-ce79-408a-8abd-9961d5d78e50","Type":"ContainerDied","Data":"99438b47f1fe3e6d63e4b85028188d5a2a15edf290707acf00ad36ddfea750cc"}
Jul 27 20:45:06.809432 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:06.809427    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf"
Jul 27 20:45:06.809673 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:06.809449    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99438b47f1fe3e6d63e4b85028188d5a2a15edf290707acf00ad36ddfea750cc"
Jul 27 20:45:06.834977 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:06.834945    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf"]
Jul 27 20:45:06.840344 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:06.840307    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-584365a2-29753085-299pf"]
Jul 27 20:45:06.903731 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:06.903694    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64979e15-ce79-408a-8abd-9961d5d78e50" path="/var/lib/kubelet/pods/64979e15-ce79-408a-8abd-9961d5d78e50/volumes"
Jul 27 20:45:37.927698 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:37.927655    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8"]
Jul 27 20:45:37.928189 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:37.928125    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64979e15-ce79-408a-8abd-9961d5d78e50" containerName="cleanup"
Jul 27 20:45:37.928189 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:37.928137    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="64979e15-ce79-408a-8abd-9961d5d78e50" containerName="cleanup"
Jul 27 20:45:37.928265 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:37.928231    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="64979e15-ce79-408a-8abd-9961d5d78e50" containerName="cleanup"
Jul 27 20:45:37.935958 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:37.935931    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8"
Jul 27 20:45:37.937691 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:37.937661    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8"]
Jul 27 20:45:37.938380 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:37.938358    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 20:45:38.120491 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:38.120456    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/439699b2-cab8-452c-9da7-cb438935e93b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8\" (UID: \"439699b2-cab8-452c-9da7-cb438935e93b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8"
Jul 27 20:45:38.221184 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:38.221098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/439699b2-cab8-452c-9da7-cb438935e93b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8\" (UID: \"439699b2-cab8-452c-9da7-cb438935e93b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8"
Jul 27 20:45:38.221713 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:38.221692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/439699b2-cab8-452c-9da7-cb438935e93b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8\" (UID: \"439699b2-cab8-452c-9da7-cb438935e93b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8"
Jul 27 20:45:38.248993 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:38.248966    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8"
Jul 27 20:45:38.391209 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:38.391183    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8"]
Jul 27 20:45:38.393841 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:45:38.393809    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439699b2_cab8_452c_9da7_cb438935e93b.slice/crio-66827feed82df5a485af6060b7582e3c23c4ec1c682c837c9a608970194b8f2d WatchSource:0}: Error finding container 66827feed82df5a485af6060b7582e3c23c4ec1c682c837c9a608970194b8f2d: Status 404 returned error can't find the container with id 66827feed82df5a485af6060b7582e3c23c4ec1c682c837c9a608970194b8f2d
Jul 27 20:45:39.006510 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:39.006416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8" event={"ID":"439699b2-cab8-452c-9da7-cb438935e93b","Type":"ContainerStarted","Data":"47ed06f1a5be17a46dabd9c684557a7d8abe192a770f71233dcc1e25d999c113"}
Jul 27 20:45:39.006510 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:39.006475    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8" event={"ID":"439699b2-cab8-452c-9da7-cb438935e93b","Type":"ContainerStarted","Data":"66827feed82df5a485af6060b7582e3c23c4ec1c682c837c9a608970194b8f2d"}
Jul 27 20:45:39.020996 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:39.020822    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8" podStartSLOduration=2.020803574 podStartE2EDuration="2.020803574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:39.02018744 +0000 UTC m=+1694.676342782" watchObservedRunningTime="2026-07-27 20:45:39.020803574 +0000 UTC m=+1694.676958918"
Jul 27 20:45:40.013583 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:40.013543    2580 generic.go:356] "Generic (PLEG): container finished" podID="439699b2-cab8-452c-9da7-cb438935e93b" containerID="47ed06f1a5be17a46dabd9c684557a7d8abe192a770f71233dcc1e25d999c113" exitCode=0
Jul 27 20:45:40.014008 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:40.013620    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8" event={"ID":"439699b2-cab8-452c-9da7-cb438935e93b","Type":"ContainerDied","Data":"47ed06f1a5be17a46dabd9c684557a7d8abe192a770f71233dcc1e25d999c113"}
Jul 27 20:45:41.167812 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:41.167787    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8"
Jul 27 20:45:41.250704 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:41.250667    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/439699b2-cab8-452c-9da7-cb438935e93b-maas-api-service-ca\") pod \"439699b2-cab8-452c-9da7-cb438935e93b\" (UID: \"439699b2-cab8-452c-9da7-cb438935e93b\") "
Jul 27 20:45:41.251121 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:41.251101    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/439699b2-cab8-452c-9da7-cb438935e93b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "439699b2-cab8-452c-9da7-cb438935e93b" (UID: "439699b2-cab8-452c-9da7-cb438935e93b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:45:41.352371 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:41.352328    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/439699b2-cab8-452c-9da7-cb438935e93b-maas-api-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:45:42.025879 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:42.025846    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8"
Jul 27 20:45:42.026067 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:42.025880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8" event={"ID":"439699b2-cab8-452c-9da7-cb438935e93b","Type":"ContainerDied","Data":"66827feed82df5a485af6060b7582e3c23c4ec1c682c837c9a608970194b8f2d"}
Jul 27 20:45:42.026067 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:42.025929    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66827feed82df5a485af6060b7582e3c23c4ec1c682c837c9a608970194b8f2d"
Jul 27 20:45:53.003210 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:53.003128    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8"]
Jul 27 20:45:53.005568 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:53.005546    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-944cd4c8-k97t8"]
Jul 27 20:45:54.904040 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:45:54.904007    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="439699b2-cab8-452c-9da7-cb438935e93b" path="/var/lib/kubelet/pods/439699b2-cab8-452c-9da7-cb438935e93b/volumes"
Jul 27 20:46:21.834403 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:21.834370    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p"]
Jul 27 20:46:21.834887 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:21.834853    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439699b2-cab8-452c-9da7-cb438935e93b" containerName="revoke-keys"
Jul 27 20:46:21.834887 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:21.834866    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="439699b2-cab8-452c-9da7-cb438935e93b" containerName="revoke-keys"
Jul 27 20:46:21.834966 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:21.834955    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="439699b2-cab8-452c-9da7-cb438935e93b" containerName="revoke-keys"
Jul 27 20:46:21.838352 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:21.838327    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p"
Jul 27 20:46:21.840877 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:21.840850    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 20:46:21.843572 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:21.843548    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p"]
Jul 27 20:46:21.863631 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:21.863594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cc3cf58-ab69-437f-a89c-ea710b319173-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p\" (UID: \"9cc3cf58-ab69-437f-a89c-ea710b319173\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p"
Jul 27 20:46:21.964288 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:21.964246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cc3cf58-ab69-437f-a89c-ea710b319173-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p\" (UID: \"9cc3cf58-ab69-437f-a89c-ea710b319173\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p"
Jul 27 20:46:21.964906 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:21.964884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cc3cf58-ab69-437f-a89c-ea710b319173-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p\" (UID: \"9cc3cf58-ab69-437f-a89c-ea710b319173\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p"
Jul 27 20:46:22.152843 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:22.152702    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p"
Jul 27 20:46:22.290021 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:22.289996    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p"]
Jul 27 20:46:22.292670 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:46:22.292645    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc3cf58_ab69_437f_a89c_ea710b319173.slice/crio-281444057fb1e5576506b65be86ff5ba7f9ecb96de8a930864cca1352dccd0f3 WatchSource:0}: Error finding container 281444057fb1e5576506b65be86ff5ba7f9ecb96de8a930864cca1352dccd0f3: Status 404 returned error can't find the container with id 281444057fb1e5576506b65be86ff5ba7f9ecb96de8a930864cca1352dccd0f3
Jul 27 20:46:23.280076 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:23.279986    2580 generic.go:356] "Generic (PLEG): container finished" podID="9cc3cf58-ab69-437f-a89c-ea710b319173" containerID="6bc16c38db7c39eb2f8d4c259b00dbccb42ce690c71c7743637466e3614bc29c" exitCode=0
Jul 27 20:46:23.280076 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:23.280062    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p" event={"ID":"9cc3cf58-ab69-437f-a89c-ea710b319173","Type":"ContainerDied","Data":"6bc16c38db7c39eb2f8d4c259b00dbccb42ce690c71c7743637466e3614bc29c"}
Jul 27 20:46:23.280476 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:23.280107    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p" event={"ID":"9cc3cf58-ab69-437f-a89c-ea710b319173","Type":"ContainerStarted","Data":"281444057fb1e5576506b65be86ff5ba7f9ecb96de8a930864cca1352dccd0f3"}
Jul 27 20:46:24.433926 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:24.433899    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p"
Jul 27 20:46:24.487616 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:24.487579    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cc3cf58-ab69-437f-a89c-ea710b319173-maas-api-service-ca\") pod \"9cc3cf58-ab69-437f-a89c-ea710b319173\" (UID: \"9cc3cf58-ab69-437f-a89c-ea710b319173\") "
Jul 27 20:46:24.487996 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:24.487973    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cc3cf58-ab69-437f-a89c-ea710b319173-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9cc3cf58-ab69-437f-a89c-ea710b319173" (UID: "9cc3cf58-ab69-437f-a89c-ea710b319173"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:46:24.588665 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:24.588568    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cc3cf58-ab69-437f-a89c-ea710b319173-maas-api-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:46:25.293219 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:25.293190    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p"
Jul 27 20:46:25.293365 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:25.293217    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p" event={"ID":"9cc3cf58-ab69-437f-a89c-ea710b319173","Type":"ContainerDied","Data":"281444057fb1e5576506b65be86ff5ba7f9ecb96de8a930864cca1352dccd0f3"}
Jul 27 20:46:25.293365 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:25.293264    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="281444057fb1e5576506b65be86ff5ba7f9ecb96de8a930864cca1352dccd0f3"
Jul 27 20:46:36.913507 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:36.913475    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p"]
Jul 27 20:46:36.916047 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:36.916025    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ac3244c-hk77p"]
Jul 27 20:46:38.903834 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:46:38.903794    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc3cf58-ab69-437f-a89c-ea710b319173" path="/var/lib/kubelet/pods/9cc3cf58-ab69-437f-a89c-ea710b319173/volumes"
Jul 27 20:47:26.522211 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:47:26.522081    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:47:26.535012 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:47:26.534989    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:50:29.394945 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:29.394868    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7"]
Jul 27 20:50:29.395369 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:29.395321    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc3cf58-ab69-437f-a89c-ea710b319173" containerName="revoke-keys"
Jul 27 20:50:29.395369 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:29.395334    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc3cf58-ab69-437f-a89c-ea710b319173" containerName="revoke-keys"
Jul 27 20:50:29.395446 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:29.395409    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc3cf58-ab69-437f-a89c-ea710b319173" containerName="revoke-keys"
Jul 27 20:50:29.398509 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:29.398493    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7"
Jul 27 20:50:29.402068 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:29.402047    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 20:50:29.410809 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:29.410739    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7"]
Jul 27 20:50:29.514528 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:29.514497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d0d7311-9253-4f43-88e6-923e2193308d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7\" (UID: \"2d0d7311-9253-4f43-88e6-923e2193308d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7"
Jul 27 20:50:29.615651 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:29.615608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d0d7311-9253-4f43-88e6-923e2193308d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7\" (UID: \"2d0d7311-9253-4f43-88e6-923e2193308d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7"
Jul 27 20:50:29.616263 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:29.616244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d0d7311-9253-4f43-88e6-923e2193308d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7\" (UID: \"2d0d7311-9253-4f43-88e6-923e2193308d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7"
Jul 27 20:50:29.708928 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:29.708844    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7"
Jul 27 20:50:29.850160 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:29.850134    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7"]
Jul 27 20:50:29.852637 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:50:29.852608    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0d7311_9253_4f43_88e6_923e2193308d.slice/crio-4394bf0486af50b3c6d1b1382e4927f9c09eeac6b459e4a71ea6b2e2eafd8812 WatchSource:0}: Error finding container 4394bf0486af50b3c6d1b1382e4927f9c09eeac6b459e4a71ea6b2e2eafd8812: Status 404 returned error can't find the container with id 4394bf0486af50b3c6d1b1382e4927f9c09eeac6b459e4a71ea6b2e2eafd8812
Jul 27 20:50:30.831416 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:30.831327    2580 generic.go:356] "Generic (PLEG): container finished" podID="2d0d7311-9253-4f43-88e6-923e2193308d" containerID="995a748f20e79f9b620f95f4cf75bdc05d0dd6acce846d1f1a8f82aec615f06a" exitCode=0
Jul 27 20:50:30.831809 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:30.831416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7" event={"ID":"2d0d7311-9253-4f43-88e6-923e2193308d","Type":"ContainerDied","Data":"995a748f20e79f9b620f95f4cf75bdc05d0dd6acce846d1f1a8f82aec615f06a"}
Jul 27 20:50:30.831809 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:30.831476    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7" event={"ID":"2d0d7311-9253-4f43-88e6-923e2193308d","Type":"ContainerStarted","Data":"4394bf0486af50b3c6d1b1382e4927f9c09eeac6b459e4a71ea6b2e2eafd8812"}
Jul 27 20:50:31.977346 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:31.977318    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7"
Jul 27 20:50:32.141145 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:32.141043    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d0d7311-9253-4f43-88e6-923e2193308d-maas-api-service-ca\") pod \"2d0d7311-9253-4f43-88e6-923e2193308d\" (UID: \"2d0d7311-9253-4f43-88e6-923e2193308d\") "
Jul 27 20:50:32.141414 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:32.141393    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d0d7311-9253-4f43-88e6-923e2193308d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d0d7311-9253-4f43-88e6-923e2193308d" (UID: "2d0d7311-9253-4f43-88e6-923e2193308d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:50:32.242256 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:32.242224    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d0d7311-9253-4f43-88e6-923e2193308d-maas-api-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:50:32.845808 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:32.845774    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7"
Jul 27 20:50:32.845808 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:32.845800    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7" event={"ID":"2d0d7311-9253-4f43-88e6-923e2193308d","Type":"ContainerDied","Data":"4394bf0486af50b3c6d1b1382e4927f9c09eeac6b459e4a71ea6b2e2eafd8812"}
Jul 27 20:50:32.846026 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:32.845885    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4394bf0486af50b3c6d1b1382e4927f9c09eeac6b459e4a71ea6b2e2eafd8812"
Jul 27 20:50:49.495946 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:49.495897    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7"]
Jul 27 20:50:49.499574 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:49.499547    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afbe9b95-wpxz7"]
Jul 27 20:50:50.903139 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:50:50.903105    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d0d7311-9253-4f43-88e6-923e2193308d" path="/var/lib/kubelet/pods/2d0d7311-9253-4f43-88e6-923e2193308d/volumes"
Jul 27 20:51:26.761805 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:51:26.761771    2580 scope.go:117] "RemoveContainer" containerID="3fcaa98cbd79ac8f5390b73b06794aef80e86b8d677f96676ed9db9bfb87c570"
Jul 27 20:52:26.566677 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:52:26.566644    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:52:26.578773 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:52:26.578732    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:52:26.786355 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:52:26.786323    2580 scope.go:117] "RemoveContainer" containerID="6bc16c38db7c39eb2f8d4c259b00dbccb42ce690c71c7743637466e3614bc29c"
Jul 27 20:52:26.795982 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:52:26.795962    2580 scope.go:117] "RemoveContainer" containerID="47ed06f1a5be17a46dabd9c684557a7d8abe192a770f71233dcc1e25d999c113"
Jul 27 20:53:40.303284 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.303246    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"]
Jul 27 20:53:40.303878 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.303712    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d0d7311-9253-4f43-88e6-923e2193308d" containerName="revoke-keys"
Jul 27 20:53:40.303878 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.303725    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d0d7311-9253-4f43-88e6-923e2193308d" containerName="revoke-keys"
Jul 27 20:53:40.303878 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.303856    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d0d7311-9253-4f43-88e6-923e2193308d" containerName="revoke-keys"
Jul 27 20:53:40.307025 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.307009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.310183 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.310155    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-704ca2\"/\"default-dockercfg-6x8wx\""
Jul 27 20:53:40.310183 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.310179    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-704ca2\"/\"test-model-704ca2-kserve-self-signed-certs\""
Jul 27 20:53:40.310356 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.310230    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-704ca2\"/\"openshift-service-ca.crt\""
Jul 27 20:53:40.310356 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.310166    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-704ca2\"/\"kube-root-ca.crt\""
Jul 27 20:53:40.315949 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.315925    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"]
Jul 27 20:53:40.403309 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.403269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d790d241-ed5d-4963-8440-5fc596ab40bb-tls-certs\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.403481 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.403322    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-model-cache\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.403481 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.403349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvpxx\" (UniqueName: \"kubernetes.io/projected/d790d241-ed5d-4963-8440-5fc596ab40bb-kube-api-access-qvpxx\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.403481 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.403371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-dshm\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.403481 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.403410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-home\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.403481 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.403425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-tmp-dir\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.504441 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.504406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-dshm\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.504637 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.504461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-home\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.504637 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.504479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-tmp-dir\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.504637 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.504552    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d790d241-ed5d-4963-8440-5fc596ab40bb-tls-certs\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.504637 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.504582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-model-cache\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.504637 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.504603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvpxx\" (UniqueName: \"kubernetes.io/projected/d790d241-ed5d-4963-8440-5fc596ab40bb-kube-api-access-qvpxx\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.504951 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.504868    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-home\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.505014 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.504968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-tmp-dir\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.505106 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.505087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-model-cache\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.506859 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.506839    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-dshm\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.506995 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.506981    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d790d241-ed5d-4963-8440-5fc596ab40bb-tls-certs\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.512793 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.512769    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvpxx\" (UniqueName: \"kubernetes.io/projected/d790d241-ed5d-4963-8440-5fc596ab40bb-kube-api-access-qvpxx\") pod \"test-model-704ca2-kserve-77cdd774cf-cwkws\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") " pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.618194 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.618095    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:40.772240 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:40.772213    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"]
Jul 27 20:53:40.773668 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:53:40.773624    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd790d241_ed5d_4963_8440_5fc596ab40bb.slice/crio-21a47d553867c66f9d15dda5f13c3fbdef9f6e78c12c6f1249b5a607bf5d112c WatchSource:0}: Error finding container 21a47d553867c66f9d15dda5f13c3fbdef9f6e78c12c6f1249b5a607bf5d112c: Status 404 returned error can't find the container with id 21a47d553867c66f9d15dda5f13c3fbdef9f6e78c12c6f1249b5a607bf5d112c
Jul 27 20:53:41.010176 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:41.010086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws" event={"ID":"d790d241-ed5d-4963-8440-5fc596ab40bb","Type":"ContainerStarted","Data":"2ebf5ca70576cfc3c3f0f060eae95fd4dccb9b9284e572ac0fe7b095e4000e71"}
Jul 27 20:53:41.010176 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:41.010132    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws" event={"ID":"d790d241-ed5d-4963-8440-5fc596ab40bb","Type":"ContainerStarted","Data":"21a47d553867c66f9d15dda5f13c3fbdef9f6e78c12c6f1249b5a607bf5d112c"}
Jul 27 20:53:41.027283 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:41.027234    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws" podStartSLOduration=1.027220535 podStartE2EDuration="1.027220535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:53:41.02652416 +0000 UTC m=+2176.682679503" watchObservedRunningTime="2026-07-27 20:53:41.027220535 +0000 UTC m=+2176.683375877"
Jul 27 20:53:50.619208 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:50.619162    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:50.619208 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:50.619218    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:50.631889 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:50.631859    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:53:51.081007 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:53:51.080978    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:54:23.095561 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:23.095521    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"]
Jul 27 20:54:38.115584 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.115508    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws" podUID="d790d241-ed5d-4963-8440-5fc596ab40bb" containerName="main" containerID="cri-o://2ebf5ca70576cfc3c3f0f060eae95fd4dccb9b9284e572ac0fe7b095e4000e71" gracePeriod=45
Jul 27 20:54:38.367470 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.367396    2580 generic.go:356] "Generic (PLEG): container finished" podID="d790d241-ed5d-4963-8440-5fc596ab40bb" containerID="2ebf5ca70576cfc3c3f0f060eae95fd4dccb9b9284e572ac0fe7b095e4000e71" exitCode=0
Jul 27 20:54:38.367618 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.367470    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws" event={"ID":"d790d241-ed5d-4963-8440-5fc596ab40bb","Type":"ContainerDied","Data":"2ebf5ca70576cfc3c3f0f060eae95fd4dccb9b9284e572ac0fe7b095e4000e71"}
Jul 27 20:54:38.367618 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.367518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws" event={"ID":"d790d241-ed5d-4963-8440-5fc596ab40bb","Type":"ContainerDied","Data":"21a47d553867c66f9d15dda5f13c3fbdef9f6e78c12c6f1249b5a607bf5d112c"}
Jul 27 20:54:38.367618 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.367530    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21a47d553867c66f9d15dda5f13c3fbdef9f6e78c12c6f1249b5a607bf5d112c"
Jul 27 20:54:38.380097 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.380074    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:54:38.490792 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.490761    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvpxx\" (UniqueName: \"kubernetes.io/projected/d790d241-ed5d-4963-8440-5fc596ab40bb-kube-api-access-qvpxx\") pod \"d790d241-ed5d-4963-8440-5fc596ab40bb\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") "
Jul 27 20:54:38.490976 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.490837    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d790d241-ed5d-4963-8440-5fc596ab40bb-tls-certs\") pod \"d790d241-ed5d-4963-8440-5fc596ab40bb\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") "
Jul 27 20:54:38.490976 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.490862    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-dshm\") pod \"d790d241-ed5d-4963-8440-5fc596ab40bb\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") "
Jul 27 20:54:38.490976 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.490887    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-model-cache\") pod \"d790d241-ed5d-4963-8440-5fc596ab40bb\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") "
Jul 27 20:54:38.490976 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.490902    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-home\") pod \"d790d241-ed5d-4963-8440-5fc596ab40bb\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") "
Jul 27 20:54:38.490976 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.490934    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-tmp-dir\") pod \"d790d241-ed5d-4963-8440-5fc596ab40bb\" (UID: \"d790d241-ed5d-4963-8440-5fc596ab40bb\") "
Jul 27 20:54:38.491257 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.491193    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-home" (OuterVolumeSpecName: "home") pod "d790d241-ed5d-4963-8440-5fc596ab40bb" (UID: "d790d241-ed5d-4963-8440-5fc596ab40bb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:54:38.491257 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.491223    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-model-cache" (OuterVolumeSpecName: "model-cache") pod "d790d241-ed5d-4963-8440-5fc596ab40bb" (UID: "d790d241-ed5d-4963-8440-5fc596ab40bb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:54:38.491257 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.491237    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d790d241-ed5d-4963-8440-5fc596ab40bb" (UID: "d790d241-ed5d-4963-8440-5fc596ab40bb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:54:38.493127 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.493107    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-dshm" (OuterVolumeSpecName: "dshm") pod "d790d241-ed5d-4963-8440-5fc596ab40bb" (UID: "d790d241-ed5d-4963-8440-5fc596ab40bb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:54:38.493212 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.493111    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d790d241-ed5d-4963-8440-5fc596ab40bb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d790d241-ed5d-4963-8440-5fc596ab40bb" (UID: "d790d241-ed5d-4963-8440-5fc596ab40bb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:54:38.493212 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.493178    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d790d241-ed5d-4963-8440-5fc596ab40bb-kube-api-access-qvpxx" (OuterVolumeSpecName: "kube-api-access-qvpxx") pod "d790d241-ed5d-4963-8440-5fc596ab40bb" (UID: "d790d241-ed5d-4963-8440-5fc596ab40bb"). InnerVolumeSpecName "kube-api-access-qvpxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:54:38.592549 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.592516    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d790d241-ed5d-4963-8440-5fc596ab40bb-tls-certs\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:54:38.592549 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.592546    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-dshm\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:54:38.592549 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.592555    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-model-cache\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:54:38.592808 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.592562    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-home\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:54:38.592808 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.592570    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d790d241-ed5d-4963-8440-5fc596ab40bb-tmp-dir\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:54:38.592808 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:38.592580    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvpxx\" (UniqueName: \"kubernetes.io/projected/d790d241-ed5d-4963-8440-5fc596ab40bb-kube-api-access-qvpxx\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:54:39.373534 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:39.373492    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"
Jul 27 20:54:39.389531 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:39.389496    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"]
Jul 27 20:54:39.393615 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:39.393581    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-704ca2/test-model-704ca2-kserve-77cdd774cf-cwkws"]
Jul 27 20:54:40.903129 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:40.903092    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d790d241-ed5d-4963-8440-5fc596ab40bb" path="/var/lib/kubelet/pods/d790d241-ed5d-4963-8440-5fc596ab40bb/volumes"
Jul 27 20:54:45.159090 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:45.159052    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg"]
Jul 27 20:54:45.159534 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:45.159520    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d790d241-ed5d-4963-8440-5fc596ab40bb" containerName="main"
Jul 27 20:54:45.159534 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:45.159535    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d790d241-ed5d-4963-8440-5fc596ab40bb" containerName="main"
Jul 27 20:54:45.159623 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:45.159613    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d790d241-ed5d-4963-8440-5fc596ab40bb" containerName="main"
Jul 27 20:54:45.163954 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:45.163937    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg"
Jul 27 20:54:45.166235 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:45.166205    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 20:54:45.169309 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:45.169237    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg"]
Jul 27 20:54:45.254881 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:45.254849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c223f091-52d2-4623-b93a-409cc11266e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg\" (UID: \"c223f091-52d2-4623-b93a-409cc11266e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg"
Jul 27 20:54:45.356001 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:45.355958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c223f091-52d2-4623-b93a-409cc11266e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg\" (UID: \"c223f091-52d2-4623-b93a-409cc11266e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg"
Jul 27 20:54:45.356837 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:45.356811    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c223f091-52d2-4623-b93a-409cc11266e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg\" (UID: \"c223f091-52d2-4623-b93a-409cc11266e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg"
Jul 27 20:54:45.477383 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:45.477288    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg"
Jul 27 20:54:45.633687 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:45.633655    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg"]
Jul 27 20:54:45.635193 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:54:45.635169    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc223f091_52d2_4623_b93a_409cc11266e7.slice/crio-3eaf6be9444806d80696d5c64122ce37d8c0cb1d7e3caae08c26f3317d05e227 WatchSource:0}: Error finding container 3eaf6be9444806d80696d5c64122ce37d8c0cb1d7e3caae08c26f3317d05e227: Status 404 returned error can't find the container with id 3eaf6be9444806d80696d5c64122ce37d8c0cb1d7e3caae08c26f3317d05e227
Jul 27 20:54:46.424231 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:46.424196    2580 generic.go:356] "Generic (PLEG): container finished" podID="c223f091-52d2-4623-b93a-409cc11266e7" containerID="442fbc93c8227e16d854f9d916215e3148a25daf5734fb55c5503df57e8fab30" exitCode=0
Jul 27 20:54:46.424604 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:46.424273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg" event={"ID":"c223f091-52d2-4623-b93a-409cc11266e7","Type":"ContainerDied","Data":"442fbc93c8227e16d854f9d916215e3148a25daf5734fb55c5503df57e8fab30"}
Jul 27 20:54:46.424604 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:46.424359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg" event={"ID":"c223f091-52d2-4623-b93a-409cc11266e7","Type":"ContainerStarted","Data":"3eaf6be9444806d80696d5c64122ce37d8c0cb1d7e3caae08c26f3317d05e227"}
Jul 27 20:54:47.575944 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:47.575913    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg"
Jul 27 20:54:47.679951 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:47.679914    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c223f091-52d2-4623-b93a-409cc11266e7-maas-api-service-ca\") pod \"c223f091-52d2-4623-b93a-409cc11266e7\" (UID: \"c223f091-52d2-4623-b93a-409cc11266e7\") "
Jul 27 20:54:47.680299 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:47.680276    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c223f091-52d2-4623-b93a-409cc11266e7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c223f091-52d2-4623-b93a-409cc11266e7" (UID: "c223f091-52d2-4623-b93a-409cc11266e7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:54:47.781361 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:47.781327    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c223f091-52d2-4623-b93a-409cc11266e7-maas-api-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:54:48.438365 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:48.438337    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg"
Jul 27 20:54:48.438538 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:48.438330    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg" event={"ID":"c223f091-52d2-4623-b93a-409cc11266e7","Type":"ContainerDied","Data":"3eaf6be9444806d80696d5c64122ce37d8c0cb1d7e3caae08c26f3317d05e227"}
Jul 27 20:54:48.438538 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:54:48.438469    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3eaf6be9444806d80696d5c64122ce37d8c0cb1d7e3caae08c26f3317d05e227"
Jul 27 20:55:00.234369 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:00.234332    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg"]
Jul 27 20:55:00.236849 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:00.236826    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-704ca2-smfjg"]
Jul 27 20:55:00.902800 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:00.902732    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c223f091-52d2-4623-b93a-409cc11266e7" path="/var/lib/kubelet/pods/c223f091-52d2-4623-b93a-409cc11266e7/volumes"
Jul 27 20:55:31.432713 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:31.432673    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw"]
Jul 27 20:55:31.433415 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:31.433395    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c223f091-52d2-4623-b93a-409cc11266e7" containerName="revoke-keys"
Jul 27 20:55:31.433506 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:31.433419    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c223f091-52d2-4623-b93a-409cc11266e7" containerName="revoke-keys"
Jul 27 20:55:31.433562 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:31.433527    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c223f091-52d2-4623-b93a-409cc11266e7" containerName="revoke-keys"
Jul 27 20:55:31.436648 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:31.436629    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw"
Jul 27 20:55:31.438893 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:31.438871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 20:55:31.444142 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:31.444116    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw"]
Jul 27 20:55:31.515537 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:31.515498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f86711d-5e31-4943-b46e-5a353f6119d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw\" (UID: \"1f86711d-5e31-4943-b46e-5a353f6119d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw"
Jul 27 20:55:31.616421 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:31.616385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f86711d-5e31-4943-b46e-5a353f6119d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw\" (UID: \"1f86711d-5e31-4943-b46e-5a353f6119d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw"
Jul 27 20:55:31.617118 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:31.617090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f86711d-5e31-4943-b46e-5a353f6119d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw\" (UID: \"1f86711d-5e31-4943-b46e-5a353f6119d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw"
Jul 27 20:55:31.749457 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:31.749373    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw"
Jul 27 20:55:31.923364 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:31.923332    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw"]
Jul 27 20:55:31.925333 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:55:31.925305    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f86711d_5e31_4943_b46e_5a353f6119d2.slice/crio-6224f40d515d2249b378fb7b32ee7865eede5e4526a15d67fca4c66995e5c0b4 WatchSource:0}: Error finding container 6224f40d515d2249b378fb7b32ee7865eede5e4526a15d67fca4c66995e5c0b4: Status 404 returned error can't find the container with id 6224f40d515d2249b378fb7b32ee7865eede5e4526a15d67fca4c66995e5c0b4
Jul 27 20:55:32.712061 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:32.712020    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f86711d-5e31-4943-b46e-5a353f6119d2" containerID="8e96e5b0aaea00875810401677bc537fb4b3a69f861c88a23c3442209afa3aef" exitCode=0
Jul 27 20:55:32.712485 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:32.712101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw" event={"ID":"1f86711d-5e31-4943-b46e-5a353f6119d2","Type":"ContainerDied","Data":"8e96e5b0aaea00875810401677bc537fb4b3a69f861c88a23c3442209afa3aef"}
Jul 27 20:55:32.712485 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:32.712156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw" event={"ID":"1f86711d-5e31-4943-b46e-5a353f6119d2","Type":"ContainerStarted","Data":"6224f40d515d2249b378fb7b32ee7865eede5e4526a15d67fca4c66995e5c0b4"}
Jul 27 20:55:33.860299 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:33.860272    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw"
Jul 27 20:55:33.943139 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:33.943105    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f86711d-5e31-4943-b46e-5a353f6119d2-maas-api-service-ca\") pod \"1f86711d-5e31-4943-b46e-5a353f6119d2\" (UID: \"1f86711d-5e31-4943-b46e-5a353f6119d2\") "
Jul 27 20:55:33.943462 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:33.943440    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f86711d-5e31-4943-b46e-5a353f6119d2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1f86711d-5e31-4943-b46e-5a353f6119d2" (UID: "1f86711d-5e31-4943-b46e-5a353f6119d2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:55:34.044895 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:34.044855    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f86711d-5e31-4943-b46e-5a353f6119d2-maas-api-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:55:34.725403 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:34.725375    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw"
Jul 27 20:55:34.725403 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:34.725397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw" event={"ID":"1f86711d-5e31-4943-b46e-5a353f6119d2","Type":"ContainerDied","Data":"6224f40d515d2249b378fb7b32ee7865eede5e4526a15d67fca4c66995e5c0b4"}
Jul 27 20:55:34.725627 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:34.725442    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6224f40d515d2249b378fb7b32ee7865eede5e4526a15d67fca4c66995e5c0b4"
Jul 27 20:55:51.533545 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:51.533503    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw"]
Jul 27 20:55:51.537147 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:51.537116    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cc8abd-xlscw"]
Jul 27 20:55:52.902999 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:52.902965    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f86711d-5e31-4943-b46e-5a353f6119d2" path="/var/lib/kubelet/pods/1f86711d-5e31-4943-b46e-5a353f6119d2/volumes"
Jul 27 20:55:58.333507 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.333463    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6"]
Jul 27 20:55:58.334162 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.334140    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f86711d-5e31-4943-b46e-5a353f6119d2" containerName="revoke-keys"
Jul 27 20:55:58.334257 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.334165    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f86711d-5e31-4943-b46e-5a353f6119d2" containerName="revoke-keys"
Jul 27 20:55:58.334315 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.334296    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f86711d-5e31-4943-b46e-5a353f6119d2" containerName="revoke-keys"
Jul 27 20:55:58.338589 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.338565    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6"
Jul 27 20:55:58.341121 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.341090    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 20:55:58.344638 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.344603    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6"]
Jul 27 20:55:58.385932 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.385890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc1aa29f-adb2-4bfe-9699-fce9ead16eb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6\" (UID: \"dc1aa29f-adb2-4bfe-9699-fce9ead16eb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6"
Jul 27 20:55:58.486707 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.486666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc1aa29f-adb2-4bfe-9699-fce9ead16eb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6\" (UID: \"dc1aa29f-adb2-4bfe-9699-fce9ead16eb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6"
Jul 27 20:55:58.487356 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.487336    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc1aa29f-adb2-4bfe-9699-fce9ead16eb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6\" (UID: \"dc1aa29f-adb2-4bfe-9699-fce9ead16eb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6"
Jul 27 20:55:58.651825 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.651679    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6"
Jul 27 20:55:58.794515 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.794484    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6"]
Jul 27 20:55:58.795833 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:55:58.795806    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1aa29f_adb2_4bfe_9699_fce9ead16eb2.slice/crio-0386b2f027e20e75dce4520a5b72544244c8c4ec3324fd60b0b484bb7742d806 WatchSource:0}: Error finding container 0386b2f027e20e75dce4520a5b72544244c8c4ec3324fd60b0b484bb7742d806: Status 404 returned error can't find the container with id 0386b2f027e20e75dce4520a5b72544244c8c4ec3324fd60b0b484bb7742d806
Jul 27 20:55:58.874155 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:58.874120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6" event={"ID":"dc1aa29f-adb2-4bfe-9699-fce9ead16eb2","Type":"ContainerStarted","Data":"0386b2f027e20e75dce4520a5b72544244c8c4ec3324fd60b0b484bb7742d806"}
Jul 27 20:55:59.882257 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:59.882223    2580 generic.go:356] "Generic (PLEG): container finished" podID="dc1aa29f-adb2-4bfe-9699-fce9ead16eb2" containerID="cb4b3897ef5eedbe68070d3541b4bfc86d9b2d710e0b93ae01136e6c95527dae" exitCode=0
Jul 27 20:55:59.882638 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:55:59.882313    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6" event={"ID":"dc1aa29f-adb2-4bfe-9699-fce9ead16eb2","Type":"ContainerDied","Data":"cb4b3897ef5eedbe68070d3541b4bfc86d9b2d710e0b93ae01136e6c95527dae"}
Jul 27 20:56:01.030077 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:56:01.030048    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6"
Jul 27 20:56:01.114438 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:56:01.114381    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc1aa29f-adb2-4bfe-9699-fce9ead16eb2-maas-api-service-ca\") pod \"dc1aa29f-adb2-4bfe-9699-fce9ead16eb2\" (UID: \"dc1aa29f-adb2-4bfe-9699-fce9ead16eb2\") "
Jul 27 20:56:01.114803 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:56:01.114781    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc1aa29f-adb2-4bfe-9699-fce9ead16eb2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dc1aa29f-adb2-4bfe-9699-fce9ead16eb2" (UID: "dc1aa29f-adb2-4bfe-9699-fce9ead16eb2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:56:01.216086 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:56:01.215998    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc1aa29f-adb2-4bfe-9699-fce9ead16eb2-maas-api-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 20:56:01.896521 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:56:01.896492    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6"
Jul 27 20:56:01.896731 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:56:01.896540    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6" event={"ID":"dc1aa29f-adb2-4bfe-9699-fce9ead16eb2","Type":"ContainerDied","Data":"0386b2f027e20e75dce4520a5b72544244c8c4ec3324fd60b0b484bb7742d806"}
Jul 27 20:56:01.896731 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:56:01.896580    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0386b2f027e20e75dce4520a5b72544244c8c4ec3324fd60b0b484bb7742d806"
Jul 27 20:56:18.425977 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:56:18.425894    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6"]
Jul 27 20:56:18.429811 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:56:18.429784    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d4c2c3-mlwm6"]
Jul 27 20:56:18.902724 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:56:18.902689    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc1aa29f-adb2-4bfe-9699-fce9ead16eb2" path="/var/lib/kubelet/pods/dc1aa29f-adb2-4bfe-9699-fce9ead16eb2/volumes"
Jul 27 20:57:26.612406 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:26.612289    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:57:26.630941 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:26.630917    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 20:57:26.863901 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:26.863816    2580 scope.go:117] "RemoveContainer" containerID="995a748f20e79f9b620f95f4cf75bdc05d0dd6acce846d1f1a8f82aec615f06a"
Jul 27 20:57:44.289014 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.288968    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"]
Jul 27 20:57:44.289535 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.289495    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc1aa29f-adb2-4bfe-9699-fce9ead16eb2" containerName="revoke-keys"
Jul 27 20:57:44.289633 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.289547    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc1aa29f-adb2-4bfe-9699-fce9ead16eb2" containerName="revoke-keys"
Jul 27 20:57:44.289696 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.289689    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc1aa29f-adb2-4bfe-9699-fce9ead16eb2" containerName="revoke-keys"
Jul 27 20:57:44.293170 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.293151    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.296443 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.296421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-66b603\"/\"kube-root-ca.crt\""
Jul 27 20:57:44.296552 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.296448    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-66b603\"/\"openshift-service-ca.crt\""
Jul 27 20:57:44.296552 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.296421    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-66b603\"/\"auth-test-model-66b603-kserve-self-signed-certs\""
Jul 27 20:57:44.296552 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.296471    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-66b603\"/\"default-dockercfg-zdpkh\""
Jul 27 20:57:44.304018 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.303990    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"]
Jul 27 20:57:44.427496 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.427461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-tmp-dir\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.427660 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.427521    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-tls-certs\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.427728 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.427698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7hf5\" (UniqueName: \"kubernetes.io/projected/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-kube-api-access-w7hf5\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.427793 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.427761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-home\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.427831 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.427800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-dshm\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.427831 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.427824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-model-cache\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.529129 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.529093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-tls-certs\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.529301 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.529164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hf5\" (UniqueName: \"kubernetes.io/projected/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-kube-api-access-w7hf5\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.529301 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.529193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-home\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.529301 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.529215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-dshm\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.529301 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.529238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-model-cache\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.529496 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.529313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-tmp-dir\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.529670 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.529648    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-model-cache\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.529777 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.529682    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-home\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.529830 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.529806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-tmp-dir\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.531508 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.531492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-dshm\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.531573 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.531542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-tls-certs\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.536864 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.536843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7hf5\" (UniqueName: \"kubernetes.io/projected/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-kube-api-access-w7hf5\") pod \"auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") " pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.604548 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.604450    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:44.753734 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:44.753707    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"]
Jul 27 20:57:44.755994 ip-10-0-139-20 kubenswrapper[2580]: W0727 20:57:44.755961    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod925cfa4c_ffd1_4501_b687_8c8ecd5c58d9.slice/crio-9e6666a2bf557ca797da6a99463075b003aba3f9543710b43a424422b71a024c WatchSource:0}: Error finding container 9e6666a2bf557ca797da6a99463075b003aba3f9543710b43a424422b71a024c: Status 404 returned error can't find the container with id 9e6666a2bf557ca797da6a99463075b003aba3f9543710b43a424422b71a024c
Jul 27 20:57:45.563586 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:45.563538    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd" event={"ID":"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9","Type":"ContainerStarted","Data":"24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2"}
Jul 27 20:57:45.564000 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:45.563597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd" event={"ID":"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9","Type":"ContainerStarted","Data":"9e6666a2bf557ca797da6a99463075b003aba3f9543710b43a424422b71a024c"}
Jul 27 20:57:45.581168 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:45.581120    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd" podStartSLOduration=1.581105778 podStartE2EDuration="1.581105778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:45.579891363 +0000 UTC m=+2421.236046705" watchObservedRunningTime="2026-07-27 20:57:45.581105778 +0000 UTC m=+2421.237261120"
Jul 27 20:57:54.605313 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:54.605219    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:54.605313 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:54.605279    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:54.618242 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:54.618213    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 20:57:54.636027 ip-10-0-139-20 kubenswrapper[2580]: I0727 20:57:54.635997    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 21:00:00.137789 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:00.137724    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s"]
Jul 27 21:00:00.141859 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:00.141830    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx"]
Jul 27 21:00:00.142016 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:00.141951    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s"
Jul 27 21:00:00.144088 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:00.144068    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 21:00:00.145570 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:00.145550    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx"
Jul 27 21:00:00.154430 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:00.154407    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s"]
Jul 27 21:00:00.158358 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:00.158332    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s"
Jul 27 21:00:00.161504 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:00.161483    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx"]
Jul 27 21:00:00.163986 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:00.163967    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx"
Jul 27 21:00:00.523939 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:00.523909    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s"]
Jul 27 21:00:00.525349 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:00:00.525320    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebed2e0_c8dc_4b33_bec2_022b14152159.slice/crio-2f7550786aa2b32e656e8cec3e88da5267a1134f62633170c089fb0ebd285801 WatchSource:0}: Error finding container 2f7550786aa2b32e656e8cec3e88da5267a1134f62633170c089fb0ebd285801: Status 404 returned error can't find the container with id 2f7550786aa2b32e656e8cec3e88da5267a1134f62633170c089fb0ebd285801
Jul 27 21:00:00.548300 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:00.548274    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx"]
Jul 27 21:00:00.550196 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:00:00.550170    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113b6e71_38a9_4a26_b8e4_f0b197bcc1c1.slice/crio-abda2ad1437044ad5a6a7d5a6bd1b9a332c3573a5a3d265196e622cea2e041f8 WatchSource:0}: Error finding container abda2ad1437044ad5a6a7d5a6bd1b9a332c3573a5a3d265196e622cea2e041f8: Status 404 returned error can't find the container with id abda2ad1437044ad5a6a7d5a6bd1b9a332c3573a5a3d265196e622cea2e041f8
Jul 27 21:00:01.427796 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:01.427719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx" event={"ID":"113b6e71-38a9-4a26-b8e4-f0b197bcc1c1","Type":"ContainerStarted","Data":"e7bdb111ac3a97513df9ff03c7aaeaa77bdddb8659a8a9ea5db3eaada820580b"}
Jul 27 21:00:01.428253 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:01.427819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx" event={"ID":"113b6e71-38a9-4a26-b8e4-f0b197bcc1c1","Type":"ContainerStarted","Data":"abda2ad1437044ad5a6a7d5a6bd1b9a332c3573a5a3d265196e622cea2e041f8"}
Jul 27 21:00:01.429415 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:01.429390    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s" event={"ID":"3ebed2e0-c8dc-4b33-bec2-022b14152159","Type":"ContainerStarted","Data":"9ff6bf1f29e86fbafd165ed407475e2811e39116603d68d60733437ad27f397a"}
Jul 27 21:00:01.429539 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:01.429440    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s" event={"ID":"3ebed2e0-c8dc-4b33-bec2-022b14152159","Type":"ContainerStarted","Data":"2f7550786aa2b32e656e8cec3e88da5267a1134f62633170c089fb0ebd285801"}
Jul 27 21:00:01.444976 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:01.444923    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx" podStartSLOduration=1.444907028 podStartE2EDuration="1.444907028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:01.442678998 +0000 UTC m=+2557.098834370" watchObservedRunningTime="2026-07-27 21:00:01.444907028 +0000 UTC m=+2557.101062370"
Jul 27 21:00:01.460330 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:01.460276    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s" podStartSLOduration=1.46026122 podStartE2EDuration="1.46026122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:01.457675669 +0000 UTC m=+2557.113831013" watchObservedRunningTime="2026-07-27 21:00:01.46026122 +0000 UTC m=+2557.116416562"
Jul 27 21:00:02.436870 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:02.436835    2580 generic.go:356] "Generic (PLEG): container finished" podID="113b6e71-38a9-4a26-b8e4-f0b197bcc1c1" containerID="e7bdb111ac3a97513df9ff03c7aaeaa77bdddb8659a8a9ea5db3eaada820580b" exitCode=0
Jul 27 21:00:02.437309 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:02.436925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx" event={"ID":"113b6e71-38a9-4a26-b8e4-f0b197bcc1c1","Type":"ContainerDied","Data":"e7bdb111ac3a97513df9ff03c7aaeaa77bdddb8659a8a9ea5db3eaada820580b"}
Jul 27 21:00:02.438479 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:02.438456    2580 generic.go:356] "Generic (PLEG): container finished" podID="3ebed2e0-c8dc-4b33-bec2-022b14152159" containerID="9ff6bf1f29e86fbafd165ed407475e2811e39116603d68d60733437ad27f397a" exitCode=0
Jul 27 21:00:02.438566 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:02.438537    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s" event={"ID":"3ebed2e0-c8dc-4b33-bec2-022b14152159","Type":"ContainerDied","Data":"9ff6bf1f29e86fbafd165ed407475e2811e39116603d68d60733437ad27f397a"}
Jul 27 21:00:03.603769 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:03.603715    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s"
Jul 27 21:00:03.631268 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:03.631241    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx"
Jul 27 21:00:04.453142 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:04.453102    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx"
Jul 27 21:00:04.453314 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:04.453103    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx" event={"ID":"113b6e71-38a9-4a26-b8e4-f0b197bcc1c1","Type":"ContainerDied","Data":"abda2ad1437044ad5a6a7d5a6bd1b9a332c3573a5a3d265196e622cea2e041f8"}
Jul 27 21:00:04.453314 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:04.453239    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="abda2ad1437044ad5a6a7d5a6bd1b9a332c3573a5a3d265196e622cea2e041f8"
Jul 27 21:00:04.454601 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:04.454572    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s"
Jul 27 21:00:04.454717 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:04.454601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s" event={"ID":"3ebed2e0-c8dc-4b33-bec2-022b14152159","Type":"ContainerDied","Data":"2f7550786aa2b32e656e8cec3e88da5267a1134f62633170c089fb0ebd285801"}
Jul 27 21:00:04.454717 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:04.454640    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f7550786aa2b32e656e8cec3e88da5267a1134f62633170c089fb0ebd285801"
Jul 27 21:00:26.908241 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:00:26.908207    2580 scope.go:117] "RemoveContainer" containerID="2ebf5ca70576cfc3c3f0f060eae95fd4dccb9b9284e572ac0fe7b095e4000e71"
Jul 27 21:01:26.931588 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:01:26.931509    2580 scope.go:117] "RemoveContainer" containerID="442fbc93c8227e16d854f9d916215e3148a25daf5734fb55c5503df57e8fab30"
Jul 27 21:02:09.266084 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:09.266044    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"]
Jul 27 21:02:24.285566 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.285515    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd" podUID="925cfa4c-ffd1-4501-b687-8c8ecd5c58d9" containerName="main" containerID="cri-o://24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2" gracePeriod=45
Jul 27 21:02:24.552992 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.552923    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 21:02:24.637001 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.636964    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-tls-certs\") pod \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") "
Jul 27 21:02:24.637177 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.637012    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-model-cache\") pod \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") "
Jul 27 21:02:24.637177 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.637039    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7hf5\" (UniqueName: \"kubernetes.io/projected/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-kube-api-access-w7hf5\") pod \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") "
Jul 27 21:02:24.637177 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.637057    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-dshm\") pod \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") "
Jul 27 21:02:24.637177 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.637074    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-tmp-dir\") pod \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") "
Jul 27 21:02:24.637383 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.637189    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-home\") pod \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\" (UID: \"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9\") "
Jul 27 21:02:24.637383 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.637313    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-model-cache" (OuterVolumeSpecName: "model-cache") pod "925cfa4c-ffd1-4501-b687-8c8ecd5c58d9" (UID: "925cfa4c-ffd1-4501-b687-8c8ecd5c58d9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:02:24.637497 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.637412    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "925cfa4c-ffd1-4501-b687-8c8ecd5c58d9" (UID: "925cfa4c-ffd1-4501-b687-8c8ecd5c58d9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:02:24.637554 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.637511    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-home" (OuterVolumeSpecName: "home") pod "925cfa4c-ffd1-4501-b687-8c8ecd5c58d9" (UID: "925cfa4c-ffd1-4501-b687-8c8ecd5c58d9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:02:24.637608 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.637596    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-home\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:02:24.637662 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.637615    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-model-cache\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:02:24.637662 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.637656    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-tmp-dir\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:02:24.639400 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.639374    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-dshm" (OuterVolumeSpecName: "dshm") pod "925cfa4c-ffd1-4501-b687-8c8ecd5c58d9" (UID: "925cfa4c-ffd1-4501-b687-8c8ecd5c58d9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:02:24.639506 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.639404    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-kube-api-access-w7hf5" (OuterVolumeSpecName: "kube-api-access-w7hf5") pod "925cfa4c-ffd1-4501-b687-8c8ecd5c58d9" (UID: "925cfa4c-ffd1-4501-b687-8c8ecd5c58d9"). InnerVolumeSpecName "kube-api-access-w7hf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:02:24.639506 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.639426    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "925cfa4c-ffd1-4501-b687-8c8ecd5c58d9" (UID: "925cfa4c-ffd1-4501-b687-8c8ecd5c58d9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:02:24.739030 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.738996    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-tls-certs\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:02:24.739030 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.739029    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7hf5\" (UniqueName: \"kubernetes.io/projected/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-kube-api-access-w7hf5\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:02:24.739224 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:24.739042    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9-dshm\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:02:25.332732 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:25.332693    2580 generic.go:356] "Generic (PLEG): container finished" podID="925cfa4c-ffd1-4501-b687-8c8ecd5c58d9" containerID="24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2" exitCode=0
Jul 27 21:02:25.332732 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:25.332737    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"
Jul 27 21:02:25.333236 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:25.332777    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd" event={"ID":"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9","Type":"ContainerDied","Data":"24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2"}
Jul 27 21:02:25.333236 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:25.332826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd" event={"ID":"925cfa4c-ffd1-4501-b687-8c8ecd5c58d9","Type":"ContainerDied","Data":"9e6666a2bf557ca797da6a99463075b003aba3f9543710b43a424422b71a024c"}
Jul 27 21:02:25.333236 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:25.332850    2580 scope.go:117] "RemoveContainer" containerID="24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2"
Jul 27 21:02:25.342882 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:25.342855    2580 scope.go:117] "RemoveContainer" containerID="24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2"
Jul 27 21:02:25.343204 ip-10-0-139-20 kubenswrapper[2580]: E0727 21:02:25.343181    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2\": container with ID starting with 24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2 not found: ID does not exist" containerID="24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2"
Jul 27 21:02:25.343285 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:25.343214    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2"} err="failed to get container status \"24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2\": rpc error: code = NotFound desc = could not find container \"24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2\": container with ID starting with 24b78b6c10bb8193807634b1261e608ab2dc73da4b8329657d395747c8669fd2 not found: ID does not exist"
Jul 27 21:02:25.351658 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:25.351627    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"]
Jul 27 21:02:25.359290 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:25.359258    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-66b603/auth-test-model-66b603-kserve-b9d9dcf5f-bzmnd"]
Jul 27 21:02:26.663452 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:26.663347    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 21:02:26.678093 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:26.677510    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 21:02:26.902862 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:26.902829    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="925cfa4c-ffd1-4501-b687-8c8ecd5c58d9" path="/var/lib/kubelet/pods/925cfa4c-ffd1-4501-b687-8c8ecd5c58d9/volumes"
Jul 27 21:02:26.953772 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:26.953671    2580 scope.go:117] "RemoveContainer" containerID="cb4b3897ef5eedbe68070d3541b4bfc86d9b2d710e0b93ae01136e6c95527dae"
Jul 27 21:02:26.962971 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:26.962952    2580 scope.go:117] "RemoveContainer" containerID="8e96e5b0aaea00875810401677bc537fb4b3a69f861c88a23c3442209afa3aef"
Jul 27 21:02:48.122879 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.122838    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"]
Jul 27 21:02:48.123498 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.123478    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="113b6e71-38a9-4a26-b8e4-f0b197bcc1c1" containerName="cleanup"
Jul 27 21:02:48.123554 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.123503    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="113b6e71-38a9-4a26-b8e4-f0b197bcc1c1" containerName="cleanup"
Jul 27 21:02:48.123554 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.123526    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="925cfa4c-ffd1-4501-b687-8c8ecd5c58d9" containerName="main"
Jul 27 21:02:48.123554 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.123532    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="925cfa4c-ffd1-4501-b687-8c8ecd5c58d9" containerName="main"
Jul 27 21:02:48.123554 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.123540    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ebed2e0-c8dc-4b33-bec2-022b14152159" containerName="cleanup"
Jul 27 21:02:48.123554 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.123546    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ebed2e0-c8dc-4b33-bec2-022b14152159" containerName="cleanup"
Jul 27 21:02:48.123729 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.123640    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="925cfa4c-ffd1-4501-b687-8c8ecd5c58d9" containerName="main"
Jul 27 21:02:48.123729 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.123650    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ebed2e0-c8dc-4b33-bec2-022b14152159" containerName="cleanup"
Jul 27 21:02:48.123729 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.123657    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="113b6e71-38a9-4a26-b8e4-f0b197bcc1c1" containerName="cleanup"
Jul 27 21:02:48.126951 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.126935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.130494 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.130464    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-66b603\"/\"openshift-service-ca.crt\""
Jul 27 21:02:48.130621 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.130508    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-66b603\"/\"sub-test-model-66b603-kserve-self-signed-certs\""
Jul 27 21:02:48.130621 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.130528    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-66b603\"/\"kube-root-ca.crt\""
Jul 27 21:02:48.130806 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.130614    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-66b603\"/\"default-dockercfg-zdpkh\""
Jul 27 21:02:48.138113 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.138085    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"]
Jul 27 21:02:48.278913 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.278876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-tmp-dir\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.278913 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.278917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46dhn\" (UniqueName: \"kubernetes.io/projected/2d7d2822-ae4f-41ff-a649-856825226831-kube-api-access-46dhn\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.279128 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.279024    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d7d2822-ae4f-41ff-a649-856825226831-tls-certs\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.279128 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.279061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-model-cache\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.279197 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.279166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-home\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.279197 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.279186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-dshm\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.380057 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.379953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-home\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.380057 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.380007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-dshm\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.380057 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.380040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-tmp-dir\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.380057 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.380059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46dhn\" (UniqueName: \"kubernetes.io/projected/2d7d2822-ae4f-41ff-a649-856825226831-kube-api-access-46dhn\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.380341 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.380111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d7d2822-ae4f-41ff-a649-856825226831-tls-certs\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.380341 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.380141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-model-cache\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.380481 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.380452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-home\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.380535 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.380461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-tmp-dir\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.380574 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.380547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-model-cache\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.382441 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.382422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-dshm\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.382706 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.382689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d7d2822-ae4f-41ff-a649-856825226831-tls-certs\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.390426 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.390399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46dhn\" (UniqueName: \"kubernetes.io/projected/2d7d2822-ae4f-41ff-a649-856825226831-kube-api-access-46dhn\") pod \"sub-test-model-66b603-kserve-5c69f8b44f-kmg7t\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") " pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.436194 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.436154    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:48.591109 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:48.591080    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"]
Jul 27 21:02:48.592199 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:02:48.592162    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d7d2822_ae4f_41ff_a649_856825226831.slice/crio-48316dca61a420fd8f886925ea36d7fa57cc65b4dd2a1f2c6fe1a60952fe0405 WatchSource:0}: Error finding container 48316dca61a420fd8f886925ea36d7fa57cc65b4dd2a1f2c6fe1a60952fe0405: Status 404 returned error can't find the container with id 48316dca61a420fd8f886925ea36d7fa57cc65b4dd2a1f2c6fe1a60952fe0405
Jul 27 21:02:49.480684 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:49.480646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t" event={"ID":"2d7d2822-ae4f-41ff-a649-856825226831","Type":"ContainerStarted","Data":"1c99ea4ffbd61c3fda5d7b54855468af8ade19885056f8d82e63d89da52859cc"}
Jul 27 21:02:49.481106 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:49.480694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t" event={"ID":"2d7d2822-ae4f-41ff-a649-856825226831","Type":"ContainerStarted","Data":"48316dca61a420fd8f886925ea36d7fa57cc65b4dd2a1f2c6fe1a60952fe0405"}
Jul 27 21:02:49.501501 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:49.501448    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t" podStartSLOduration=1.501429597 podStartE2EDuration="1.501429597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:49.499230629 +0000 UTC m=+2725.155385973" watchObservedRunningTime="2026-07-27 21:02:49.501429597 +0000 UTC m=+2725.157584958"
Jul 27 21:02:58.437072 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:58.437034    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:58.437548 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:58.437086    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:58.449709 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:58.449681    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:02:58.553872 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:02:58.553841    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:03:49.697394 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:03:49.697311    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"]
Jul 27 21:04:01.322871 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.322831    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"]
Jul 27 21:04:01.326965 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.326942    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.330373 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.330344    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-132aad\"/\"rate-test-model-132aad-kserve-self-signed-certs\""
Jul 27 21:04:01.330373 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.330368    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-132aad\"/\"openshift-service-ca.crt\""
Jul 27 21:04:01.330551 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.330378    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-132aad\"/\"default-dockercfg-rvfc5\""
Jul 27 21:04:01.330551 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.330368    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-132aad\"/\"kube-root-ca.crt\""
Jul 27 21:04:01.335297 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.335264    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"]
Jul 27 21:04:01.387481 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.387440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-model-cache\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.387654 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.387508    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdgtw\" (UniqueName: \"kubernetes.io/projected/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-kube-api-access-fdgtw\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.387654 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.387576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-home\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.387654 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.387606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-tmp-dir\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.387654 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.387646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-dshm\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.387831 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.387661    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-tls-certs\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.488710 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.488677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-model-cache\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.488926 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.488742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdgtw\" (UniqueName: \"kubernetes.io/projected/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-kube-api-access-fdgtw\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.488926 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.488837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-home\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.488926 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.488868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-tmp-dir\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.488926 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.488918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-dshm\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.489128 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.488941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-tls-certs\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.489223 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.489200    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-model-cache\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.489267 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.489251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-home\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.489304 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.489261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-tmp-dir\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.491256 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.491232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-dshm\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.491517 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.491501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-tls-certs\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.496931 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.496909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdgtw\" (UniqueName: \"kubernetes.io/projected/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-kube-api-access-fdgtw\") pod \"rate-test-model-132aad-kserve-774d8dcbd7-w4g2h\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") " pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.638234 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.638135    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:01.790119 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.790086    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"]
Jul 27 21:04:01.791643 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:04:01.791614    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a6f2aa0_25d9_4294_a22f_5dc5b4e60c9b.slice/crio-5d21388891f2e09c4002751749f97f609545334da0b254b75f499bb248c56e89 WatchSource:0}: Error finding container 5d21388891f2e09c4002751749f97f609545334da0b254b75f499bb248c56e89: Status 404 returned error can't find the container with id 5d21388891f2e09c4002751749f97f609545334da0b254b75f499bb248c56e89
Jul 27 21:04:01.945036 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.944928    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h" event={"ID":"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b","Type":"ContainerStarted","Data":"e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da"}
Jul 27 21:04:01.945036 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.944983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h" event={"ID":"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b","Type":"ContainerStarted","Data":"5d21388891f2e09c4002751749f97f609545334da0b254b75f499bb248c56e89"}
Jul 27 21:04:01.967289 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:01.967233    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h" podStartSLOduration=0.967216599 podStartE2EDuration="967.216599ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:01.966828318 +0000 UTC m=+2797.622983663" watchObservedRunningTime="2026-07-27 21:04:01.967216599 +0000 UTC m=+2797.623371942"
Jul 27 21:04:04.717622 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:04.717580    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t" podUID="2d7d2822-ae4f-41ff-a649-856825226831" containerName="main" containerID="cri-o://1c99ea4ffbd61c3fda5d7b54855468af8ade19885056f8d82e63d89da52859cc" gracePeriod=45
Jul 27 21:04:04.965010 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:04.964978    2580 generic.go:356] "Generic (PLEG): container finished" podID="2d7d2822-ae4f-41ff-a649-856825226831" containerID="1c99ea4ffbd61c3fda5d7b54855468af8ade19885056f8d82e63d89da52859cc" exitCode=0
Jul 27 21:04:04.965175 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:04.965048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t" event={"ID":"2d7d2822-ae4f-41ff-a649-856825226831","Type":"ContainerDied","Data":"1c99ea4ffbd61c3fda5d7b54855468af8ade19885056f8d82e63d89da52859cc"}
Jul 27 21:04:04.983543 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:04.983474    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:04:05.129405 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.129352    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-model-cache\") pod \"2d7d2822-ae4f-41ff-a649-856825226831\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") "
Jul 27 21:04:05.129593 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.129428    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-tmp-dir\") pod \"2d7d2822-ae4f-41ff-a649-856825226831\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") "
Jul 27 21:04:05.129593 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.129469    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-home\") pod \"2d7d2822-ae4f-41ff-a649-856825226831\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") "
Jul 27 21:04:05.129593 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.129495    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d7d2822-ae4f-41ff-a649-856825226831-tls-certs\") pod \"2d7d2822-ae4f-41ff-a649-856825226831\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") "
Jul 27 21:04:05.129593 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.129540    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-dshm\") pod \"2d7d2822-ae4f-41ff-a649-856825226831\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") "
Jul 27 21:04:05.129857 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.129598    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46dhn\" (UniqueName: \"kubernetes.io/projected/2d7d2822-ae4f-41ff-a649-856825226831-kube-api-access-46dhn\") pod \"2d7d2822-ae4f-41ff-a649-856825226831\" (UID: \"2d7d2822-ae4f-41ff-a649-856825226831\") "
Jul 27 21:04:05.129857 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.129682    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-model-cache" (OuterVolumeSpecName: "model-cache") pod "2d7d2822-ae4f-41ff-a649-856825226831" (UID: "2d7d2822-ae4f-41ff-a649-856825226831"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:05.129857 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.129760    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2d7d2822-ae4f-41ff-a649-856825226831" (UID: "2d7d2822-ae4f-41ff-a649-856825226831"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:05.129857 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.129805    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-home" (OuterVolumeSpecName: "home") pod "2d7d2822-ae4f-41ff-a649-856825226831" (UID: "2d7d2822-ae4f-41ff-a649-856825226831"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:05.130090 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.130042    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-model-cache\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:04:05.130090 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.130060    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-tmp-dir\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:04:05.130090 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.130068    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-home\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:04:05.131845 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.131821    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7d2822-ae4f-41ff-a649-856825226831-kube-api-access-46dhn" (OuterVolumeSpecName: "kube-api-access-46dhn") pod "2d7d2822-ae4f-41ff-a649-856825226831" (UID: "2d7d2822-ae4f-41ff-a649-856825226831"). InnerVolumeSpecName "kube-api-access-46dhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:04:05.131929 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.131824    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-dshm" (OuterVolumeSpecName: "dshm") pod "2d7d2822-ae4f-41ff-a649-856825226831" (UID: "2d7d2822-ae4f-41ff-a649-856825226831"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:05.131929 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.131886    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d7d2822-ae4f-41ff-a649-856825226831-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2d7d2822-ae4f-41ff-a649-856825226831" (UID: "2d7d2822-ae4f-41ff-a649-856825226831"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:04:05.231300 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.231261    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46dhn\" (UniqueName: \"kubernetes.io/projected/2d7d2822-ae4f-41ff-a649-856825226831-kube-api-access-46dhn\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:04:05.231300 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.231294    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d7d2822-ae4f-41ff-a649-856825226831-tls-certs\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:04:05.231300 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.231305    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d7d2822-ae4f-41ff-a649-856825226831-dshm\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:04:05.973185 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.973143    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t" event={"ID":"2d7d2822-ae4f-41ff-a649-856825226831","Type":"ContainerDied","Data":"48316dca61a420fd8f886925ea36d7fa57cc65b4dd2a1f2c6fe1a60952fe0405"}
Jul 27 21:04:05.973185 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.973165    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"
Jul 27 21:04:05.973185 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.973195    2580 scope.go:117] "RemoveContainer" containerID="1c99ea4ffbd61c3fda5d7b54855468af8ade19885056f8d82e63d89da52859cc"
Jul 27 21:04:05.996197 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.996162    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"]
Jul 27 21:04:05.998705 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:05.998684    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-66b603/sub-test-model-66b603-kserve-5c69f8b44f-kmg7t"]
Jul 27 21:04:06.903400 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:06.903368    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d7d2822-ae4f-41ff-a649-856825226831" path="/var/lib/kubelet/pods/2d7d2822-ae4f-41ff-a649-856825226831/volumes"
Jul 27 21:04:11.639025 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:11.638983    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:11.639025 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:11.639031    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:11.651860 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:11.651827    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:04:12.022580 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:04:12.022493    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:05:42.841016 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:42.840975    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"]
Jul 27 21:05:44.700573 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:44.700542    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7612-140101039084848"]
Jul 27 21:05:44.701040 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:44.701025    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7d2822-ae4f-41ff-a649-856825226831" containerName="main"
Jul 27 21:05:44.701040 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:44.701042    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7d2822-ae4f-41ff-a649-856825226831" containerName="main"
Jul 27 21:05:44.701128 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:44.701107    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7d2822-ae4f-41ff-a649-856825226831" containerName="main"
Jul 27 21:05:44.704739 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:44.704676    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039084848"
Jul 27 21:05:44.707098 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:44.707071    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hmb6d\""
Jul 27 21:05:44.711416 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:44.711388    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7612-140101039084848"]
Jul 27 21:05:44.810768 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:44.810713    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8xmf\" (UniqueName: \"kubernetes.io/projected/87fa6c6d-edfe-4728-8382-def57c80a6b9-kube-api-access-j8xmf\") pod \"test-curl-7612-140101039084848\" (UID: \"87fa6c6d-edfe-4728-8382-def57c80a6b9\") " pod="opendatahub/test-curl-7612-140101039084848"
Jul 27 21:05:44.911503 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:44.911467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8xmf\" (UniqueName: \"kubernetes.io/projected/87fa6c6d-edfe-4728-8382-def57c80a6b9-kube-api-access-j8xmf\") pod \"test-curl-7612-140101039084848\" (UID: \"87fa6c6d-edfe-4728-8382-def57c80a6b9\") " pod="opendatahub/test-curl-7612-140101039084848"
Jul 27 21:05:44.919171 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:44.919143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8xmf\" (UniqueName: \"kubernetes.io/projected/87fa6c6d-edfe-4728-8382-def57c80a6b9-kube-api-access-j8xmf\") pod \"test-curl-7612-140101039084848\" (UID: \"87fa6c6d-edfe-4728-8382-def57c80a6b9\") " pod="opendatahub/test-curl-7612-140101039084848"
Jul 27 21:05:45.018185 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:45.018080    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039084848"
Jul 27 21:05:45.158995 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:45.158968    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7612-140101039084848"]
Jul 27 21:05:45.161888 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:05:45.161862    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87fa6c6d_edfe_4728_8382_def57c80a6b9.slice/crio-ff642186172a29f20ca99092625d2af680a07ecde0fdf6bccea6b8567c05862e WatchSource:0}: Error finding container ff642186172a29f20ca99092625d2af680a07ecde0fdf6bccea6b8567c05862e: Status 404 returned error can't find the container with id ff642186172a29f20ca99092625d2af680a07ecde0fdf6bccea6b8567c05862e
Jul 27 21:05:45.163550 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:45.163532    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:05:45.614315 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:45.614279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7612-140101039084848" event={"ID":"87fa6c6d-edfe-4728-8382-def57c80a6b9","Type":"ContainerStarted","Data":"ff642186172a29f20ca99092625d2af680a07ecde0fdf6bccea6b8567c05862e"}
Jul 27 21:05:46.622129 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:46.622089    2580 generic.go:356] "Generic (PLEG): container finished" podID="87fa6c6d-edfe-4728-8382-def57c80a6b9" containerID="767de879a675f30bd8cb8dbd1df81346ad6e339bf1b9214073307d34cb49d5f6" exitCode=0
Jul 27 21:05:46.622520 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:46.622139    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7612-140101039084848" event={"ID":"87fa6c6d-edfe-4728-8382-def57c80a6b9","Type":"ContainerDied","Data":"767de879a675f30bd8cb8dbd1df81346ad6e339bf1b9214073307d34cb49d5f6"}
Jul 27 21:05:47.776533 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.776506    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039084848"
Jul 27 21:05:47.809352 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.809324    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7612-140101039084848_87fa6c6d-edfe-4728-8382-def57c80a6b9/test-curl-7612-140101039084848/0.log"
Jul 27 21:05:47.833670 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.833640    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7612-140101039084848"]
Jul 27 21:05:47.837699 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.837675    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7612-140101039084848"]
Jul 27 21:05:47.840890 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.840858    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8xmf\" (UniqueName: \"kubernetes.io/projected/87fa6c6d-edfe-4728-8382-def57c80a6b9-kube-api-access-j8xmf\") pod \"87fa6c6d-edfe-4728-8382-def57c80a6b9\" (UID: \"87fa6c6d-edfe-4728-8382-def57c80a6b9\") "
Jul 27 21:05:47.842938 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.842913    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87fa6c6d-edfe-4728-8382-def57c80a6b9-kube-api-access-j8xmf" (OuterVolumeSpecName: "kube-api-access-j8xmf") pod "87fa6c6d-edfe-4728-8382-def57c80a6b9" (UID: "87fa6c6d-edfe-4728-8382-def57c80a6b9"). InnerVolumeSpecName "kube-api-access-j8xmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:05:47.941963 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.941863    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8xmf\" (UniqueName: \"kubernetes.io/projected/87fa6c6d-edfe-4728-8382-def57c80a6b9-kube-api-access-j8xmf\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:05:47.949697 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.949664    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7612-140101038916144"]
Jul 27 21:05:47.950140 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.950126    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87fa6c6d-edfe-4728-8382-def57c80a6b9" containerName="test-curl-7612-140101039084848"
Jul 27 21:05:47.950184 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.950143    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="87fa6c6d-edfe-4728-8382-def57c80a6b9" containerName="test-curl-7612-140101039084848"
Jul 27 21:05:47.950228 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.950219    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="87fa6c6d-edfe-4728-8382-def57c80a6b9" containerName="test-curl-7612-140101039084848"
Jul 27 21:05:47.953300 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.953284    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101038916144"
Jul 27 21:05:47.957266 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:47.957238    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7612-140101038916144"]
Jul 27 21:05:48.042926 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:48.042888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58f78\" (UniqueName: \"kubernetes.io/projected/986fef72-a762-47b6-835f-9aebe4b839e4-kube-api-access-58f78\") pod \"test-curl-7612-140101038916144\" (UID: \"986fef72-a762-47b6-835f-9aebe4b839e4\") " pod="opendatahub/test-curl-7612-140101038916144"
Jul 27 21:05:48.144092 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:48.144058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58f78\" (UniqueName: \"kubernetes.io/projected/986fef72-a762-47b6-835f-9aebe4b839e4-kube-api-access-58f78\") pod \"test-curl-7612-140101038916144\" (UID: \"986fef72-a762-47b6-835f-9aebe4b839e4\") " pod="opendatahub/test-curl-7612-140101038916144"
Jul 27 21:05:48.152340 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:48.152306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58f78\" (UniqueName: \"kubernetes.io/projected/986fef72-a762-47b6-835f-9aebe4b839e4-kube-api-access-58f78\") pod \"test-curl-7612-140101038916144\" (UID: \"986fef72-a762-47b6-835f-9aebe4b839e4\") " pod="opendatahub/test-curl-7612-140101038916144"
Jul 27 21:05:48.263901 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:48.263811    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101038916144"
Jul 27 21:05:48.403690 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:48.403661    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7612-140101038916144"]
Jul 27 21:05:48.404553 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:05:48.404530    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod986fef72_a762_47b6_835f_9aebe4b839e4.slice/crio-f171f13915c3682ac7a8683ec5aaf0e0d905d046d7493edec29417e46fb5f9df WatchSource:0}: Error finding container f171f13915c3682ac7a8683ec5aaf0e0d905d046d7493edec29417e46fb5f9df: Status 404 returned error can't find the container with id f171f13915c3682ac7a8683ec5aaf0e0d905d046d7493edec29417e46fb5f9df
Jul 27 21:05:48.635282 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:48.635240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7612-140101038916144" event={"ID":"986fef72-a762-47b6-835f-9aebe4b839e4","Type":"ContainerStarted","Data":"f171f13915c3682ac7a8683ec5aaf0e0d905d046d7493edec29417e46fb5f9df"}
Jul 27 21:05:48.636582 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:48.636562    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff642186172a29f20ca99092625d2af680a07ecde0fdf6bccea6b8567c05862e"
Jul 27 21:05:48.636582 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:48.636580    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039084848"
Jul 27 21:05:48.647342 ip-10-0-139-20 kubenswrapper[2580]: E0727 21:05:48.647314    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7612-140101039084848\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="87fa6c6d-edfe-4728-8382-def57c80a6b9" pod="opendatahub/test-curl-7612-140101039084848"
Jul 27 21:05:48.903061 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:48.902967    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87fa6c6d-edfe-4728-8382-def57c80a6b9" path="/var/lib/kubelet/pods/87fa6c6d-edfe-4728-8382-def57c80a6b9/volumes"
Jul 27 21:05:49.643582 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:49.643548    2580 generic.go:356] "Generic (PLEG): container finished" podID="986fef72-a762-47b6-835f-9aebe4b839e4" containerID="82a28ff4cbfa12075f3d1b7e8e6a474a63c17dbd5eb63234a9d86380974654ab" exitCode=0
Jul 27 21:05:49.643794 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:49.643607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7612-140101038916144" event={"ID":"986fef72-a762-47b6-835f-9aebe4b839e4","Type":"ContainerDied","Data":"82a28ff4cbfa12075f3d1b7e8e6a474a63c17dbd5eb63234a9d86380974654ab"}
Jul 27 21:05:50.805555 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:50.805526    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101038916144"
Jul 27 21:05:50.824384 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:50.824348    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7612-140101038916144_986fef72-a762-47b6-835f-9aebe4b839e4/test-curl-7612-140101038916144/0.log"
Jul 27 21:05:50.847177 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:50.847147    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7612-140101038916144"]
Jul 27 21:05:50.851338 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:50.851312    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7612-140101038916144"]
Jul 27 21:05:50.872927 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:50.872904    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58f78\" (UniqueName: \"kubernetes.io/projected/986fef72-a762-47b6-835f-9aebe4b839e4-kube-api-access-58f78\") pod \"986fef72-a762-47b6-835f-9aebe4b839e4\" (UID: \"986fef72-a762-47b6-835f-9aebe4b839e4\") "
Jul 27 21:05:50.874980 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:50.874958    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/986fef72-a762-47b6-835f-9aebe4b839e4-kube-api-access-58f78" (OuterVolumeSpecName: "kube-api-access-58f78") pod "986fef72-a762-47b6-835f-9aebe4b839e4" (UID: "986fef72-a762-47b6-835f-9aebe4b839e4"). InnerVolumeSpecName "kube-api-access-58f78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:05:50.906365 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:50.906298    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="986fef72-a762-47b6-835f-9aebe4b839e4" path="/var/lib/kubelet/pods/986fef72-a762-47b6-835f-9aebe4b839e4/volumes"
Jul 27 21:05:50.974149 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:50.974109    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58f78\" (UniqueName: \"kubernetes.io/projected/986fef72-a762-47b6-835f-9aebe4b839e4-kube-api-access-58f78\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:05:51.016004 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.015962    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7612-140101039110160"]
Jul 27 21:05:51.017177 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.017148    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986fef72-a762-47b6-835f-9aebe4b839e4" containerName="test-curl-7612-140101038916144"
Jul 27 21:05:51.017349 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.017333    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="986fef72-a762-47b6-835f-9aebe4b839e4" containerName="test-curl-7612-140101038916144"
Jul 27 21:05:51.019352 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.019328    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="986fef72-a762-47b6-835f-9aebe4b839e4" containerName="test-curl-7612-140101038916144"
Jul 27 21:05:51.024565 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.024543    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:51.026563 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.026541    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7612-140101039110160"]
Jul 27 21:05:51.074942 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.074906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j578\" (UniqueName: \"kubernetes.io/projected/6c0934fe-80cb-4e0d-9187-726ae4a46910-kube-api-access-9j578\") pod \"test-curl-7612-140101039110160\" (UID: \"6c0934fe-80cb-4e0d-9187-726ae4a46910\") " pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:51.176387 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.176299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j578\" (UniqueName: \"kubernetes.io/projected/6c0934fe-80cb-4e0d-9187-726ae4a46910-kube-api-access-9j578\") pod \"test-curl-7612-140101039110160\" (UID: \"6c0934fe-80cb-4e0d-9187-726ae4a46910\") " pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:51.183984 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.183953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j578\" (UniqueName: \"kubernetes.io/projected/6c0934fe-80cb-4e0d-9187-726ae4a46910-kube-api-access-9j578\") pod \"test-curl-7612-140101039110160\" (UID: \"6c0934fe-80cb-4e0d-9187-726ae4a46910\") " pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:51.335625 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.335579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:51.479330 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.479287    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7612-140101039110160"]
Jul 27 21:05:51.480909 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:05:51.480878    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c0934fe_80cb_4e0d_9187_726ae4a46910.slice/crio-e67d2ad42f4f4e5817a4124429d82c5ec2624bac69eb71bb25803dd21c1201ea WatchSource:0}: Error finding container e67d2ad42f4f4e5817a4124429d82c5ec2624bac69eb71bb25803dd21c1201ea: Status 404 returned error can't find the container with id e67d2ad42f4f4e5817a4124429d82c5ec2624bac69eb71bb25803dd21c1201ea
Jul 27 21:05:51.656763 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.656728    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101038916144"
Jul 27 21:05:51.656924 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.656772    2580 scope.go:117] "RemoveContainer" containerID="82a28ff4cbfa12075f3d1b7e8e6a474a63c17dbd5eb63234a9d86380974654ab"
Jul 27 21:05:51.658116 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:51.658088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7612-140101039110160" event={"ID":"6c0934fe-80cb-4e0d-9187-726ae4a46910","Type":"ContainerStarted","Data":"e67d2ad42f4f4e5817a4124429d82c5ec2624bac69eb71bb25803dd21c1201ea"}
Jul 27 21:05:52.666674 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:52.666638    2580 generic.go:356] "Generic (PLEG): container finished" podID="6c0934fe-80cb-4e0d-9187-726ae4a46910" containerID="6facae46ae03774b68575a9af8bc89b8d5d84f694b855f7e0ec8d9b2a1ae8cfb" exitCode=0
Jul 27 21:05:52.667112 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:52.666725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7612-140101039110160" event={"ID":"6c0934fe-80cb-4e0d-9187-726ae4a46910","Type":"ContainerDied","Data":"6facae46ae03774b68575a9af8bc89b8d5d84f694b855f7e0ec8d9b2a1ae8cfb"}
Jul 27 21:05:53.824592 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:53.824565    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:53.843493 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:53.843457    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7612-140101039110160_6c0934fe-80cb-4e0d-9187-726ae4a46910/test-curl-7612-140101039110160/0.log"
Jul 27 21:05:53.866905 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:53.866869    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7612-140101039110160"]
Jul 27 21:05:53.874256 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:53.874226    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7612-140101039110160"]
Jul 27 21:05:53.904522 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:53.904481    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j578\" (UniqueName: \"kubernetes.io/projected/6c0934fe-80cb-4e0d-9187-726ae4a46910-kube-api-access-9j578\") pod \"6c0934fe-80cb-4e0d-9187-726ae4a46910\" (UID: \"6c0934fe-80cb-4e0d-9187-726ae4a46910\") "
Jul 27 21:05:53.906667 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:53.906631    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c0934fe-80cb-4e0d-9187-726ae4a46910-kube-api-access-9j578" (OuterVolumeSpecName: "kube-api-access-9j578") pod "6c0934fe-80cb-4e0d-9187-726ae4a46910" (UID: "6c0934fe-80cb-4e0d-9187-726ae4a46910"). InnerVolumeSpecName "kube-api-access-9j578". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:05:53.983173 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:53.983086    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7612-140101039110160"]
Jul 27 21:05:53.983560 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:53.983546    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c0934fe-80cb-4e0d-9187-726ae4a46910" containerName="test-curl-7612-140101039110160"
Jul 27 21:05:53.983617 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:53.983562    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c0934fe-80cb-4e0d-9187-726ae4a46910" containerName="test-curl-7612-140101039110160"
Jul 27 21:05:53.983649 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:53.983640    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c0934fe-80cb-4e0d-9187-726ae4a46910" containerName="test-curl-7612-140101039110160"
Jul 27 21:05:53.986715 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:53.986698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:53.992664 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:53.992638    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7612-140101039110160"]
Jul 27 21:05:54.005624 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:54.005596    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j578\" (UniqueName: \"kubernetes.io/projected/6c0934fe-80cb-4e0d-9187-726ae4a46910-kube-api-access-9j578\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:05:54.106197 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:54.106159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gbwl\" (UniqueName: \"kubernetes.io/projected/7c97550f-3bbd-45f4-aaf6-f2e2092b6f81-kube-api-access-6gbwl\") pod \"test-curl-7612-140101039110160\" (UID: \"7c97550f-3bbd-45f4-aaf6-f2e2092b6f81\") " pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:54.207218 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:54.207179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gbwl\" (UniqueName: \"kubernetes.io/projected/7c97550f-3bbd-45f4-aaf6-f2e2092b6f81-kube-api-access-6gbwl\") pod \"test-curl-7612-140101039110160\" (UID: \"7c97550f-3bbd-45f4-aaf6-f2e2092b6f81\") " pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:54.215255 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:54.215230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gbwl\" (UniqueName: \"kubernetes.io/projected/7c97550f-3bbd-45f4-aaf6-f2e2092b6f81-kube-api-access-6gbwl\") pod \"test-curl-7612-140101039110160\" (UID: \"7c97550f-3bbd-45f4-aaf6-f2e2092b6f81\") " pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:54.298172 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:54.298143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:54.643296 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:54.643269    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7612-140101039110160"]
Jul 27 21:05:54.644651 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:05:54.644623    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c97550f_3bbd_45f4_aaf6_f2e2092b6f81.slice/crio-221534a8f6deb9f977e90008d4baab99ebf57ed7073f4b41c623ac50f21fba47 WatchSource:0}: Error finding container 221534a8f6deb9f977e90008d4baab99ebf57ed7073f4b41c623ac50f21fba47: Status 404 returned error can't find the container with id 221534a8f6deb9f977e90008d4baab99ebf57ed7073f4b41c623ac50f21fba47
Jul 27 21:05:54.680086 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:54.680062    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:54.680274 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:54.680111    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e67d2ad42f4f4e5817a4124429d82c5ec2624bac69eb71bb25803dd21c1201ea"
Jul 27 21:05:54.681582 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:54.681561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7612-140101039110160" event={"ID":"7c97550f-3bbd-45f4-aaf6-f2e2092b6f81","Type":"ContainerStarted","Data":"221534a8f6deb9f977e90008d4baab99ebf57ed7073f4b41c623ac50f21fba47"}
Jul 27 21:05:54.692549 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:54.692515    2580 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7612-140101039110160" oldPodUID="6c0934fe-80cb-4e0d-9187-726ae4a46910" podUID="7c97550f-3bbd-45f4-aaf6-f2e2092b6f81"
Jul 27 21:05:54.903820 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:54.903722    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c0934fe-80cb-4e0d-9187-726ae4a46910" path="/var/lib/kubelet/pods/6c0934fe-80cb-4e0d-9187-726ae4a46910/volumes"
Jul 27 21:05:55.689139 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:55.689099    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c97550f-3bbd-45f4-aaf6-f2e2092b6f81" containerID="3d680c5a8c327340a733127a85cc744bde98627dece6abbcdf2e56e06bf4e627" exitCode=0
Jul 27 21:05:55.689312 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:55.689175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7612-140101039110160" event={"ID":"7c97550f-3bbd-45f4-aaf6-f2e2092b6f81","Type":"ContainerDied","Data":"3d680c5a8c327340a733127a85cc744bde98627dece6abbcdf2e56e06bf4e627"}
Jul 27 21:05:56.839754 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:56.839729    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:56.865502 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:56.865462    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7612-140101039110160_7c97550f-3bbd-45f4-aaf6-f2e2092b6f81/test-curl-7612-140101039110160/0.log"
Jul 27 21:05:56.888222 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:56.888189    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7612-140101039110160"]
Jul 27 21:05:56.892044 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:56.892014    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7612-140101039110160"]
Jul 27 21:05:56.934293 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:56.934262    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gbwl\" (UniqueName: \"kubernetes.io/projected/7c97550f-3bbd-45f4-aaf6-f2e2092b6f81-kube-api-access-6gbwl\") pod \"7c97550f-3bbd-45f4-aaf6-f2e2092b6f81\" (UID: \"7c97550f-3bbd-45f4-aaf6-f2e2092b6f81\") "
Jul 27 21:05:56.936411 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:56.936384    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c97550f-3bbd-45f4-aaf6-f2e2092b6f81-kube-api-access-6gbwl" (OuterVolumeSpecName: "kube-api-access-6gbwl") pod "7c97550f-3bbd-45f4-aaf6-f2e2092b6f81" (UID: "7c97550f-3bbd-45f4-aaf6-f2e2092b6f81"). InnerVolumeSpecName "kube-api-access-6gbwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:05:57.011225 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.011189    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7612-140101039111600"]
Jul 27 21:05:57.011647 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.011632    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c97550f-3bbd-45f4-aaf6-f2e2092b6f81" containerName="test-curl-7612-140101039110160"
Jul 27 21:05:57.011690 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.011649    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c97550f-3bbd-45f4-aaf6-f2e2092b6f81" containerName="test-curl-7612-140101039110160"
Jul 27 21:05:57.011768 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.011757    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c97550f-3bbd-45f4-aaf6-f2e2092b6f81" containerName="test-curl-7612-140101039110160"
Jul 27 21:05:57.014873 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.014846    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039111600"
Jul 27 21:05:57.019047 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.019017    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7612-140101039111600"]
Jul 27 21:05:57.035709 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.035679    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gbwl\" (UniqueName: \"kubernetes.io/projected/7c97550f-3bbd-45f4-aaf6-f2e2092b6f81-kube-api-access-6gbwl\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:05:57.136834 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.136785    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d959q\" (UniqueName: \"kubernetes.io/projected/83d3a0e2-7d62-4577-9720-c301ab5aeb3f-kube-api-access-d959q\") pod \"test-curl-7612-140101039111600\" (UID: \"83d3a0e2-7d62-4577-9720-c301ab5aeb3f\") " pod="opendatahub/test-curl-7612-140101039111600"
Jul 27 21:05:57.237710 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.237610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d959q\" (UniqueName: \"kubernetes.io/projected/83d3a0e2-7d62-4577-9720-c301ab5aeb3f-kube-api-access-d959q\") pod \"test-curl-7612-140101039111600\" (UID: \"83d3a0e2-7d62-4577-9720-c301ab5aeb3f\") " pod="opendatahub/test-curl-7612-140101039111600"
Jul 27 21:05:57.248531 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.248503    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d959q\" (UniqueName: \"kubernetes.io/projected/83d3a0e2-7d62-4577-9720-c301ab5aeb3f-kube-api-access-d959q\") pod \"test-curl-7612-140101039111600\" (UID: \"83d3a0e2-7d62-4577-9720-c301ab5aeb3f\") " pod="opendatahub/test-curl-7612-140101039111600"
Jul 27 21:05:57.326786 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.326730    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039111600"
Jul 27 21:05:57.465838 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.465807    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7612-140101039111600"]
Jul 27 21:05:57.467221 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:05:57.467197    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83d3a0e2_7d62_4577_9720_c301ab5aeb3f.slice/crio-a1fe53042d829e06ca6397a48b1095906c99e734f713c19cd045c5bc65c862af WatchSource:0}: Error finding container a1fe53042d829e06ca6397a48b1095906c99e734f713c19cd045c5bc65c862af: Status 404 returned error can't find the container with id a1fe53042d829e06ca6397a48b1095906c99e734f713c19cd045c5bc65c862af
Jul 27 21:05:57.704567 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.704529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7612-140101039111600" event={"ID":"83d3a0e2-7d62-4577-9720-c301ab5aeb3f","Type":"ContainerStarted","Data":"a1fe53042d829e06ca6397a48b1095906c99e734f713c19cd045c5bc65c862af"}
Jul 27 21:05:57.705904 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.705883    2580 scope.go:117] "RemoveContainer" containerID="3d680c5a8c327340a733127a85cc744bde98627dece6abbcdf2e56e06bf4e627"
Jul 27 21:05:57.706010 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.705891    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039110160"
Jul 27 21:05:57.861540 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:57.861505    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h" podUID="4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b" containerName="main" containerID="cri-o://e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da" gracePeriod=45
Jul 27 21:05:58.132310 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.132280    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:05:58.247701 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.247666    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-tls-certs\") pod \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") "
Jul 27 21:05:58.247890 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.247723    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdgtw\" (UniqueName: \"kubernetes.io/projected/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-kube-api-access-fdgtw\") pod \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") "
Jul 27 21:05:58.247890 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.247769    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-home\") pod \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") "
Jul 27 21:05:58.247890 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.247786    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-dshm\") pod \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") "
Jul 27 21:05:58.247890 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.247845    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-model-cache\") pod \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") "
Jul 27 21:05:58.248082 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.247917    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-tmp-dir\") pod \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\" (UID: \"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b\") "
Jul 27 21:05:58.248082 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.248068    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-home" (OuterVolumeSpecName: "home") pod "4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b" (UID: "4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:05:58.248192 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.248097    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-model-cache" (OuterVolumeSpecName: "model-cache") pod "4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b" (UID: "4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:05:58.248266 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.248244    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b" (UID: "4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:05:58.248361 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.248345    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-home\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:05:58.248419 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.248366    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-model-cache\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:05:58.248419 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.248382    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-tmp-dir\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:05:58.250082 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.250062    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-dshm" (OuterVolumeSpecName: "dshm") pod "4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b" (UID: "4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:05:58.250164 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.250119    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b" (UID: "4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:05:58.250164 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.250146    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-kube-api-access-fdgtw" (OuterVolumeSpecName: "kube-api-access-fdgtw") pod "4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b" (UID: "4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b"). InnerVolumeSpecName "kube-api-access-fdgtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:05:58.349627 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.349526    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-tls-certs\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:05:58.349627 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.349565    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdgtw\" (UniqueName: \"kubernetes.io/projected/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-kube-api-access-fdgtw\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:05:58.349627 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.349574    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b-dshm\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:05:58.714866 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.714769    2580 generic.go:356] "Generic (PLEG): container finished" podID="4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b" containerID="e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da" exitCode=0
Jul 27 21:05:58.714866 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.714811    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"
Jul 27 21:05:58.715071 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.714860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h" event={"ID":"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b","Type":"ContainerDied","Data":"e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da"}
Jul 27 21:05:58.715071 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.714903    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h" event={"ID":"4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b","Type":"ContainerDied","Data":"5d21388891f2e09c4002751749f97f609545334da0b254b75f499bb248c56e89"}
Jul 27 21:05:58.715071 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.714927    2580 scope.go:117] "RemoveContainer" containerID="e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da"
Jul 27 21:05:58.716533 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.716510    2580 generic.go:356] "Generic (PLEG): container finished" podID="83d3a0e2-7d62-4577-9720-c301ab5aeb3f" containerID="495b00f5e1c827942ddfa7fdb435ec9c8746b5f899cdd3faee8771bdc603dfaa" exitCode=0
Jul 27 21:05:58.716666 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.716531    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7612-140101039111600" event={"ID":"83d3a0e2-7d62-4577-9720-c301ab5aeb3f","Type":"ContainerDied","Data":"495b00f5e1c827942ddfa7fdb435ec9c8746b5f899cdd3faee8771bdc603dfaa"}
Jul 27 21:05:58.725332 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.725314    2580 scope.go:117] "RemoveContainer" containerID="e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da"
Jul 27 21:05:58.725579 ip-10-0-139-20 kubenswrapper[2580]: E0727 21:05:58.725560    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da\": container with ID starting with e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da not found: ID does not exist" containerID="e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da"
Jul 27 21:05:58.725644 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.725586    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da"} err="failed to get container status \"e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da\": rpc error: code = NotFound desc = could not find container \"e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da\": container with ID starting with e47af84e52579fcbb58cbd55700fb77a313fe6668184721ed9ef1569f20446da not found: ID does not exist"
Jul 27 21:05:58.746595 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.746564    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"]
Jul 27 21:05:58.749280 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.749260    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-132aad/rate-test-model-132aad-kserve-774d8dcbd7-w4g2h"]
Jul 27 21:05:58.904343 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.904310    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b" path="/var/lib/kubelet/pods/4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b/volumes"
Jul 27 21:05:58.904706 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:58.904643    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c97550f-3bbd-45f4-aaf6-f2e2092b6f81" path="/var/lib/kubelet/pods/7c97550f-3bbd-45f4-aaf6-f2e2092b6f81/volumes"
Jul 27 21:05:59.870644 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:59.870616    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039111600"
Jul 27 21:05:59.890685 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:59.890653    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7612-140101039111600_83d3a0e2-7d62-4577-9720-c301ab5aeb3f/test-curl-7612-140101039111600/0.log"
Jul 27 21:05:59.924357 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:59.924311    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7612-140101039111600"]
Jul 27 21:05:59.925618 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:59.925594    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7612-140101039111600"]
Jul 27 21:05:59.965069 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:59.965040    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d959q\" (UniqueName: \"kubernetes.io/projected/83d3a0e2-7d62-4577-9720-c301ab5aeb3f-kube-api-access-d959q\") pod \"83d3a0e2-7d62-4577-9720-c301ab5aeb3f\" (UID: \"83d3a0e2-7d62-4577-9720-c301ab5aeb3f\") "
Jul 27 21:05:59.967062 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:05:59.967041    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83d3a0e2-7d62-4577-9720-c301ab5aeb3f-kube-api-access-d959q" (OuterVolumeSpecName: "kube-api-access-d959q") pod "83d3a0e2-7d62-4577-9720-c301ab5aeb3f" (UID: "83d3a0e2-7d62-4577-9720-c301ab5aeb3f"). InnerVolumeSpecName "kube-api-access-d959q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:06:00.066264 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:00.066227    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d959q\" (UniqueName: \"kubernetes.io/projected/83d3a0e2-7d62-4577-9720-c301ab5aeb3f-kube-api-access-d959q\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:06:00.733362 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:00.733325    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7612-140101039111600"
Jul 27 21:06:00.733516 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:00.733362    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1fe53042d829e06ca6397a48b1095906c99e734f713c19cd045c5bc65c862af"
Jul 27 21:06:00.743468 ip-10-0-139-20 kubenswrapper[2580]: E0727 21:06:00.743438    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7612-140101039111600\" is forbidden: User \"system:node:ip-10-0-139-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-20.ec2.internal' and this object" podUID="83d3a0e2-7d62-4577-9720-c301ab5aeb3f" pod="opendatahub/test-curl-7612-140101039111600"
Jul 27 21:06:00.903239 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:00.903205    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83d3a0e2-7d62-4577-9720-c301ab5aeb3f" path="/var/lib/kubelet/pods/83d3a0e2-7d62-4577-9720-c301ab5aeb3f/volumes"
Jul 27 21:06:07.062030 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.061992    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"]
Jul 27 21:06:07.062479 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.062463    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83d3a0e2-7d62-4577-9720-c301ab5aeb3f" containerName="test-curl-7612-140101039111600"
Jul 27 21:06:07.062526 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.062480    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="83d3a0e2-7d62-4577-9720-c301ab5aeb3f" containerName="test-curl-7612-140101039111600"
Jul 27 21:06:07.062526 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.062498    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b" containerName="main"
Jul 27 21:06:07.062526 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.062504    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b" containerName="main"
Jul 27 21:06:07.062626 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.062571    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="83d3a0e2-7d62-4577-9720-c301ab5aeb3f" containerName="test-curl-7612-140101039111600"
Jul 27 21:06:07.062626 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.062586    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6f2aa0-25d9-4294-a22f-5dc5b4e60c9b" containerName="main"
Jul 27 21:06:07.065812 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.065793    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:07.068088 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.068070    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-6d6a46-serving-cert\""
Jul 27 21:06:07.078696 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.078672    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"]
Jul 27 21:06:07.137533 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.137492    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:07.137734 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.137566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gjvs\" (UniqueName: \"kubernetes.io/projected/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-kube-api-access-6gjvs\") pod \"maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:07.137734 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.137643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:07.238593 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.238554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:07.238816 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.238637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gjvs\" (UniqueName: \"kubernetes.io/projected/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-kube-api-access-6gjvs\") pod \"maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:07.238816 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.238672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:07.238816 ip-10-0-139-20 kubenswrapper[2580]: E0727 21:06:07.238723    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-serving-cert: secret "maas-api-e2e-ipp-a-6d6a46-serving-cert" not found
Jul 27 21:06:07.238998 ip-10-0-139-20 kubenswrapper[2580]: E0727 21:06:07.238829    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-maas-api-tls podName:3c4cf0c1-029f-4ddd-a221-ebbcf5531fee nodeName:}" failed. No retries permitted until 2026-07-27 21:06:07.738811298 +0000 UTC m=+2923.394966618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-maas-api-tls") pod "maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj" (UID: "3c4cf0c1-029f-4ddd-a221-ebbcf5531fee") : secret "maas-api-e2e-ipp-a-6d6a46-serving-cert" not found
Jul 27 21:06:07.239429 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.239406    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:07.250151 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.250126    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gjvs\" (UniqueName: \"kubernetes.io/projected/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-kube-api-access-6gjvs\") pod \"maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:07.743416 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.743374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:07.746190 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.746154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:07.977319 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:07.977281    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:08.122990 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:08.122950    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"]
Jul 27 21:06:08.123858 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:06:08.123824    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4cf0c1_029f_4ddd_a221_ebbcf5531fee.slice/crio-bb956fa26a76e65c3c5bcee380e11d134cf22676242b759c29b3b11613a63999 WatchSource:0}: Error finding container bb956fa26a76e65c3c5bcee380e11d134cf22676242b759c29b3b11613a63999: Status 404 returned error can't find the container with id bb956fa26a76e65c3c5bcee380e11d134cf22676242b759c29b3b11613a63999
Jul 27 21:06:08.785181 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:08.785142    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj" event={"ID":"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee","Type":"ContainerStarted","Data":"474e525c6028f4e1f71e14ecbc474435856b44d2313e706c7bd40de06cabd7fd"}
Jul 27 21:06:08.785374 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:08.785198    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj" event={"ID":"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee","Type":"ContainerStarted","Data":"bb956fa26a76e65c3c5bcee380e11d134cf22676242b759c29b3b11613a63999"}
Jul 27 21:06:08.785374 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:08.785232    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:08.803068 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:08.803017    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj" podStartSLOduration=1.3504337419999999 podStartE2EDuration="1.803000864s" totalImagesPullingTime="452.567122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:08.801475355 +0000 UTC m=+2924.457630698" watchObservedRunningTime="2026-07-27 21:06:08.803000864 +0000 UTC m=+2924.459156207"
Jul 27 21:06:14.796675 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:14.796646    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:06:26.272497 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.272456    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"]
Jul 27 21:06:26.278410 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.278391    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:26.281022 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.281001    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-cae454-serving-cert\""
Jul 27 21:06:26.301348 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.301322    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"]
Jul 27 21:06:26.330992 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.330957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e77d78-4f62-43ab-a756-092843e098af-maas-api-tls\") pod \"maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw\" (UID: \"b9e77d78-4f62-43ab-a756-092843e098af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:26.331246 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.331011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwfj6\" (UniqueName: \"kubernetes.io/projected/b9e77d78-4f62-43ab-a756-092843e098af-kube-api-access-pwfj6\") pod \"maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw\" (UID: \"b9e77d78-4f62-43ab-a756-092843e098af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:26.331246 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.331199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e77d78-4f62-43ab-a756-092843e098af-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw\" (UID: \"b9e77d78-4f62-43ab-a756-092843e098af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:26.432338 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.432302    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e77d78-4f62-43ab-a756-092843e098af-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw\" (UID: \"b9e77d78-4f62-43ab-a756-092843e098af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:26.432516 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.432353    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e77d78-4f62-43ab-a756-092843e098af-maas-api-tls\") pod \"maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw\" (UID: \"b9e77d78-4f62-43ab-a756-092843e098af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:26.432516 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.432379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwfj6\" (UniqueName: \"kubernetes.io/projected/b9e77d78-4f62-43ab-a756-092843e098af-kube-api-access-pwfj6\") pod \"maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw\" (UID: \"b9e77d78-4f62-43ab-a756-092843e098af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:26.433050 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.433019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e77d78-4f62-43ab-a756-092843e098af-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw\" (UID: \"b9e77d78-4f62-43ab-a756-092843e098af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:26.434793 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.434764    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e77d78-4f62-43ab-a756-092843e098af-maas-api-tls\") pod \"maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw\" (UID: \"b9e77d78-4f62-43ab-a756-092843e098af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:26.440913 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.440889    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwfj6\" (UniqueName: \"kubernetes.io/projected/b9e77d78-4f62-43ab-a756-092843e098af-kube-api-access-pwfj6\") pod \"maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw\" (UID: \"b9e77d78-4f62-43ab-a756-092843e098af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:26.588518 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.588482    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:26.738249 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.738213    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"]
Jul 27 21:06:26.738805 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:06:26.738774    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e77d78_4f62_43ab_a756_092843e098af.slice/crio-8e579492cecbc17908178ec7112d327e9a55e2c6f170ea4bddb986ca248aa087 WatchSource:0}: Error finding container 8e579492cecbc17908178ec7112d327e9a55e2c6f170ea4bddb986ca248aa087: Status 404 returned error can't find the container with id 8e579492cecbc17908178ec7112d327e9a55e2c6f170ea4bddb986ca248aa087
Jul 27 21:06:26.903250 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:26.903164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw" event={"ID":"b9e77d78-4f62-43ab-a756-092843e098af","Type":"ContainerStarted","Data":"8e579492cecbc17908178ec7112d327e9a55e2c6f170ea4bddb986ca248aa087"}
Jul 27 21:06:27.905921 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:27.905885    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw" event={"ID":"b9e77d78-4f62-43ab-a756-092843e098af","Type":"ContainerStarted","Data":"e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86"}
Jul 27 21:06:27.906305 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:27.906053    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:27.922822 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:27.922740    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw" podStartSLOduration=1.5243990589999998 podStartE2EDuration="1.922724153s" totalImagesPullingTime="398.325094ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:27.921082594 +0000 UTC m=+2943.577237936" watchObservedRunningTime="2026-07-27 21:06:27.922724153 +0000 UTC m=+2943.578879495"
Jul 27 21:06:33.917274 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:33.917238    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:06:47.603949 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:06:47.603640    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-sb92s_6d73fc6c-684b-4483-91c7-d61cdce108aa/payload-processing/0.log"
Jul 27 21:07:02.809958 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.809924    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"]
Jul 27 21:07:02.814872 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.814846    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:02.818164 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.818139    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-6d6a46\"/\"openshift-service-ca.crt\""
Jul 27 21:07:02.818310 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.818207    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-6d6a46\"/\"default-dockercfg-2vfrw\""
Jul 27 21:07:02.818310 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.818188    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-6d6a46\"/\"kube-root-ca.crt\""
Jul 27 21:07:02.818310 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.818288    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-6d6a46\"/\"ipp-route-6d6a46-kserve-self-signed-certs\""
Jul 27 21:07:02.824281 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.824255    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"]
Jul 27 21:07:02.908254 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.908219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9kt6\" (UniqueName: \"kubernetes.io/projected/bca35112-6d57-4790-b769-71fefbc8f5cc-kube-api-access-b9kt6\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:02.908254 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.908255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-home\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:02.908506 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.908285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca35112-6d57-4790-b769-71fefbc8f5cc-tls-certs\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:02.908506 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.908359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-dshm\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:02.908506 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.908400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-tmp-dir\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:02.908506 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:02.908426    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-model-cache\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.009486 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.009438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9kt6\" (UniqueName: \"kubernetes.io/projected/bca35112-6d57-4790-b769-71fefbc8f5cc-kube-api-access-b9kt6\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.009841 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.009809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-home\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.009996 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.009889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca35112-6d57-4790-b769-71fefbc8f5cc-tls-certs\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.009996 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.009946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-dshm\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.009996 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.009975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-tmp-dir\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.010194 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.009999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-model-cache\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.010900 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.010874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-tmp-dir\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.011071 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.010932    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-model-cache\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.011227 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.011141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-home\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.013239 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.013217    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-dshm\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.013334 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.013256    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca35112-6d57-4790-b769-71fefbc8f5cc-tls-certs\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.018097 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.018068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9kt6\" (UniqueName: \"kubernetes.io/projected/bca35112-6d57-4790-b769-71fefbc8f5cc-kube-api-access-b9kt6\") pod \"ipp-route-6d6a46-kserve-6d57fdb58c-955pw\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") " pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.126317 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.126227    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:03.477445 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:03.477411    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"]
Jul 27 21:07:03.480085 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:07:03.480046    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbca35112_6d57_4790_b769_71fefbc8f5cc.slice/crio-c5b6b3d6444039db1303c78976ee03effb032cb1da77fe1b247b0a82b45a5117 WatchSource:0}: Error finding container c5b6b3d6444039db1303c78976ee03effb032cb1da77fe1b247b0a82b45a5117: Status 404 returned error can't find the container with id c5b6b3d6444039db1303c78976ee03effb032cb1da77fe1b247b0a82b45a5117
Jul 27 21:07:04.141600 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:04.141564    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw" event={"ID":"bca35112-6d57-4790-b769-71fefbc8f5cc","Type":"ContainerStarted","Data":"8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b"}
Jul 27 21:07:04.141987 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:04.141611    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw" event={"ID":"bca35112-6d57-4790-b769-71fefbc8f5cc","Type":"ContainerStarted","Data":"c5b6b3d6444039db1303c78976ee03effb032cb1da77fe1b247b0a82b45a5117"}
Jul 27 21:07:04.160901 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:04.160853    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw" podStartSLOduration=2.160837914 podStartE2EDuration="2.160837914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:04.158439543 +0000 UTC m=+2979.814594900" watchObservedRunningTime="2026-07-27 21:07:04.160837914 +0000 UTC m=+2979.816993253"
Jul 27 21:07:13.126597 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:13.126558    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:13.127150 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:13.126624    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:13.139865 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:13.139839    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:13.214349 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:13.214317    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:07:26.707931 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:26.707821    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 21:07:26.726328 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:26.726303    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 21:07:47.885618 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:47.885588    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-sb92s_6d73fc6c-684b-4483-91c7-d61cdce108aa/payload-processing/0.log"
Jul 27 21:07:51.924529 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:51.924491    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"]
Jul 27 21:07:51.933197 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:51.930933    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:07:51.934294 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:51.934266    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-1482c3-serving-cert\""
Jul 27 21:07:51.948783 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:51.948735    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"]
Jul 27 21:07:52.023088 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:52.023048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl98w\" (UniqueName: \"kubernetes.io/projected/653d18a3-b67c-4c3e-b23d-909281397277-kube-api-access-wl98w\") pod \"maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64\" (UID: \"653d18a3-b67c-4c3e-b23d-909281397277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:07:52.023295 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:52.023108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/653d18a3-b67c-4c3e-b23d-909281397277-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64\" (UID: \"653d18a3-b67c-4c3e-b23d-909281397277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:07:52.023295 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:52.023209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/653d18a3-b67c-4c3e-b23d-909281397277-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64\" (UID: \"653d18a3-b67c-4c3e-b23d-909281397277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:07:52.123786 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:52.123729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/653d18a3-b67c-4c3e-b23d-909281397277-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64\" (UID: \"653d18a3-b67c-4c3e-b23d-909281397277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:07:52.123987 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:52.123849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl98w\" (UniqueName: \"kubernetes.io/projected/653d18a3-b67c-4c3e-b23d-909281397277-kube-api-access-wl98w\") pod \"maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64\" (UID: \"653d18a3-b67c-4c3e-b23d-909281397277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:07:52.123987 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:52.123881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/653d18a3-b67c-4c3e-b23d-909281397277-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64\" (UID: \"653d18a3-b67c-4c3e-b23d-909281397277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:07:52.124626 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:52.124603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/653d18a3-b67c-4c3e-b23d-909281397277-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64\" (UID: \"653d18a3-b67c-4c3e-b23d-909281397277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:07:52.126338 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:52.126316    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/653d18a3-b67c-4c3e-b23d-909281397277-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64\" (UID: \"653d18a3-b67c-4c3e-b23d-909281397277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:07:52.133926 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:52.133895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl98w\" (UniqueName: \"kubernetes.io/projected/653d18a3-b67c-4c3e-b23d-909281397277-kube-api-access-wl98w\") pod \"maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64\" (UID: \"653d18a3-b67c-4c3e-b23d-909281397277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:07:52.242787 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:52.242666    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:07:52.438479 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:52.438450    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"]
Jul 27 21:07:52.439939 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:07:52.439903    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653d18a3_b67c_4c3e_b23d_909281397277.slice/crio-a36b8821869e3dd95e8905a746761512b66f206412c65129bbcb1200c45b5ee3 WatchSource:0}: Error finding container a36b8821869e3dd95e8905a746761512b66f206412c65129bbcb1200c45b5ee3: Status 404 returned error can't find the container with id a36b8821869e3dd95e8905a746761512b66f206412c65129bbcb1200c45b5ee3
Jul 27 21:07:52.448476 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:52.448431    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64" event={"ID":"653d18a3-b67c-4c3e-b23d-909281397277","Type":"ContainerStarted","Data":"a36b8821869e3dd95e8905a746761512b66f206412c65129bbcb1200c45b5ee3"}
Jul 27 21:07:53.456762 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:53.456712    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64" event={"ID":"653d18a3-b67c-4c3e-b23d-909281397277","Type":"ContainerStarted","Data":"34fbf85781b4f0bbbf8cd5027d3d59f7bd06b970966e624c00a2261d40b26f08"}
Jul 27 21:07:53.457244 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:53.456865    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:07:53.496124 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:53.496067    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64" podStartSLOduration=2.105868163 podStartE2EDuration="2.496050522s" totalImagesPullingTime="390.182359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:53.49506911 +0000 UTC m=+3029.151224454" watchObservedRunningTime="2026-07-27 21:07:53.496050522 +0000 UTC m=+3029.152205864"
Jul 27 21:07:59.468720 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:07:59.468685    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:08:07.058049 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:07.058011    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx"]
Jul 27 21:08:07.061689 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:07.061671    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx"
Jul 27 21:08:07.066685 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:07.066659    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 21:08:07.077392 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:07.077364    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx"]
Jul 27 21:08:07.186442 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:07.186404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3185995c-9314-4cf0-b4d7-d71885ea6b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx\" (UID: \"3185995c-9314-4cf0-b4d7-d71885ea6b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx"
Jul 27 21:08:07.287254 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:07.287220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3185995c-9314-4cf0-b4d7-d71885ea6b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx\" (UID: \"3185995c-9314-4cf0-b4d7-d71885ea6b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx"
Jul 27 21:08:07.287894 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:07.287873    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3185995c-9314-4cf0-b4d7-d71885ea6b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx\" (UID: \"3185995c-9314-4cf0-b4d7-d71885ea6b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx"
Jul 27 21:08:07.372935 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:07.372850    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx"
Jul 27 21:08:07.513725 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:07.513694    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx"]
Jul 27 21:08:07.515203 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:08:07.515166    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3185995c_9314_4cf0_b4d7_d71885ea6b70.slice/crio-307b308dbe8c139c9c51855329d1aa3d3ac7990dd1ca4ebc4567060300a4755e WatchSource:0}: Error finding container 307b308dbe8c139c9c51855329d1aa3d3ac7990dd1ca4ebc4567060300a4755e: Status 404 returned error can't find the container with id 307b308dbe8c139c9c51855329d1aa3d3ac7990dd1ca4ebc4567060300a4755e
Jul 27 21:08:07.551219 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:07.551183    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx" event={"ID":"3185995c-9314-4cf0-b4d7-d71885ea6b70","Type":"ContainerStarted","Data":"307b308dbe8c139c9c51855329d1aa3d3ac7990dd1ca4ebc4567060300a4755e"}
Jul 27 21:08:08.559001 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:08.558966    2580 generic.go:356] "Generic (PLEG): container finished" podID="3185995c-9314-4cf0-b4d7-d71885ea6b70" containerID="9385de5698d8552f6559f0f2d03b7eaf496fbb5b64bb1dec8fc4f1ae61723c84" exitCode=0
Jul 27 21:08:08.559403 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:08.559054    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx" event={"ID":"3185995c-9314-4cf0-b4d7-d71885ea6b70","Type":"ContainerDied","Data":"9385de5698d8552f6559f0f2d03b7eaf496fbb5b64bb1dec8fc4f1ae61723c84"}
Jul 27 21:08:09.704430 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:09.704403    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx"
Jul 27 21:08:09.813099 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:09.813062    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3185995c-9314-4cf0-b4d7-d71885ea6b70-maas-api-service-ca\") pod \"3185995c-9314-4cf0-b4d7-d71885ea6b70\" (UID: \"3185995c-9314-4cf0-b4d7-d71885ea6b70\") "
Jul 27 21:08:09.813481 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:09.813457    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3185995c-9314-4cf0-b4d7-d71885ea6b70-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3185995c-9314-4cf0-b4d7-d71885ea6b70" (UID: "3185995c-9314-4cf0-b4d7-d71885ea6b70"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:08:09.914071 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:09.913981    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3185995c-9314-4cf0-b4d7-d71885ea6b70-maas-api-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:08:10.573621 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:10.573590    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx"
Jul 27 21:08:10.573835 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:10.573629    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx" event={"ID":"3185995c-9314-4cf0-b4d7-d71885ea6b70","Type":"ContainerDied","Data":"307b308dbe8c139c9c51855329d1aa3d3ac7990dd1ca4ebc4567060300a4755e"}
Jul 27 21:08:10.573835 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:10.573675    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="307b308dbe8c139c9c51855329d1aa3d3ac7990dd1ca4ebc4567060300a4755e"
Jul 27 21:08:17.497444 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.497337    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"]
Jul 27 21:08:17.498050 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.497610    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64" podUID="653d18a3-b67c-4c3e-b23d-909281397277" containerName="maas-api" containerID="cri-o://34fbf85781b4f0bbbf8cd5027d3d59f7bd06b970966e624c00a2261d40b26f08" gracePeriod=30
Jul 27 21:08:17.625085 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.625037    2580 generic.go:356] "Generic (PLEG): container finished" podID="653d18a3-b67c-4c3e-b23d-909281397277" containerID="34fbf85781b4f0bbbf8cd5027d3d59f7bd06b970966e624c00a2261d40b26f08" exitCode=0
Jul 27 21:08:17.625253 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.625102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64" event={"ID":"653d18a3-b67c-4c3e-b23d-909281397277","Type":"ContainerDied","Data":"34fbf85781b4f0bbbf8cd5027d3d59f7bd06b970966e624c00a2261d40b26f08"}
Jul 27 21:08:17.773652 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.773625    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:08:17.895658 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.895627    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl98w\" (UniqueName: \"kubernetes.io/projected/653d18a3-b67c-4c3e-b23d-909281397277-kube-api-access-wl98w\") pod \"653d18a3-b67c-4c3e-b23d-909281397277\" (UID: \"653d18a3-b67c-4c3e-b23d-909281397277\") "
Jul 27 21:08:17.895858 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.895737    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/653d18a3-b67c-4c3e-b23d-909281397277-openshift-service-ca\") pod \"653d18a3-b67c-4c3e-b23d-909281397277\" (UID: \"653d18a3-b67c-4c3e-b23d-909281397277\") "
Jul 27 21:08:17.895858 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.895810    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/653d18a3-b67c-4c3e-b23d-909281397277-maas-api-tls\") pod \"653d18a3-b67c-4c3e-b23d-909281397277\" (UID: \"653d18a3-b67c-4c3e-b23d-909281397277\") "
Jul 27 21:08:17.896069 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.896035    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/653d18a3-b67c-4c3e-b23d-909281397277-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "653d18a3-b67c-4c3e-b23d-909281397277" (UID: "653d18a3-b67c-4c3e-b23d-909281397277"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:08:17.896192 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.896178    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/653d18a3-b67c-4c3e-b23d-909281397277-openshift-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:08:17.897817 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.897794    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/653d18a3-b67c-4c3e-b23d-909281397277-kube-api-access-wl98w" (OuterVolumeSpecName: "kube-api-access-wl98w") pod "653d18a3-b67c-4c3e-b23d-909281397277" (UID: "653d18a3-b67c-4c3e-b23d-909281397277"). InnerVolumeSpecName "kube-api-access-wl98w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:08:17.897965 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.897948    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653d18a3-b67c-4c3e-b23d-909281397277-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "653d18a3-b67c-4c3e-b23d-909281397277" (UID: "653d18a3-b67c-4c3e-b23d-909281397277"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:08:17.997015 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.996965    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/653d18a3-b67c-4c3e-b23d-909281397277-maas-api-tls\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:08:17.997015 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:17.997008    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl98w\" (UniqueName: \"kubernetes.io/projected/653d18a3-b67c-4c3e-b23d-909281397277-kube-api-access-wl98w\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:08:18.633200 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:18.633165    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"
Jul 27 21:08:18.633615 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:18.633198    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64" event={"ID":"653d18a3-b67c-4c3e-b23d-909281397277","Type":"ContainerDied","Data":"a36b8821869e3dd95e8905a746761512b66f206412c65129bbcb1200c45b5ee3"}
Jul 27 21:08:18.633615 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:18.633268    2580 scope.go:117] "RemoveContainer" containerID="34fbf85781b4f0bbbf8cd5027d3d59f7bd06b970966e624c00a2261d40b26f08"
Jul 27 21:08:18.664244 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:18.664211    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"]
Jul 27 21:08:18.668438 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:18.668404    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-1482c3-c9554445f-2dh64"]
Jul 27 21:08:18.903510 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:18.903431    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="653d18a3-b67c-4c3e-b23d-909281397277" path="/var/lib/kubelet/pods/653d18a3-b67c-4c3e-b23d-909281397277/volumes"
Jul 27 21:08:22.133637 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:22.133602    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx"]
Jul 27 21:08:22.136454 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:22.136427    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1482c3-5z7qx"]
Jul 27 21:08:22.903443 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:22.903411    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3185995c-9314-4cf0-b4d7-d71885ea6b70" path="/var/lib/kubelet/pods/3185995c-9314-4cf0-b4d7-d71885ea6b70/volumes"
Jul 27 21:08:32.069776 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.069728    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl"]
Jul 27 21:08:32.070225 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.070211    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653d18a3-b67c-4c3e-b23d-909281397277" containerName="maas-api"
Jul 27 21:08:32.070274 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.070226    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="653d18a3-b67c-4c3e-b23d-909281397277" containerName="maas-api"
Jul 27 21:08:32.070274 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.070236    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3185995c-9314-4cf0-b4d7-d71885ea6b70" containerName="revoke-keys"
Jul 27 21:08:32.070274 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.070242    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3185995c-9314-4cf0-b4d7-d71885ea6b70" containerName="revoke-keys"
Jul 27 21:08:32.070375 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.070311    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3185995c-9314-4cf0-b4d7-d71885ea6b70" containerName="revoke-keys"
Jul 27 21:08:32.070375 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.070321    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="653d18a3-b67c-4c3e-b23d-909281397277" containerName="maas-api"
Jul 27 21:08:32.074885 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.074869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl"
Jul 27 21:08:32.077444 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.077422    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 21:08:32.080862 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.080836    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl"]
Jul 27 21:08:32.138125 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.138092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl\" (UID: \"a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl"
Jul 27 21:08:32.238661 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.238624    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl\" (UID: \"a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl"
Jul 27 21:08:32.239268 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.239249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl\" (UID: \"a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl"
Jul 27 21:08:32.388075 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.387985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl"
Jul 27 21:08:32.535618 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.535583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl"]
Jul 27 21:08:32.536639 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:08:32.536612    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c1a088_da34_4d0d_81d8_9ef3e61e0ba1.slice/crio-a7d3e454acfff2732b44980329de87298723c68df31fa0e3d25c70d3620cac81 WatchSource:0}: Error finding container a7d3e454acfff2732b44980329de87298723c68df31fa0e3d25c70d3620cac81: Status 404 returned error can't find the container with id a7d3e454acfff2732b44980329de87298723c68df31fa0e3d25c70d3620cac81
Jul 27 21:08:32.722733 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:32.722641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl" event={"ID":"a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1","Type":"ContainerStarted","Data":"a7d3e454acfff2732b44980329de87298723c68df31fa0e3d25c70d3620cac81"}
Jul 27 21:08:33.730816 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:33.730779    2580 generic.go:356] "Generic (PLEG): container finished" podID="a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1" containerID="124bc66051ac781de8be80234a0e289f67ae2d34764165da3160e46f4373ab6b" exitCode=0
Jul 27 21:08:33.731224 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:33.730831    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl" event={"ID":"a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1","Type":"ContainerDied","Data":"124bc66051ac781de8be80234a0e289f67ae2d34764165da3160e46f4373ab6b"}
Jul 27 21:08:34.885663 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:34.885635    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl"
Jul 27 21:08:34.963920 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:34.963885    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1-maas-api-service-ca\") pod \"a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1\" (UID: \"a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1\") "
Jul 27 21:08:34.964300 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:34.964272    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1" (UID: "a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:08:35.065262 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:35.065221    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1-maas-api-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:08:35.745038 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:35.745005    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl"
Jul 27 21:08:35.745238 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:35.745036    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl" event={"ID":"a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1","Type":"ContainerDied","Data":"a7d3e454acfff2732b44980329de87298723c68df31fa0e3d25c70d3620cac81"}
Jul 27 21:08:35.745238 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:35.745082    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7d3e454acfff2732b44980329de87298723c68df31fa0e3d25c70d3620cac81"
Jul 27 21:08:43.105876 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:43.105836    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s9jzc"]
Jul 27 21:08:43.106671 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:43.106645    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1" containerName="revoke-keys"
Jul 27 21:08:43.106730 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:43.106676    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1" containerName="revoke-keys"
Jul 27 21:08:43.106861 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:43.106846    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1" containerName="revoke-keys"
Jul 27 21:08:43.110437 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:43.110417    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc"
Jul 27 21:08:43.120846 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:43.120775    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s9jzc"]
Jul 27 21:08:43.147875 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:43.147842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpx89\" (UniqueName: \"kubernetes.io/projected/bf279c0f-360a-443f-ba99-c495d95e04f6-kube-api-access-rpx89\") pod \"kuadrant-operator-catalog-s9jzc\" (UID: \"bf279c0f-360a-443f-ba99-c495d95e04f6\") " pod="kuadrant-system/kuadrant-operator-catalog-s9jzc"
Jul 27 21:08:43.248685 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:43.248649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpx89\" (UniqueName: \"kubernetes.io/projected/bf279c0f-360a-443f-ba99-c495d95e04f6-kube-api-access-rpx89\") pod \"kuadrant-operator-catalog-s9jzc\" (UID: \"bf279c0f-360a-443f-ba99-c495d95e04f6\") " pod="kuadrant-system/kuadrant-operator-catalog-s9jzc"
Jul 27 21:08:43.257123 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:43.257091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpx89\" (UniqueName: \"kubernetes.io/projected/bf279c0f-360a-443f-ba99-c495d95e04f6-kube-api-access-rpx89\") pod \"kuadrant-operator-catalog-s9jzc\" (UID: \"bf279c0f-360a-443f-ba99-c495d95e04f6\") " pod="kuadrant-system/kuadrant-operator-catalog-s9jzc"
Jul 27 21:08:43.424212 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:43.424116    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc"
Jul 27 21:08:43.573365 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:43.573333    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s9jzc"]
Jul 27 21:08:43.573575 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:08:43.573546    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf279c0f_360a_443f_ba99_c495d95e04f6.slice/crio-45aaa7ef98cea22ffa188d2dd4f82bb6f323bd9a3a962a224a3968ecc0a27a33 WatchSource:0}: Error finding container 45aaa7ef98cea22ffa188d2dd4f82bb6f323bd9a3a962a224a3968ecc0a27a33: Status 404 returned error can't find the container with id 45aaa7ef98cea22ffa188d2dd4f82bb6f323bd9a3a962a224a3968ecc0a27a33
Jul 27 21:08:43.803062 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:43.803023    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc" event={"ID":"bf279c0f-360a-443f-ba99-c495d95e04f6","Type":"ContainerStarted","Data":"45aaa7ef98cea22ffa188d2dd4f82bb6f323bd9a3a962a224a3968ecc0a27a33"}
Jul 27 21:08:44.811484 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:44.811450    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc" event={"ID":"bf279c0f-360a-443f-ba99-c495d95e04f6","Type":"ContainerStarted","Data":"844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c"}
Jul 27 21:08:44.829565 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:44.829512    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc" podStartSLOduration=1.387088332 podStartE2EDuration="1.829497744s" totalImagesPullingTime="442.409412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:08:44.826871751 +0000 UTC m=+3080.483027132" watchObservedRunningTime="2026-07-27 21:08:44.829497744 +0000 UTC m=+3080.485653086"
Jul 27 21:08:47.639605 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:47.639569    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"]
Jul 27 21:08:47.640121 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:47.639838    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj" podUID="3c4cf0c1-029f-4ddd-a221-ebbcf5531fee" containerName="maas-api" containerID="cri-o://474e525c6028f4e1f71e14ecbc474435856b44d2313e706c7bd40de06cabd7fd" gracePeriod=30
Jul 27 21:08:47.835361 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:47.835315    2580 generic.go:356] "Generic (PLEG): container finished" podID="3c4cf0c1-029f-4ddd-a221-ebbcf5531fee" containerID="474e525c6028f4e1f71e14ecbc474435856b44d2313e706c7bd40de06cabd7fd" exitCode=0
Jul 27 21:08:47.835549 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:47.835387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj" event={"ID":"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee","Type":"ContainerDied","Data":"474e525c6028f4e1f71e14ecbc474435856b44d2313e706c7bd40de06cabd7fd"}
Jul 27 21:08:47.915441 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:47.915411    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:08:47.997861 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:47.997826    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gjvs\" (UniqueName: \"kubernetes.io/projected/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-kube-api-access-6gjvs\") pod \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") "
Jul 27 21:08:47.998050 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:47.997921    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-maas-api-tls\") pod \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") "
Jul 27 21:08:47.998050 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:47.997968    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-openshift-service-ca\") pod \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\" (UID: \"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee\") "
Jul 27 21:08:47.998345 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:47.998322    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c4cf0c1-029f-4ddd-a221-ebbcf5531fee" (UID: "3c4cf0c1-029f-4ddd-a221-ebbcf5531fee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:08:48.000028 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:47.999999    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c4cf0c1-029f-4ddd-a221-ebbcf5531fee" (UID: "3c4cf0c1-029f-4ddd-a221-ebbcf5531fee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:08:48.000131 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:48.000105    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-kube-api-access-6gjvs" (OuterVolumeSpecName: "kube-api-access-6gjvs") pod "3c4cf0c1-029f-4ddd-a221-ebbcf5531fee" (UID: "3c4cf0c1-029f-4ddd-a221-ebbcf5531fee"). InnerVolumeSpecName "kube-api-access-6gjvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:08:48.099542 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:48.099502    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-maas-api-tls\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:08:48.099542 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:48.099535    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-openshift-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:08:48.099542 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:48.099545    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gjvs\" (UniqueName: \"kubernetes.io/projected/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee-kube-api-access-6gjvs\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:08:48.842918 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:48.842890    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"
Jul 27 21:08:48.843467 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:48.842938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj" event={"ID":"3c4cf0c1-029f-4ddd-a221-ebbcf5531fee","Type":"ContainerDied","Data":"bb956fa26a76e65c3c5bcee380e11d134cf22676242b759c29b3b11613a63999"}
Jul 27 21:08:48.843467 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:48.843006    2580 scope.go:117] "RemoveContainer" containerID="474e525c6028f4e1f71e14ecbc474435856b44d2313e706c7bd40de06cabd7fd"
Jul 27 21:08:48.864761 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:48.864720    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"]
Jul 27 21:08:48.867417 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:48.867397    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d6a46-6c8ff8bd8b-hbvmj"]
Jul 27 21:08:48.903510 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:48.903480    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c4cf0c1-029f-4ddd-a221-ebbcf5531fee" path="/var/lib/kubelet/pods/3c4cf0c1-029f-4ddd-a221-ebbcf5531fee/volumes"
Jul 27 21:08:52.154237 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:52.154177    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl"]
Jul 27 21:08:52.158106 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:52.158077    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6d6a46-khxvl"]
Jul 27 21:08:52.903724 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:52.903688    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1" path="/var/lib/kubelet/pods/a1c1a088-da34-4d0d-81d8-9ef3e61e0ba1/volumes"
Jul 27 21:08:53.425237 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:53.425174    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc"
Jul 27 21:08:53.425677 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:53.425268    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc"
Jul 27 21:08:53.447466 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:53.447435    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc"
Jul 27 21:08:53.901069 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:53.901043    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc"
Jul 27 21:08:53.939087 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:53.939034    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s9jzc"]
Jul 27 21:08:55.890902 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:55.890865    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc" podUID="bf279c0f-360a-443f-ba99-c495d95e04f6" containerName="registry-server" containerID="cri-o://844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c" gracePeriod=2
Jul 27 21:08:56.159847 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.159823    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc"
Jul 27 21:08:56.292339 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.292300    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpx89\" (UniqueName: \"kubernetes.io/projected/bf279c0f-360a-443f-ba99-c495d95e04f6-kube-api-access-rpx89\") pod \"bf279c0f-360a-443f-ba99-c495d95e04f6\" (UID: \"bf279c0f-360a-443f-ba99-c495d95e04f6\") "
Jul 27 21:08:56.294360 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.294336    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf279c0f-360a-443f-ba99-c495d95e04f6-kube-api-access-rpx89" (OuterVolumeSpecName: "kube-api-access-rpx89") pod "bf279c0f-360a-443f-ba99-c495d95e04f6" (UID: "bf279c0f-360a-443f-ba99-c495d95e04f6"). InnerVolumeSpecName "kube-api-access-rpx89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:08:56.393616 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.393522    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpx89\" (UniqueName: \"kubernetes.io/projected/bf279c0f-360a-443f-ba99-c495d95e04f6-kube-api-access-rpx89\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:08:56.898136 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.898106    2580 generic.go:356] "Generic (PLEG): container finished" podID="bf279c0f-360a-443f-ba99-c495d95e04f6" containerID="844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c" exitCode=0
Jul 27 21:08:56.898627 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.898220    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc"
Jul 27 21:08:56.903155 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.903126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc" event={"ID":"bf279c0f-360a-443f-ba99-c495d95e04f6","Type":"ContainerDied","Data":"844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c"}
Jul 27 21:08:56.903313 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.903167    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s9jzc" event={"ID":"bf279c0f-360a-443f-ba99-c495d95e04f6","Type":"ContainerDied","Data":"45aaa7ef98cea22ffa188d2dd4f82bb6f323bd9a3a962a224a3968ecc0a27a33"}
Jul 27 21:08:56.903313 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.903187    2580 scope.go:117] "RemoveContainer" containerID="844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c"
Jul 27 21:08:56.914700 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.914680    2580 scope.go:117] "RemoveContainer" containerID="844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c"
Jul 27 21:08:56.915014 ip-10-0-139-20 kubenswrapper[2580]: E0727 21:08:56.914992    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c\": container with ID starting with 844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c not found: ID does not exist" containerID="844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c"
Jul 27 21:08:56.915122 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.915020    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c"} err="failed to get container status \"844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c\": rpc error: code = NotFound desc = could not find container \"844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c\": container with ID starting with 844c1ff8859efb42e92d9c7dcde2338e8d60ed32ffaa110fef1dbd10b08c333c not found: ID does not exist"
Jul 27 21:08:56.924077 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.924044    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s9jzc"]
Jul 27 21:08:56.928798 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:56.928774    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s9jzc"]
Jul 27 21:08:57.503498 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:57.503462    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"]
Jul 27 21:08:58.903251 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:08:58.903217    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf279c0f-360a-443f-ba99-c495d95e04f6" path="/var/lib/kubelet/pods/bf279c0f-360a-443f-ba99-c495d95e04f6/volumes"
Jul 27 21:09:12.523034 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.522993    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw" podUID="bca35112-6d57-4790-b769-71fefbc8f5cc" containerName="main" containerID="cri-o://8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b" gracePeriod=45
Jul 27 21:09:12.781889 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.781868    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:09:12.839873 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.839846    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-dshm\") pod \"bca35112-6d57-4790-b769-71fefbc8f5cc\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") "
Jul 27 21:09:12.840067 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.839881    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-model-cache\") pod \"bca35112-6d57-4790-b769-71fefbc8f5cc\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") "
Jul 27 21:09:12.840067 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.839903    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9kt6\" (UniqueName: \"kubernetes.io/projected/bca35112-6d57-4790-b769-71fefbc8f5cc-kube-api-access-b9kt6\") pod \"bca35112-6d57-4790-b769-71fefbc8f5cc\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") "
Jul 27 21:09:12.840067 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.840000    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca35112-6d57-4790-b769-71fefbc8f5cc-tls-certs\") pod \"bca35112-6d57-4790-b769-71fefbc8f5cc\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") "
Jul 27 21:09:12.840235 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.840102    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-tmp-dir\") pod \"bca35112-6d57-4790-b769-71fefbc8f5cc\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") "
Jul 27 21:09:12.840235 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.840139    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-home\") pod \"bca35112-6d57-4790-b769-71fefbc8f5cc\" (UID: \"bca35112-6d57-4790-b769-71fefbc8f5cc\") "
Jul 27 21:09:12.840235 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.840199    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-model-cache" (OuterVolumeSpecName: "model-cache") pod "bca35112-6d57-4790-b769-71fefbc8f5cc" (UID: "bca35112-6d57-4790-b769-71fefbc8f5cc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:12.840444 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.840412    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-home" (OuterVolumeSpecName: "home") pod "bca35112-6d57-4790-b769-71fefbc8f5cc" (UID: "bca35112-6d57-4790-b769-71fefbc8f5cc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:12.840444 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.840435    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-model-cache\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:09:12.840569 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.840509    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bca35112-6d57-4790-b769-71fefbc8f5cc" (UID: "bca35112-6d57-4790-b769-71fefbc8f5cc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:12.842268 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.842241    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca35112-6d57-4790-b769-71fefbc8f5cc-kube-api-access-b9kt6" (OuterVolumeSpecName: "kube-api-access-b9kt6") pod "bca35112-6d57-4790-b769-71fefbc8f5cc" (UID: "bca35112-6d57-4790-b769-71fefbc8f5cc"). InnerVolumeSpecName "kube-api-access-b9kt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:09:12.842373 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.842268    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bca35112-6d57-4790-b769-71fefbc8f5cc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bca35112-6d57-4790-b769-71fefbc8f5cc" (UID: "bca35112-6d57-4790-b769-71fefbc8f5cc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:09:12.842373 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.842356    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-dshm" (OuterVolumeSpecName: "dshm") pod "bca35112-6d57-4790-b769-71fefbc8f5cc" (UID: "bca35112-6d57-4790-b769-71fefbc8f5cc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:12.940972 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.940930    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bca35112-6d57-4790-b769-71fefbc8f5cc-tls-certs\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:09:12.940972 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.940965    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-tmp-dir\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:09:12.940972 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.940977    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-home\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:09:12.941230 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.940985    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bca35112-6d57-4790-b769-71fefbc8f5cc-dshm\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:09:12.941230 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.940993    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9kt6\" (UniqueName: \"kubernetes.io/projected/bca35112-6d57-4790-b769-71fefbc8f5cc-kube-api-access-b9kt6\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:09:12.999971 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.999935    2580 generic.go:356] "Generic (PLEG): container finished" podID="bca35112-6d57-4790-b769-71fefbc8f5cc" containerID="8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b" exitCode=0
Jul 27 21:09:13.000149 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.999981    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"
Jul 27 21:09:13.000149 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:12.999984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw" event={"ID":"bca35112-6d57-4790-b769-71fefbc8f5cc","Type":"ContainerDied","Data":"8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b"}
Jul 27 21:09:13.000149 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:13.000106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw" event={"ID":"bca35112-6d57-4790-b769-71fefbc8f5cc","Type":"ContainerDied","Data":"c5b6b3d6444039db1303c78976ee03effb032cb1da77fe1b247b0a82b45a5117"}
Jul 27 21:09:13.000149 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:13.000134    2580 scope.go:117] "RemoveContainer" containerID="8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b"
Jul 27 21:09:13.009740 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:13.009718    2580 scope.go:117] "RemoveContainer" containerID="8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b"
Jul 27 21:09:13.010070 ip-10-0-139-20 kubenswrapper[2580]: E0727 21:09:13.010048    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b\": container with ID starting with 8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b not found: ID does not exist" containerID="8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b"
Jul 27 21:09:13.010178 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:13.010078    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b"} err="failed to get container status \"8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b\": rpc error: code = NotFound desc = could not find container \"8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b\": container with ID starting with 8ca3645434369feed8505bc8f4a78472ccae9a5bc93019a66a010dd98a1d6c4b not found: ID does not exist"
Jul 27 21:09:13.023471 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:13.023442    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"]
Jul 27 21:09:13.028334 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:13.028309    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-6d6a46/ipp-route-6d6a46-kserve-6d57fdb58c-955pw"]
Jul 27 21:09:14.904178 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:14.904140    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bca35112-6d57-4790-b769-71fefbc8f5cc" path="/var/lib/kubelet/pods/bca35112-6d57-4790-b769-71fefbc8f5cc/volumes"
Jul 27 21:09:41.230304 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.230266    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5"]
Jul 27 21:09:41.230743 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.230700    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c4cf0c1-029f-4ddd-a221-ebbcf5531fee" containerName="maas-api"
Jul 27 21:09:41.230743 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.230712    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c4cf0c1-029f-4ddd-a221-ebbcf5531fee" containerName="maas-api"
Jul 27 21:09:41.230743 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.230722    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf279c0f-360a-443f-ba99-c495d95e04f6" containerName="registry-server"
Jul 27 21:09:41.230743 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.230729    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf279c0f-360a-443f-ba99-c495d95e04f6" containerName="registry-server"
Jul 27 21:09:41.230743 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.230737    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca35112-6d57-4790-b769-71fefbc8f5cc" containerName="main"
Jul 27 21:09:41.230743 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.230767    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca35112-6d57-4790-b769-71fefbc8f5cc" containerName="main"
Jul 27 21:09:41.231000 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.230854    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bca35112-6d57-4790-b769-71fefbc8f5cc" containerName="main"
Jul 27 21:09:41.231000 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.230866    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c4cf0c1-029f-4ddd-a221-ebbcf5531fee" containerName="maas-api"
Jul 27 21:09:41.231000 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.230873    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf279c0f-360a-443f-ba99-c495d95e04f6" containerName="registry-server"
Jul 27 21:09:41.234070 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.234054    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5"
Jul 27 21:09:41.236759 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.236726    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 21:09:41.246105 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.246081    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5"]
Jul 27 21:09:41.327528 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.327489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bca498-bc76-42c9-a342-0431c805ef6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5\" (UID: \"47bca498-bc76-42c9-a342-0431c805ef6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5"
Jul 27 21:09:41.429148 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.429106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bca498-bc76-42c9-a342-0431c805ef6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5\" (UID: \"47bca498-bc76-42c9-a342-0431c805ef6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5"
Jul 27 21:09:41.429775 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.429735    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bca498-bc76-42c9-a342-0431c805ef6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5\" (UID: \"47bca498-bc76-42c9-a342-0431c805ef6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5"
Jul 27 21:09:41.545037 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.545003    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5"
Jul 27 21:09:41.693025 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:09:41.692985    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47bca498_bc76_42c9_a342_0431c805ef6f.slice/crio-6f8d5bb602f15617175863569554533cb741ccbb2cf21650d7a72dbdba24b508 WatchSource:0}: Error finding container 6f8d5bb602f15617175863569554533cb741ccbb2cf21650d7a72dbdba24b508: Status 404 returned error can't find the container with id 6f8d5bb602f15617175863569554533cb741ccbb2cf21650d7a72dbdba24b508
Jul 27 21:09:41.693854 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:41.693778    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5"]
Jul 27 21:09:42.200303 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:42.200263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5" event={"ID":"47bca498-bc76-42c9-a342-0431c805ef6f","Type":"ContainerStarted","Data":"a1a2d84861932a3af710fccfeec6921d0df24cd8591898876cf65816fa013f87"}
Jul 27 21:09:42.200487 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:42.200351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5" event={"ID":"47bca498-bc76-42c9-a342-0431c805ef6f","Type":"ContainerStarted","Data":"6f8d5bb602f15617175863569554533cb741ccbb2cf21650d7a72dbdba24b508"}
Jul 27 21:09:42.218758 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:42.218640    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5" podStartSLOduration=1.218622878 podStartE2EDuration="1.218622878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:09:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:09:42.215144083 +0000 UTC m=+3137.871299427" watchObservedRunningTime="2026-07-27 21:09:42.218622878 +0000 UTC m=+3137.874778222"
Jul 27 21:09:43.209398 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:43.209361    2580 generic.go:356] "Generic (PLEG): container finished" podID="47bca498-bc76-42c9-a342-0431c805ef6f" containerID="a1a2d84861932a3af710fccfeec6921d0df24cd8591898876cf65816fa013f87" exitCode=0
Jul 27 21:09:43.209824 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:43.209422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5" event={"ID":"47bca498-bc76-42c9-a342-0431c805ef6f","Type":"ContainerDied","Data":"a1a2d84861932a3af710fccfeec6921d0df24cd8591898876cf65816fa013f87"}
Jul 27 21:09:44.374099 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:44.374073    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5"
Jul 27 21:09:44.562708 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:44.562669    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bca498-bc76-42c9-a342-0431c805ef6f-maas-api-service-ca\") pod \"47bca498-bc76-42c9-a342-0431c805ef6f\" (UID: \"47bca498-bc76-42c9-a342-0431c805ef6f\") "
Jul 27 21:09:44.563119 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:44.563089    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47bca498-bc76-42c9-a342-0431c805ef6f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "47bca498-bc76-42c9-a342-0431c805ef6f" (UID: "47bca498-bc76-42c9-a342-0431c805ef6f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:09:44.664628 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:44.664593    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bca498-bc76-42c9-a342-0431c805ef6f-maas-api-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:09:45.223407 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:45.223316    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5"
Jul 27 21:09:45.223407 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:45.223338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5" event={"ID":"47bca498-bc76-42c9-a342-0431c805ef6f","Type":"ContainerDied","Data":"6f8d5bb602f15617175863569554533cb741ccbb2cf21650d7a72dbdba24b508"}
Jul 27 21:09:45.223407 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:45.223394    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f8d5bb602f15617175863569554533cb741ccbb2cf21650d7a72dbdba24b508"
Jul 27 21:09:51.689677 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:51.689462    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"]
Jul 27 21:09:51.690116 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:51.689727    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw" podUID="b9e77d78-4f62-43ab-a756-092843e098af" containerName="maas-api" containerID="cri-o://e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86" gracePeriod=30
Jul 27 21:09:51.960005 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:51.959979    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:09:52.036275 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.036233    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e77d78-4f62-43ab-a756-092843e098af-openshift-service-ca\") pod \"b9e77d78-4f62-43ab-a756-092843e098af\" (UID: \"b9e77d78-4f62-43ab-a756-092843e098af\") "
Jul 27 21:09:52.036458 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.036409    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e77d78-4f62-43ab-a756-092843e098af-maas-api-tls\") pod \"b9e77d78-4f62-43ab-a756-092843e098af\" (UID: \"b9e77d78-4f62-43ab-a756-092843e098af\") "
Jul 27 21:09:52.036507 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.036488    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwfj6\" (UniqueName: \"kubernetes.io/projected/b9e77d78-4f62-43ab-a756-092843e098af-kube-api-access-pwfj6\") pod \"b9e77d78-4f62-43ab-a756-092843e098af\" (UID: \"b9e77d78-4f62-43ab-a756-092843e098af\") "
Jul 27 21:09:52.036651 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.036621    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9e77d78-4f62-43ab-a756-092843e098af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9e77d78-4f62-43ab-a756-092843e098af" (UID: "b9e77d78-4f62-43ab-a756-092843e098af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:09:52.036886 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.036860    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e77d78-4f62-43ab-a756-092843e098af-openshift-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:09:52.038550 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.038525    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e77d78-4f62-43ab-a756-092843e098af-kube-api-access-pwfj6" (OuterVolumeSpecName: "kube-api-access-pwfj6") pod "b9e77d78-4f62-43ab-a756-092843e098af" (UID: "b9e77d78-4f62-43ab-a756-092843e098af"). InnerVolumeSpecName "kube-api-access-pwfj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:09:52.038682 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.038640    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9e77d78-4f62-43ab-a756-092843e098af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9e77d78-4f62-43ab-a756-092843e098af" (UID: "b9e77d78-4f62-43ab-a756-092843e098af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:09:52.137547 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.137503    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e77d78-4f62-43ab-a756-092843e098af-maas-api-tls\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:09:52.137547 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.137545    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwfj6\" (UniqueName: \"kubernetes.io/projected/b9e77d78-4f62-43ab-a756-092843e098af-kube-api-access-pwfj6\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:09:52.275973 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.275878    2580 generic.go:356] "Generic (PLEG): container finished" podID="b9e77d78-4f62-43ab-a756-092843e098af" containerID="e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86" exitCode=0
Jul 27 21:09:52.275973 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.275943    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"
Jul 27 21:09:52.276162 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.275965    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw" event={"ID":"b9e77d78-4f62-43ab-a756-092843e098af","Type":"ContainerDied","Data":"e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86"}
Jul 27 21:09:52.276162 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.276052    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw" event={"ID":"b9e77d78-4f62-43ab-a756-092843e098af","Type":"ContainerDied","Data":"8e579492cecbc17908178ec7112d327e9a55e2c6f170ea4bddb986ca248aa087"}
Jul 27 21:09:52.276162 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.276077    2580 scope.go:117] "RemoveContainer" containerID="e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86"
Jul 27 21:09:52.287364 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.287345    2580 scope.go:117] "RemoveContainer" containerID="e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86"
Jul 27 21:09:52.287705 ip-10-0-139-20 kubenswrapper[2580]: E0727 21:09:52.287678    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86\": container with ID starting with e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86 not found: ID does not exist" containerID="e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86"
Jul 27 21:09:52.287788 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.287715    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86"} err="failed to get container status \"e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86\": rpc error: code = NotFound desc = could not find container \"e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86\": container with ID starting with e5bd408b5d4ab33bebc6a2c349618da81893afc0d2f416c5bbb091534c815c86 not found: ID does not exist"
Jul 27 21:09:52.303732 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.303702    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"]
Jul 27 21:09:52.306559 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.306534    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-cae454-7b87c458fb-wjlgw"]
Jul 27 21:09:52.903134 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:52.903091    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9e77d78-4f62-43ab-a756-092843e098af" path="/var/lib/kubelet/pods/b9e77d78-4f62-43ab-a756-092843e098af/volumes"
Jul 27 21:09:56.305042 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:56.305011    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5"]
Jul 27 21:09:56.307519 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:56.307497    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cae454-pfqg5"]
Jul 27 21:09:56.903650 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:09:56.903614    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47bca498-bc76-42c9-a342-0431c805ef6f" path="/var/lib/kubelet/pods/47bca498-bc76-42c9-a342-0431c805ef6f/volumes"
Jul 27 21:10:03.319820 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.319780    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2"]
Jul 27 21:10:03.320301 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.320243    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e77d78-4f62-43ab-a756-092843e098af" containerName="maas-api"
Jul 27 21:10:03.320301 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.320255    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e77d78-4f62-43ab-a756-092843e098af" containerName="maas-api"
Jul 27 21:10:03.320301 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.320269    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47bca498-bc76-42c9-a342-0431c805ef6f" containerName="revoke-keys"
Jul 27 21:10:03.320301 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.320274    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="47bca498-bc76-42c9-a342-0431c805ef6f" containerName="revoke-keys"
Jul 27 21:10:03.320436 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.320349    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9e77d78-4f62-43ab-a756-092843e098af" containerName="maas-api"
Jul 27 21:10:03.320436 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.320358    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="47bca498-bc76-42c9-a342-0431c805ef6f" containerName="revoke-keys"
Jul 27 21:10:03.325181 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.325162    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2"
Jul 27 21:10:03.327922 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.327900    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 21:10:03.332926 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.332888    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2"]
Jul 27 21:10:03.450190 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.450155    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6975901-b23f-454b-87f0-ccbaacedbf97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2\" (UID: \"f6975901-b23f-454b-87f0-ccbaacedbf97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2"
Jul 27 21:10:03.551295 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.551259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6975901-b23f-454b-87f0-ccbaacedbf97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2\" (UID: \"f6975901-b23f-454b-87f0-ccbaacedbf97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2"
Jul 27 21:10:03.551953 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.551933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6975901-b23f-454b-87f0-ccbaacedbf97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2\" (UID: \"f6975901-b23f-454b-87f0-ccbaacedbf97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2"
Jul 27 21:10:03.638489 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.638404    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2"
Jul 27 21:10:03.778158 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:03.778125    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2"]
Jul 27 21:10:03.778358 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:10:03.778329    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6975901_b23f_454b_87f0_ccbaacedbf97.slice/crio-d465afdb027d512da79c11e3e4a467aabe5bac1b69a886d85497d91a4ca081a7 WatchSource:0}: Error finding container d465afdb027d512da79c11e3e4a467aabe5bac1b69a886d85497d91a4ca081a7: Status 404 returned error can't find the container with id d465afdb027d512da79c11e3e4a467aabe5bac1b69a886d85497d91a4ca081a7
Jul 27 21:10:04.357537 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:04.357498    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2" event={"ID":"f6975901-b23f-454b-87f0-ccbaacedbf97","Type":"ContainerStarted","Data":"918ae46eed78bfefedd3e640b3648a391a60996da22abce311b0ce189bf5745b"}
Jul 27 21:10:04.357956 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:04.357564    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2" event={"ID":"f6975901-b23f-454b-87f0-ccbaacedbf97","Type":"ContainerStarted","Data":"d465afdb027d512da79c11e3e4a467aabe5bac1b69a886d85497d91a4ca081a7"}
Jul 27 21:10:04.380192 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:04.380142    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2" podStartSLOduration=1.380127329 podStartE2EDuration="1.380127329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:04.378166357 +0000 UTC m=+3160.034321701" watchObservedRunningTime="2026-07-27 21:10:04.380127329 +0000 UTC m=+3160.036282671"
Jul 27 21:10:05.373665 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:05.373632    2580 generic.go:356] "Generic (PLEG): container finished" podID="f6975901-b23f-454b-87f0-ccbaacedbf97" containerID="918ae46eed78bfefedd3e640b3648a391a60996da22abce311b0ce189bf5745b" exitCode=0
Jul 27 21:10:05.374125 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:05.373729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2" event={"ID":"f6975901-b23f-454b-87f0-ccbaacedbf97","Type":"ContainerDied","Data":"918ae46eed78bfefedd3e640b3648a391a60996da22abce311b0ce189bf5745b"}
Jul 27 21:10:06.523383 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:06.523356    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2"
Jul 27 21:10:06.580759 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:06.580713    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6975901-b23f-454b-87f0-ccbaacedbf97-maas-api-service-ca\") pod \"f6975901-b23f-454b-87f0-ccbaacedbf97\" (UID: \"f6975901-b23f-454b-87f0-ccbaacedbf97\") "
Jul 27 21:10:06.581098 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:06.581073    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6975901-b23f-454b-87f0-ccbaacedbf97-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f6975901-b23f-454b-87f0-ccbaacedbf97" (UID: "f6975901-b23f-454b-87f0-ccbaacedbf97"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:10:06.681919 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:06.681822    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6975901-b23f-454b-87f0-ccbaacedbf97-maas-api-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:10:07.388032 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:07.388000    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2"
Jul 27 21:10:07.388220 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:07.388031    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2" event={"ID":"f6975901-b23f-454b-87f0-ccbaacedbf97","Type":"ContainerDied","Data":"d465afdb027d512da79c11e3e4a467aabe5bac1b69a886d85497d91a4ca081a7"}
Jul 27 21:10:07.388220 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:07.388080    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d465afdb027d512da79c11e3e4a467aabe5bac1b69a886d85497d91a4ca081a7"
Jul 27 21:10:13.807549 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:13.807515    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx"]
Jul 27 21:10:13.811951 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:13.811910    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-132aad-29753100-qp9zx"]
Jul 27 21:10:14.903840 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:14.903802    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="113b6e71-38a9-4a26-b8e4-f0b197bcc1c1" path="/var/lib/kubelet/pods/113b6e71-38a9-4a26-b8e4-f0b197bcc1c1/volumes"
Jul 27 21:10:18.400502 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:18.400470    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2"]
Jul 27 21:10:18.405929 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:18.405900    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-132aad-lxxk2"]
Jul 27 21:10:18.902689 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:18.902654    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6975901-b23f-454b-87f0-ccbaacedbf97" path="/var/lib/kubelet/pods/f6975901-b23f-454b-87f0-ccbaacedbf97/volumes"
Jul 27 21:10:25.178782 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:25.178731    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq"]
Jul 27 21:10:25.179249 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:25.179234    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6975901-b23f-454b-87f0-ccbaacedbf97" containerName="revoke-keys"
Jul 27 21:10:25.179292 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:25.179251    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6975901-b23f-454b-87f0-ccbaacedbf97" containerName="revoke-keys"
Jul 27 21:10:25.179351 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:25.179342    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6975901-b23f-454b-87f0-ccbaacedbf97" containerName="revoke-keys"
Jul 27 21:10:25.183689 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:25.183670    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq"
Jul 27 21:10:25.186542 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:25.186237    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xw8dl\""
Jul 27 21:10:25.190648 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:25.190620    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq"]
Jul 27 21:10:25.268883 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:25.268835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq\" (UID: \"05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq"
Jul 27 21:10:25.370044 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:25.370008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq\" (UID: \"05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq"
Jul 27 21:10:25.370665 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:25.370646    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq\" (UID: \"05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq"
Jul 27 21:10:25.496592 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:25.496504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq"
Jul 27 21:10:25.846519 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:25.846493    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq"]
Jul 27 21:10:25.847678 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:10:25.847655    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d9c570_3ace_42e3_85fe_eeaa4ff7b6b6.slice/crio-31f1d92413ea9d762a0ed5300e3a3784645ebbfb389ff361c4f05020dca1cb3b WatchSource:0}: Error finding container 31f1d92413ea9d762a0ed5300e3a3784645ebbfb389ff361c4f05020dca1cb3b: Status 404 returned error can't find the container with id 31f1d92413ea9d762a0ed5300e3a3784645ebbfb389ff361c4f05020dca1cb3b
Jul 27 21:10:26.518386 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:26.518275    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq" event={"ID":"05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6","Type":"ContainerStarted","Data":"00a4788b30a141bc8e0b0606be41386dd889f67392ee44788787ae85ad63c192"}
Jul 27 21:10:26.518386 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:26.518333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq" event={"ID":"05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6","Type":"ContainerStarted","Data":"31f1d92413ea9d762a0ed5300e3a3784645ebbfb389ff361c4f05020dca1cb3b"}
Jul 27 21:10:26.537282 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:26.537226    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq" podStartSLOduration=1.537207645 podStartE2EDuration="1.537207645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:26.53379389 +0000 UTC m=+3182.189949230" watchObservedRunningTime="2026-07-27 21:10:26.537207645 +0000 UTC m=+3182.193362989"
Jul 27 21:10:27.110623 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:27.110589    2580 scope.go:117] "RemoveContainer" containerID="e7bdb111ac3a97513df9ff03c7aaeaa77bdddb8659a8a9ea5db3eaada820580b"
Jul 27 21:10:27.526627 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:27.526532    2580 generic.go:356] "Generic (PLEG): container finished" podID="05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6" containerID="00a4788b30a141bc8e0b0606be41386dd889f67392ee44788787ae85ad63c192" exitCode=0
Jul 27 21:10:27.526627 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:27.526604    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq" event={"ID":"05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6","Type":"ContainerDied","Data":"00a4788b30a141bc8e0b0606be41386dd889f67392ee44788787ae85ad63c192"}
Jul 27 21:10:28.675683 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:28.675654    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq"
Jul 27 21:10:28.703052 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:28.702269    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6-maas-api-service-ca\") pod \"05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6\" (UID: \"05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6\") "
Jul 27 21:10:28.703379 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:28.703347    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6" (UID: "05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:10:28.804220 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:28.804123    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6-maas-api-service-ca\") on node \"ip-10-0-139-20.ec2.internal\" DevicePath \"\""
Jul 27 21:10:29.541069 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:29.541039    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq"
Jul 27 21:10:29.541249 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:29.541081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq" event={"ID":"05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6","Type":"ContainerDied","Data":"31f1d92413ea9d762a0ed5300e3a3784645ebbfb389ff361c4f05020dca1cb3b"}
Jul 27 21:10:29.541249 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:29.541138    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31f1d92413ea9d762a0ed5300e3a3784645ebbfb389ff361c4f05020dca1cb3b"
Jul 27 21:10:35.644043 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:35.643997    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s"]
Jul 27 21:10:35.647265 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:35.647231    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-66b603-29753100-42h7s"]
Jul 27 21:10:36.903100 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:36.903067    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ebed2e0-c8dc-4b33-bec2-022b14152159" path="/var/lib/kubelet/pods/3ebed2e0-c8dc-4b33-bec2-022b14152159/volumes"
Jul 27 21:10:40.258000 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:40.257954    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq"]
Jul 27 21:10:40.260548 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:40.260519    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66b603-fgzwq"]
Jul 27 21:10:40.903509 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:40.903471    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6" path="/var/lib/kubelet/pods/05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6/volumes"
Jul 27 21:10:47.743356 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:47.743318    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76454666df-jlxzk_61810c8a-925e-49be-b56f-07e0b61f9c7b/authorino/0.log"
Jul 27 21:10:53.030439 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:53.030408    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v478z_dfaef796-b214-4318-a774-805d734db22a/manager/0.log"
Jul 27 21:10:53.157968 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:53.157938    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dgh4l_bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9/manager/0.log"
Jul 27 21:10:53.565858 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:53.565814    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9d6v5_34230126-94de-401a-9b97-2c6a23389ae8/manager/0.log"
Jul 27 21:10:53.811608 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:53.811572    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8fd6b656-8cfwr_e71996de-f400-4bf6-9103-c7edf7801c24/copy-manifests/0.log"
Jul 27 21:10:53.820071 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:53.819984    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8fd6b656-8cfwr_e71996de-f400-4bf6-9103-c7edf7801c24/manager/0.log"
Jul 27 21:10:54.278856 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:54.278767    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7685ffc6c7-4wsx7_c638dd28-067b-457c-99d6-683643719783/maas-api/0.log"
Jul 27 21:10:54.714029 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:54.713994    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-wt7xj_72ced759-bb14-48e1-99c6-94c0689f510b/postgres/0.log"
Jul 27 21:10:55.475668 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.475629    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29_1f6b017c-b54f-47e1-8004-aecc817c11e2/pull/0.log"
Jul 27 21:10:55.482864 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.482838    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29_1f6b017c-b54f-47e1-8004-aecc817c11e2/extract/0.log"
Jul 27 21:10:55.488648 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.488624    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29_1f6b017c-b54f-47e1-8004-aecc817c11e2/util/0.log"
Jul 27 21:10:55.601492 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.601458    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx_1f231303-b6d4-4e5d-a587-42375dcf5a20/util/0.log"
Jul 27 21:10:55.608430 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.608402    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx_1f231303-b6d4-4e5d-a587-42375dcf5a20/pull/0.log"
Jul 27 21:10:55.615325 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.615299    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx_1f231303-b6d4-4e5d-a587-42375dcf5a20/extract/0.log"
Jul 27 21:10:55.729132 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.729044    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4_92388ca6-1733-4b12-89c7-673632de1ac4/util/0.log"
Jul 27 21:10:55.736346 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.736317    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4_92388ca6-1733-4b12-89c7-673632de1ac4/pull/0.log"
Jul 27 21:10:55.744009 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.743983    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4_92388ca6-1733-4b12-89c7-673632de1ac4/extract/0.log"
Jul 27 21:10:55.850841 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.850811    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk_ae72ac99-02d5-41fc-a256-1af902eac455/util/0.log"
Jul 27 21:10:55.857184 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.857156    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk_ae72ac99-02d5-41fc-a256-1af902eac455/pull/0.log"
Jul 27 21:10:55.863689 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.863666    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk_ae72ac99-02d5-41fc-a256-1af902eac455/extract/0.log"
Jul 27 21:10:55.987405 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:55.987287    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76454666df-jlxzk_61810c8a-925e-49be-b56f-07e0b61f9c7b/authorino/0.log"
Jul 27 21:10:56.098620 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:56.098589    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ldc54_0a08926b-049f-4722-846c-41b4ea4fd1c7/manager/0.log"
Jul 27 21:10:56.206644 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:56.206611    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s8x9x_762d4d63-7f89-4379-9854-b89dae61a3ce/manager/0.log"
Jul 27 21:10:56.314915 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:56.314889    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rx77d_91237c94-9c3b-4508-8f24-2d8e5f551ef8/kuadrant-console-plugin/0.log"
Jul 27 21:10:56.435311 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:56.435278    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2nxm9_1ecb2cd3-6906-4dd4-a647-d2ba7d1b09cf/registry-server/0.log"
Jul 27 21:10:56.784283 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:56.784253    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xxzhp_8fa5522d-fe95-4f8b-8e4c-d6b425cec567/manager/0.log"
Jul 27 21:10:57.122249 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:57.122148    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz_6f101355-fb89-44aa-9771-e1d80fb4ac8a/istio-proxy/0.log"
Jul 27 21:10:57.349794 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:57.349736    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59b675654c-dcxj2_505f4a06-57ee-475c-bd78-24f4d9359815/kube-auth-proxy/0.log"
Jul 27 21:10:57.583207 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:57.583178    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xr7hz_60e7f197-5fb2-47ed-9000-fd326c12eb3f/istio-proxy/1.log"
Jul 27 21:10:57.708489 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:57.708454    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-fg87n_0b11532d-e0df-49bf-bf7b-ca20ead9d7bb/payload-pre-processing/0.log"
Jul 27 21:10:57.826010 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:57.825976    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-sb92s_6d73fc6c-684b-4483-91c7-d61cdce108aa/payload-processing/0.log"
Jul 27 21:10:57.935794 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:57.935689    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f5f9b87f-2bfnt_0013340e-a437-449d-9668-5bfcd6ebd16c/router/0.log"
Jul 27 21:10:58.274860 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:58.274773    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-j62gc_671966c0-01ee-4c1b-9648-087cb7f361f4/main/0.log"
Jul 27 21:10:58.605263 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:58.605232    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2pm7g_6171d123-4fd1-438f-957f-c6d063be0af3/main/0.log"
Jul 27 21:10:58.824819 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:10:58.824793    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-h85cj_877af25c-0809-4835-944c-6ebe41e91221/main/0.log"
Jul 27 21:11:06.996172 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:06.996134    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k7v72_018163d0-e356-4286-b3e3-2b32e0afdf23/global-pull-secret-syncer/0.log"
Jul 27 21:11:07.175977 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:07.175945    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zllw5_3459e0f1-bf89-482c-96cd-dbd50ea26125/konnectivity-agent/0.log"
Jul 27 21:11:07.225661 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:07.225629    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-20.ec2.internal_ef9ae45a7bae6d28e2a06a2229f4e588/haproxy/0.log"
Jul 27 21:11:11.304208 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:11.304168    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29_1f6b017c-b54f-47e1-8004-aecc817c11e2/extract/0.log"
Jul 27 21:11:11.325865 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:11.325803    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29_1f6b017c-b54f-47e1-8004-aecc817c11e2/util/0.log"
Jul 27 21:11:11.354404 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:11.354361    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595lv29_1f6b017c-b54f-47e1-8004-aecc817c11e2/pull/0.log"
Jul 27 21:11:11.384415 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:11.384382    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx_1f231303-b6d4-4e5d-a587-42375dcf5a20/extract/0.log"
Jul 27 21:11:11.407849 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:11.407819    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx_1f231303-b6d4-4e5d-a587-42375dcf5a20/util/0.log"
Jul 27 21:11:11.431428 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:11.431398    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e082rjx_1f231303-b6d4-4e5d-a587-42375dcf5a20/pull/0.log"
Jul 27 21:11:11.484251 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:11.484217    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4_92388ca6-1733-4b12-89c7-673632de1ac4/extract/0.log"
Jul 27 21:11:11.509973 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:11.509944    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4_92388ca6-1733-4b12-89c7-673632de1ac4/util/0.log"
Jul 27 21:11:11.532766 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:11.532719    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wq5f4_92388ca6-1733-4b12-89c7-673632de1ac4/pull/0.log"
Jul 27 21:11:11.562633 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:11.562607    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk_ae72ac99-02d5-41fc-a256-1af902eac455/extract/0.log"
Jul 27 21:11:11.591299 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:11.591271    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk_ae72ac99-02d5-41fc-a256-1af902eac455/util/0.log"
Jul 27 21:11:11.632299 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:11.632268    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2kxk_ae72ac99-02d5-41fc-a256-1af902eac455/pull/0.log"
Jul 27 21:11:12.273165 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:12.273122    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76454666df-jlxzk_61810c8a-925e-49be-b56f-07e0b61f9c7b/authorino/0.log"
Jul 27 21:11:12.308653 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:12.308617    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ldc54_0a08926b-049f-4722-846c-41b4ea4fd1c7/manager/0.log"
Jul 27 21:11:12.341909 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:12.341876    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s8x9x_762d4d63-7f89-4379-9854-b89dae61a3ce/manager/0.log"
Jul 27 21:11:12.371259 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:12.371233    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rx77d_91237c94-9c3b-4508-8f24-2d8e5f551ef8/kuadrant-console-plugin/0.log"
Jul 27 21:11:12.440237 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:12.440206    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2nxm9_1ecb2cd3-6906-4dd4-a647-d2ba7d1b09cf/registry-server/0.log"
Jul 27 21:11:12.860710 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:12.860678    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xxzhp_8fa5522d-fe95-4f8b-8e4c-d6b425cec567/manager/0.log"
Jul 27 21:11:14.569925 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:14.569897    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9409878d-b5e2-4d77-a911-0229753e6954/alertmanager/0.log"
Jul 27 21:11:14.599044 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:14.599006    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9409878d-b5e2-4d77-a911-0229753e6954/config-reloader/0.log"
Jul 27 21:11:14.622089 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:14.622059    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9409878d-b5e2-4d77-a911-0229753e6954/kube-rbac-proxy-web/0.log"
Jul 27 21:11:14.648669 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:14.648644    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9409878d-b5e2-4d77-a911-0229753e6954/kube-rbac-proxy/0.log"
Jul 27 21:11:14.669928 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:14.669900    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9409878d-b5e2-4d77-a911-0229753e6954/kube-rbac-proxy-metric/0.log"
Jul 27 21:11:14.694801 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:14.694774    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9409878d-b5e2-4d77-a911-0229753e6954/prom-label-proxy/0.log"
Jul 27 21:11:14.716601 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:14.716574    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9409878d-b5e2-4d77-a911-0229753e6954/init-config-reloader/0.log"
Jul 27 21:11:14.769589 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:14.769556    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-t44h7_c5b42704-6ac3-4fe3-a7d9-6e327f59bccd/cluster-monitoring-operator/0.log"
Jul 27 21:11:14.934322 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:14.934226    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wm8f_4b6e274b-669e-4670-b4d4-43daed3ac433/node-exporter/0.log"
Jul 27 21:11:14.963065 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:14.963031    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wm8f_4b6e274b-669e-4670-b4d4-43daed3ac433/kube-rbac-proxy/0.log"
Jul 27 21:11:14.988970 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:14.988943    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wm8f_4b6e274b-669e-4670-b4d4-43daed3ac433/init-textfile/0.log"
Jul 27 21:11:15.554015 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:15.553984    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c7658747b-r6rhx_2d2ac731-521d-4d05-b94c-43a820621c07/telemeter-client/0.log"
Jul 27 21:11:15.575513 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:15.575486    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c7658747b-r6rhx_2d2ac731-521d-4d05-b94c-43a820621c07/reload/0.log"
Jul 27 21:11:15.601879 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:15.601840    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c7658747b-r6rhx_2d2ac731-521d-4d05-b94c-43a820621c07/kube-rbac-proxy/0.log"
Jul 27 21:11:16.919225 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:16.919143    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-h25jw_b15e2e83-21fe-4673-b2ca-46c2ce42a4f3/networking-console-plugin/0.log"
Jul 27 21:11:17.108937 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.108898    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"]
Jul 27 21:11:17.109427 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.109411    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6" containerName="revoke-keys"
Jul 27 21:11:17.109427 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.109428    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6" containerName="revoke-keys"
Jul 27 21:11:17.109519 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.109513    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="05d9c570-3ace-42e3-85fe-eeaa4ff7b6b6" containerName="revoke-keys"
Jul 27 21:11:17.112802 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.112776    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.115125 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.115102    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5ws2\"/\"openshift-service-ca.crt\""
Jul 27 21:11:17.115255 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.115214    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5ws2\"/\"kube-root-ca.crt\""
Jul 27 21:11:17.115381 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.115274    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n5ws2\"/\"default-dockercfg-4f785\""
Jul 27 21:11:17.124277 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.124251    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"]
Jul 27 21:11:17.165626 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.165589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b79c09b-69eb-4a76-a245-2fd76a23051b-podres\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.165850 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.165782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b79c09b-69eb-4a76-a245-2fd76a23051b-sys\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.165850 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.165814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqt4h\" (UniqueName: \"kubernetes.io/projected/7b79c09b-69eb-4a76-a245-2fd76a23051b-kube-api-access-mqt4h\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.165971 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.165853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b79c09b-69eb-4a76-a245-2fd76a23051b-proc\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.165971 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.165909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b79c09b-69eb-4a76-a245-2fd76a23051b-lib-modules\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.267059 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.266968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b79c09b-69eb-4a76-a245-2fd76a23051b-sys\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.267059 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.267006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqt4h\" (UniqueName: \"kubernetes.io/projected/7b79c09b-69eb-4a76-a245-2fd76a23051b-kube-api-access-mqt4h\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.267059 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.267027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b79c09b-69eb-4a76-a245-2fd76a23051b-proc\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.267328 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.267082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b79c09b-69eb-4a76-a245-2fd76a23051b-lib-modules\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.267328 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.267100    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b79c09b-69eb-4a76-a245-2fd76a23051b-sys\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.267328 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.267107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b79c09b-69eb-4a76-a245-2fd76a23051b-podres\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.267328 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.267175    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b79c09b-69eb-4a76-a245-2fd76a23051b-proc\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.267328 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.267215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b79c09b-69eb-4a76-a245-2fd76a23051b-podres\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.267328 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.267245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b79c09b-69eb-4a76-a245-2fd76a23051b-lib-modules\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.275771 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.275736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqt4h\" (UniqueName: \"kubernetes.io/projected/7b79c09b-69eb-4a76-a245-2fd76a23051b-kube-api-access-mqt4h\") pod \"perf-node-gather-daemonset-l5ht4\" (UID: \"7b79c09b-69eb-4a76-a245-2fd76a23051b\") " pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.423927 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.423887    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.568136 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.568104    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"]
Jul 27 21:11:17.569832 ip-10-0-139-20 kubenswrapper[2580]: W0727 21:11:17.569799    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7b79c09b_69eb_4a76_a245_2fd76a23051b.slice/crio-50b8c764b8a39369c38277874fd37996b7f10c021fa014022ed19d49c5bf681e WatchSource:0}: Error finding container 50b8c764b8a39369c38277874fd37996b7f10c021fa014022ed19d49c5bf681e: Status 404 returned error can't find the container with id 50b8c764b8a39369c38277874fd37996b7f10c021fa014022ed19d49c5bf681e
Jul 27 21:11:17.632813 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.632778    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/2.log"
Jul 27 21:11:17.639818 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.639787    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-p68dz_3736de45-8222-42d0-871a-5304b17df9da/console-operator/3.log"
Jul 27 21:11:17.856459 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.856373    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4" event={"ID":"7b79c09b-69eb-4a76-a245-2fd76a23051b","Type":"ContainerStarted","Data":"c9950f022f1bbe0fb418d2a9ca590b18f77598661d66e7955b004cdee18c91a2"}
Jul 27 21:11:17.856459 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.856432    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:17.856459 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.856451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4" event={"ID":"7b79c09b-69eb-4a76-a245-2fd76a23051b","Type":"ContainerStarted","Data":"50b8c764b8a39369c38277874fd37996b7f10c021fa014022ed19d49c5bf681e"}
Jul 27 21:11:17.872693 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:17.872649    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4" podStartSLOduration=0.872634636 podStartE2EDuration="872.634636ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:11:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:11:17.871600368 +0000 UTC m=+3233.527755724" watchObservedRunningTime="2026-07-27 21:11:17.872634636 +0000 UTC m=+3233.528789980"
Jul 27 21:11:18.156129 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:18.156041    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-766f949564-nww57_e54ced22-ea40-44e2-8286-6d3a8a926b23/console/0.log"
Jul 27 21:11:18.763232 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:18.763197    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-dhvxz_3c13e5da-d871-4afa-ae81-bbcb923fd200/volume-data-source-validator/0.log"
Jul 27 21:11:19.790387 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:19.790361    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-67qht_37f6140b-7997-493a-ade8-5d64dd0b4870/dns/0.log"
Jul 27 21:11:19.811076 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:19.811052    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-67qht_37f6140b-7997-493a-ade8-5d64dd0b4870/kube-rbac-proxy/0.log"
Jul 27 21:11:19.927054 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:19.927024    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xlqmn_75c6df92-2bce-4b1e-9e2d-e0ca0812f9de/dns-node-resolver/0.log"
Jul 27 21:11:20.519030 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:20.518996    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vx29c_f4cdb38f-eb44-4a04-9e14-5ff2e5c0cbd6/node-ca/0.log"
Jul 27 21:11:21.436264 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:21.436220    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz_6f101355-fb89-44aa-9771-e1d80fb4ac8a/istio-proxy/0.log"
Jul 27 21:11:21.607590 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:21.607555    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59b675654c-dcxj2_505f4a06-57ee-475c-bd78-24f4d9359815/kube-auth-proxy/0.log"
Jul 27 21:11:21.665070 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:21.665041    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xr7hz_60e7f197-5fb2-47ed-9000-fd326c12eb3f/istio-proxy/0.log"
Jul 27 21:11:21.714339 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:21.714254    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xr7hz_60e7f197-5fb2-47ed-9000-fd326c12eb3f/istio-proxy/1.log"
Jul 27 21:11:21.753372 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:21.753331    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-fg87n_0b11532d-e0df-49bf-bf7b-ca20ead9d7bb/payload-pre-processing/0.log"
Jul 27 21:11:21.791882 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:21.791852    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-sb92s_6d73fc6c-684b-4483-91c7-d61cdce108aa/payload-processing/0.log"
Jul 27 21:11:21.818511 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:21.818468    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f5f9b87f-2bfnt_0013340e-a437-449d-9668-5bfcd6ebd16c/router/0.log"
Jul 27 21:11:22.583344 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:22.583312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8xg2p_3d8bc154-34cd-4fd3-8f9b-b4c0b6a6e81b/serve-healthcheck-canary/0.log"
Jul 27 21:11:23.104806 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:23.104766    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-kdl8p_e3317a2a-a923-430a-80ac-56bc1016877f/insights-operator/0.log"
Jul 27 21:11:23.106188 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:23.106165    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-kdl8p_e3317a2a-a923-430a-80ac-56bc1016877f/insights-operator/1.log"
Jul 27 21:11:23.270033 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:23.270004    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ppjj2_436b68b3-0ad6-4980-9d97-e02c99f8395d/kube-rbac-proxy/0.log"
Jul 27 21:11:23.291196 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:23.291169    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ppjj2_436b68b3-0ad6-4980-9d97-e02c99f8395d/exporter/0.log"
Jul 27 21:11:23.312594 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:23.312566    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ppjj2_436b68b3-0ad6-4980-9d97-e02c99f8395d/extractor/0.log"
Jul 27 21:11:23.873431 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:23.873403    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n5ws2/perf-node-gather-daemonset-l5ht4"
Jul 27 21:11:25.394105 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:25.394076    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v478z_dfaef796-b214-4318-a774-805d734db22a/manager/0.log"
Jul 27 21:11:25.799777 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:25.799708    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dgh4l_bc98a047-2fd0-45ca-9c2c-c7d9cb934dd9/manager/0.log"
Jul 27 21:11:26.130399 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:26.130364    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9d6v5_34230126-94de-401a-9b97-2c6a23389ae8/manager/0.log"
Jul 27 21:11:26.216288 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:26.216251    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8fd6b656-8cfwr_e71996de-f400-4bf6-9103-c7edf7801c24/manager/0.log"
Jul 27 21:11:26.239997 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:26.239964    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8fd6b656-8cfwr_e71996de-f400-4bf6-9103-c7edf7801c24/copy-manifests/0.log"
Jul 27 21:11:27.141055 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:27.140962    2580 scope.go:117] "RemoveContainer" containerID="9ff6bf1f29e86fbafd165ed407475e2811e39116603d68d60733437ad27f397a"
Jul 27 21:11:27.660193 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:27.660160    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz_6f101355-fb89-44aa-9771-e1d80fb4ac8a/istio-proxy/0.log"
Jul 27 21:11:27.823602 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:27.823570    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59b675654c-dcxj2_505f4a06-57ee-475c-bd78-24f4d9359815/kube-auth-proxy/0.log"
Jul 27 21:11:27.871530 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:27.871490    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xr7hz_60e7f197-5fb2-47ed-9000-fd326c12eb3f/istio-proxy/0.log"
Jul 27 21:11:27.922527 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:27.922439    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xr7hz_60e7f197-5fb2-47ed-9000-fd326c12eb3f/istio-proxy/1.log"
Jul 27 21:11:27.952359 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:27.952320    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-fg87n_0b11532d-e0df-49bf-bf7b-ca20ead9d7bb/payload-pre-processing/0.log"
Jul 27 21:11:27.990657 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:27.990625    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-sb92s_6d73fc6c-684b-4483-91c7-d61cdce108aa/payload-processing/0.log"
Jul 27 21:11:28.013552 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:28.013520    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f5f9b87f-2bfnt_0013340e-a437-449d-9668-5bfcd6ebd16c/router/0.log"
Jul 27 21:11:29.413726 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:29.413632    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-v9zcz_6f101355-fb89-44aa-9771-e1d80fb4ac8a/istio-proxy/0.log"
Jul 27 21:11:29.574085 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:29.574052    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59b675654c-dcxj2_505f4a06-57ee-475c-bd78-24f4d9359815/kube-auth-proxy/0.log"
Jul 27 21:11:29.613527 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:29.613493    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xr7hz_60e7f197-5fb2-47ed-9000-fd326c12eb3f/istio-proxy/0.log"
Jul 27 21:11:29.662176 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:29.662141    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xr7hz_60e7f197-5fb2-47ed-9000-fd326c12eb3f/istio-proxy/1.log"
Jul 27 21:11:29.695608 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:29.695518    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-fg87n_0b11532d-e0df-49bf-bf7b-ca20ead9d7bb/payload-pre-processing/0.log"
Jul 27 21:11:29.723074 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:29.723037    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-sb92s_6d73fc6c-684b-4483-91c7-d61cdce108aa/payload-processing/0.log"
Jul 27 21:11:29.742980 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:29.742950    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f5f9b87f-2bfnt_0013340e-a437-449d-9668-5bfcd6ebd16c/router/0.log"
Jul 27 21:11:33.070345 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:33.070315    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb_f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a/kube-storage-version-migrator-operator/1.log"
Jul 27 21:11:33.071794 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:33.071771    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-tc6bb_f9ad22b9-e5e2-4ec0-8333-9c277a96ae3a/kube-storage-version-migrator-operator/0.log"
Jul 27 21:11:34.015052 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:34.015023    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78fk7_204e7972-20a7-442a-a4c3-c29f8e78c3f7/kube-multus-additional-cni-plugins/0.log"
Jul 27 21:11:34.036208 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:34.036164    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78fk7_204e7972-20a7-442a-a4c3-c29f8e78c3f7/egress-router-binary-copy/0.log"
Jul 27 21:11:34.057016 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:34.056982    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78fk7_204e7972-20a7-442a-a4c3-c29f8e78c3f7/cni-plugins/0.log"
Jul 27 21:11:34.077340 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:34.077308    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78fk7_204e7972-20a7-442a-a4c3-c29f8e78c3f7/bond-cni-plugin/0.log"
Jul 27 21:11:34.097201 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:34.097173    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78fk7_204e7972-20a7-442a-a4c3-c29f8e78c3f7/routeoverride-cni/0.log"
Jul 27 21:11:34.117659 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:34.117629    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78fk7_204e7972-20a7-442a-a4c3-c29f8e78c3f7/whereabouts-cni-bincopy/0.log"
Jul 27 21:11:34.138663 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:34.138631    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78fk7_204e7972-20a7-442a-a4c3-c29f8e78c3f7/whereabouts-cni/0.log"
Jul 27 21:11:34.677480 ip-10-0-139-20 kubenswrapper[2580]: I0727 21:11:34.677444    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rznfm_9134f898-53ea-442c-a679-527eedd58c2f/kube-multus/0.log"